HDInsight Emulator Tip #1

When developing map-reduce programs for Microsoft Azures Hadoop implementation, HDInsight, it's often useful to reference data stored in azure.

Here is what I've found works easily but wasn't clear from the examples discovered online:

  • Add a configuration to your core-site.xml file:
<property>
    <name>fs.azure.account.key.<storage-account-name>.blob.core.windows.net</name>
    <value>STORAGE KEY</value>
</property>
  • Refer to the file you want to use as:
wasb://<containername>@<storage-account-name>.blob.core.windows.net/<blobname>