Access to the meeting dataset

[muhangao]

Hi,

May I ask if we still have access to download the dataset? '

When I run the command:
azcopy copy https://notsofarsa.blob.core.windows.net/benchmark-datasets/train_set/240825.1_train/MTG . --recursive

I got the error:

INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to source using Unknown, Please authenticate using Microsoft Entra ID (https://aka.ms/AzCopy/AuthZ), use AzCopy login, or append a SAS token to your Azure URL.
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support

failed to perform copy command due to error: cannot start job due to error: cannot list files due to reason GET https://notsofarsa.blob.core.windows.net/benchmark-datasets
--------------------------------------------------------------------------------
RESPONSE 401: 401 Server failed to authenticate the request. Please refer to the information in the www-authenticate header.
ERROR CODE: NoAuthenticationInformation
--------------------------------------------------------------------------------
<?xml version="1.0" encoding="utf-8"?><Error><Code>NoAuthenticationInformation</Code><Message>Server failed to authenticate the request. Please refer to the information in the www-authenticate header.
RequestId:3523a328-001e-00cb-2177-4b1feb000000
Time:2024-12-11T02:50:22.8410863Z</Message></Error>
--------------------------------------------------------------------------------

Thanks in advance!

[igor0304]

Hi Muhan. Sure, we never planned to revoke access to this data. I am checking what happened. Will get back to you.

[SaddamAnnais]

Hi team. I'm currently having the same issue.

from utils.azure_storage import download_meeting_subset
download_meeting_subset('train_set', '240825.1_train', 'data/meeting_data')

About 3 weeks ago, I have run it and I can download it. Due to some reason I want to download it again and it fails with the same error as @muhangao. Any help would be appreciated, thanks!

[shanguanma]

Hi team, I'm currtently having the similar issue.
NOTE: I have use the command azcopy login and Tip has been successful。
However, I run the below example, it is not still working.

For example:

./azcopy copy https://notsofarsa.blob.core.windows.net/benchmark-datasets/train_set/240825.1_train/MTG . --recursive

The error log:

INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support

failed to perform copy command due to error: cannot start job due to error: cannot list files due to reason GET https://notsofarsa.blob.core.windows.net/benchmark-datasets
--------------------------------------------------------------------------------
RESPONSE 401: 401 Server failed to authenticate the request. Please refer to the information in the www-authenticate header.
ERROR CODE: InvalidAuthenticationInfo
--------------------------------------------------------------------------------
<?xml version="1.0" encoding="utf-8"?><Error><Code>InvalidAuthenticationInfo</Code><Message>Server failed to authenticate the request. Please refer to the information in the www-authenticate header.
RequestId:cea76fac-c01e-007d-7532-5b6d9d000000
Time:2024-12-31T03:17:42.4115452Z</Message><AuthenticationErrorDetail>Issuer validation failed. Issuer did not match.</AuthenticationErrorDetail></Error>
--------------------------------------------------------------------------------
.
ERROR DETAILS: https://aka.ms/AzCopyError/InvalidAuthenticationInfo

Looking forward to your reply.

[igor0304]

Hi. Microsoft's new security policies don't allow public access to this blob anymore. We are working on making the data available through Hugging Face. Sorry for the inconvenience and thanks for your understanding! I hope the data will be accessible again soon.

[igor0304]

Hi. The data is available here: https://huggingface.co/datasets/microsoft/NOTSOFAR/tree/main
The scripts were not updated yet and will keep failing trying to download data from the old location. We are working on this.
Thanks for your patience!

[boeddeker]

Would it be possible to provide .zip or .tar.gz archives for the data? That would make it much easier to download the data:

• A simple wget <link> could download the data
• A simple click in the browser could download the data
• No git lfs or huggingface-cli has to be installed
• Having a single (or few) archives has some download speed advantages

[igor0304]

Yes, sounds reasonable. We'll upload the .zip archives as well.

…

________________________________ From: Christoph Boeddeker Sent: Thursday, January 23, 2025 1:18 AM To: microsoft/NOTSOFAR1-Challenge Cc: Igor Abramovski; Comment Subject: Re: [microsoft/NOTSOFAR1-Challenge] Access to the meeting dataset (Issue #54) Would it be possible to provide .zip or .tar.gz archives for the data? That would make it much easier to download the data: * A simple wget <link> could download the data * A simple click in the browser could download the data * No git lfs or huggingface-cli has to be installed * Having a single (or few) archives has some download speed advantages — Reply to this email directly, view it on GitHub<#54 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/A62UUF4DS2AAIOBXFNXBKP32MCXXFAVCNFSM6AAAAABTMQEHF2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMMBZGI3TIOBSHA>. You are receiving this because you commented.

[huhuqwaszxedc]

@igor0304 Hi, team, Has there been any progress?