从数据湖 (gen1) 复制到 Blob 存储时，数据工厂失去权限
亚历克斯·戈登
尝试从数据湖 gen1 复制到 Blob 存储时，数据工厂给了我这个错误：
"message": "Failure happened on 'Sink' side. ErrorCode=UserErrorFailedFileOperation,
'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Upload file failed at
path myblobcontainer\\file_that_im_tryin_to_copy.xml.,Source=Microsoft.DataTransfer.Common,''Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to read a 'AzureDataLakeStore' file. File path: 'SourceFolderInDataLake/2019/09/26/SomeOtherFile.usql'.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.WebException,Message=The remote server returned an error: (403) Forbidden.
我有一个U-SQL Script将执行的活动1-Patient.usql：
下一个活动是一个copy data步骤：
来源
下沉
我已经使用本教程配置了角色/权限。
我可以通过以下方式解决此问题Data Explorer --> Access：
然后我点击Advanced：
单击Apply to all children后，复制工作正常！
Please note that prior to the Copy Data activity, data factory is executing usql script inside of the gen1. The script is stored in gen1, and it generates files inside of data lake as well as folders. There is never any permissions issue running this script.
What am I doing wrong?
Joy Wang
I can reproduce your issue. Actually the Apply folder permissions to sub-folders is not necessary. The issue should be caused by the access control of data lake gen1, the key to the problem is the order in which files are uploaded and permissions are set.
You could check the Access control in Azure Data Lake Storage Gen1 first and refer to the information below which was based my test.
I suppose you add the permissions like below to the root /.
If your file is already existing before setting the permission, it will be affected by the operation, i.e. the access to the file will be set, you can access the file.
But if you upload the file or create a new folder after setting the permission, the folder and file will not have the access, you will not be able to access them. You could select the file, click the Access to check directly.
After setting the permission above, then if you set the A default permission entry, it will not affect the existing folders and files, but if you create new folders and files, you will get the access of all of them. i.e. the old folder and file still have not access, the new ones will have access. If you want to get the access to the old ones, just add the permissions like the screenshot again, the Apply folder permissions to sub-folders is the same logic.
所以总而言之，如果您希望您的服务主体/MSI 访问数据湖中的所有文件，您可以添加第三个选项An access permission entry and a default permission entry，然后您将能够访问现有和新文件夹/文件。
本文收集自互联网，转载请注明来源。
如有侵权，请联系[email protected] 删除。
编辑于
相关文章
Related 相关文章
- 1
数据湖文件到 blob 性能不佳
- 2
Azure数据工厂到Azure Blob存储权限
- 3
如何使用 Odata 链接服务将文件从共享点复制到 blob 存储 azure 数据工厂 v2
- 4
数据工厂：从Blob复制到SQL后如何执行查询？
- 5
将$ Logs容器数据复制到另一个Blob位置
- 6
使用 Azure 数据工厂 V2 将本地平面文件复制到 Azure Blob
- 7
Nodejs Azure存储将Blob复制到新Blob
- 8
使用数据工厂复制文件时如何在 blob 存储中保留文件夹结构
- 9
将VM映像复制到Blob存储
- 10
将 Blob 从 Azure 存储帐户复制到网络路径
- 11
并行处理Azure blob和批量复制到SQL数据库的设计帮助。C＃
- 12
Azure数据工厂将变量存储到Blob中的文件
- 13
将光标数据复制到arraylist
- 14
将数据复制到JQGrid
- 15
将粘贴的Excel数据复制到
- 16
VBA将数据复制到列
- 17
数据未复制到注册
- 18
JSONObject 数据复制到 JSONArray
- 19
Azure数据湖gen。2（adls2），api获取存储在数据湖中的数据的整体大小
- 20
Azure DevOps-将文件复制到Blob存储时，AzureBlob文件复制任务失败
- 21
通过运行手册将一个 blob 容器数据复制到 azure 中的另一个 blob 容器中
- 22
将数据从GAE复制到本地数据存储失败
- 23
将数据从文件复制到数据存储
- 24
数据工厂复制活动 Blob -> ADLS
- 25
Azure数据工厂->从SQL复制到表存储（布尔映射）
- 26
根据标题将数据从Sheet1复制到Sheet2
- 27
将1列经过过滤的数据复制到另一张纸上
- 28
根据标题将数据从Sheet1复制到Sheet2
- 29
PL / SQL触发器问题（将数据从表1复制到表2）
我来说两句