首页
学习
活动
专区
圈层
工具
发布
首页
学习
活动
专区
圈层
工具
MCP广场
社区首页 >问答首页 >AWS Glue Python Shell download_and_install(args.extra_py_files) - download_from_s3(s3_file_path,local_file_path)

AWS Glue Python Shell download_and_install(args.extra_py_files) - download_from_s3(s3_file_path,local_file_path)
EN

Stack Overflow用户
提问于 2020-01-29 22:55:10
回答 1查看 532关注 0票数 1

我使用的是AWS Glue Python Shell类型。作业失败,并显示错误Command failed with exit code 1。如果我试图看到日志对于特定运行是不可用的。我可以从错误日志中获得的唯一消息是以下错误消息:

代码语言:javascript
运行
复制
Traceback (most recent call last):
  File "/tmp/runscript.py", line 112, in <module>
    download_and_install(args.extra_py_files)
  File "/tmp/runscript.py", line 55, in download_and_install
    download_from_s3(s3_file_path, local_file_path)
  File "/tmp/runscript.py", line 80, in download_from_s3
    s3.download_file(bucket_name, s3_key, new_file_path)
  File "/usr/local/lib/python3.6/site-packages/boto3/s3/inject.py", line 172, in download_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/site-packages/boto3/s3/transfer.py", line 307, in download_file
    future.result()
  File "/usr/local/lib/python3.6/site-packages/s3transfer/futures.py", line 106, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/site-packages/s3transfer/futures.py", line 265, in result
    raise self._exception
  File "/usr/local/lib/python3.6/site-packages/s3transfer/tasks.py", line 255, in _main
    self._submit(transfer_future=transfer_future, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/s3transfer/download.py", line 345, in _submit
    **transfer_future.meta.call_args.extra_args
  File "/usr/local/lib/python3.6/site-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/site-packages/botocore/client.py", line 661, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (404) when calling the HeadObject operation: Not Found

这并没有给我太多的错误信息(错误消息中报告的所有函数/ python文件都与我提交的脚本完全无关)。有什么帮助吗?

EN

回答 1

Stack Overflow用户

发布于 2020-01-29 22:55:10

事实证明,我引用了S3中不存在的文件,在Python lib path字段中错误地导入了库。

错误消息没有多大帮助...我希望我的经验可以帮助其他用户

票数 0
EN
页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接:

https://stackoverflow.com/questions/59969770

复制
相关文章

相似问题

领券
问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档