使用“BadValueError: name必须低于500”的Mapreduce作业随机失败
使用“BadValueError: name必须低于500”的Mapreduce作业随机失败
提问于 2013-03-05 10:47:22
我正在运行一个地图减少作业，它映射了大约100 K的记录。
在数千条记录(每次不同的位置)之后，映射步骤失败，应用程序引擎日志中出现以下错误: BadValueError:名称必须低于500
流水线作业id: baada59c857d11e28527e1efd5a519d7 输出Blob文件名: content_contributors_report_1362478582.csv
原木转储
Final result for job '1581739058957C0CA88F5' is 'success' E2013-03-05
12:25:21.637 name must be under 500 bytes. Traceback (most recent call
last): File
"/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py",
line 1535, in __call__
rv = self.handle_exception(request, response, e) File "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py",
line 1529, in __call__
rv = self.router.dispatch(request, response) File "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py",
line 1278, in default_dispatcher
return route.handler_adapter(request, response) File "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py",
line 1102, in __call__
return handler.dispatch() File "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py",
line 572, in dispatch
return self.handle_exception(e, self.app.debug) File "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py",
line 570, in dispatch
return method(*args, **kwargs) File "/base/data/home/apps/s~myap/a-276.365486148015822746/mapreduce/base_handler.py",
line 68, in post
self.handle() File "/base/data/home/apps/s~myapp/a-276.365486148015822746/mapreduce/handlers.py",
line 437, in handle
spec, state, self.base_path()) File "/base/data/home/apps/s~myapp/a-276.365486148015822746/mapreduce/handlers.py",
line 517, in _finalize_job
mapreduce_spec.mapper.output_writer_class().finalize_job(mapreduce_state)
File
"/base/data/home/apps/s~myapp/a-276.365486148015822746/mapreduce/output_writers.py",
line 454, in finalize_job
files.blobstore.get_blob_key(filename))) File "/base/data/home/apps/s~myapp/a-276.365486148015822746/mapreduce/lib/files/blobstore.py",
line 112, in get_blob_key
_BLOB_FILE_INDEX_KIND, ticket, namespace='')])[0] File "/python27_runtime/python27_lib/versions/1/google/appengine/api/datastore_types.py",
line 504, in from_path
ValidateString(id_or_name, 'name') File "/python27_runtime/python27_lib/versions/1/google/appengine/api/datastore_types.py",
line 176, in ValidateString
raise exception('%s must be under %d bytes.' % (name, max_len)) BadValueError: name must be under 500 bytes.回答 1
Stack Overflow用户
发布于 2013-03-07 20:17:08
mapreduce的不同版本可能会导致此问题。基于Run Map Reduce on non-default versions?，建议使用https://code.google.com/p/appengine-mapreduce/
文档中陈旧的包链接是一个bug。很快就会清理干净的。 我们的几个SDK都有一些MapReduce (出于历史原因)，但是开源版本现在是可行的。
页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接：
https://stackoverflow.com/questions/15221828
复制相关文章
相似问题
腾讯云开发者
