根据其ID将嵌套的JSON文件拆分为两个JSON？
根据其ID将嵌套的JSON文件拆分为两个JSON？
提问于 2021-01-27 23:17:34
我有嵌套的JSON，它作为称为movies_data的python字典加载，如下所示：
with open('project_folder/data_movie_absa.json') as infile:
movies_data = json.load(infile)它的结构如下：
{ "review_1": {"tokens": ["Best", "show", "ever", "!"],
"movie_user_4": {"aspects": ["O", "B_A", "O", "O"], "sentiments": ["B_S", "O", "O", "O"]},
"movie_user_6": {"aspects": ["O", "B_A", "O", "O"], "sentiments": ["B_S", "O", "O", "O"]}},
"review_2": {"tokens": ["Its", "a", "great", "show"],
"movie_user_1": {"aspects": ["O", "O", "O", "B_A"], "sentiments": ["O", "O", "B_S", "O"]},
"movie_user_6": {"aspects": ["O", "O", "O", "B_A"], "sentiments": ["O", "O", "B_S", "O"]}},
"review_3": {"tokens": ["I", "love", "this", "actor", "!"],
"movie_user_17": {"aspects": ["O", "O", "O", "B_A", "O"], "sentiments": ["O", "B_S", "O", "O", "O"]},
"movie_user_23": {"aspects": ["O", "O", "O", "B_A", "O"], "sentiments": ["O", "B_S", "O", "O", "O"]}},
"review_4": {"tokens": ["Bad", "movie"],
"movie_user_1": {"aspects": ["O", "B_A"], "sentiments": ["B_S", "O"]},
"movie_user_6": {"aspects": ["O", "B_A"], "sentiments": ["B_S", "O"]}}
...
}它有3324个键值对(即，直到键review_3224)。我想根据特定的键列表将这个文件分成两个json文件(train_movies.json，test_movies.json)：
test_IDS = ['review_2', 'review_4']
with open("train_movies.json", "w", encoding="utf-8-sig") as outfile_train, open("test_movies.json", "w", encoding="utf-8-sig") as outfile_test:
for review_id, review in movies_data.items():
if review_id in test_IDS:
outfile = outfile_test
outfile.write('{"%s": "%s"}' % (review_id, movies_data[review_id]))
else:
outfile = outfile_train
outfile.write('{"%s": "%s"}' % (review_id, movies_data[review_id]))
outfile.close()对于test_movies.json，我有以下结构：
{"review_2": "{'tokens': ['Its', 'a', 'great', 'show'],
'movie_user_4': {'aspects': ['O', 'O', 'O', 'B_A'], 'sentiments': ['O', 'O', 'B_S', 'O']},
'movie_user_6': {'aspects': ['O', 'O', 'O', 'B_A'], 'sentiments': ['O', 'O', 'B_S', 'O']}}"}
{"review_4": "{'tokens': ['Bad', 'movie'],
'movie_user_1': {'aspects': ['O', 'B_A'], 'sentiments': ['B_S', 'O']},
'movie_user_6': {'aspects': ['O', 'B_A'], 'sentiments': ['B_S', 'O']}}"}不幸的是，这种结构存在一些问题，比如不一致的双引号()，不一致的双引号(，" vs. ')，在评论之间没有逗号，等等。因此，通过将test_movies.json作为json文件读取，我有以下问题：
with open('project_folder/test_movies.json') as infile:
testing_data = json.load(infile)错误信息：
JSONDecodeError Traceback (most recent call last)
<ipython-input-10-3548a718f421> in <module>()
1 with open('/content/gdrive/My Drive/project_folder/test_movies.json') as infile:
----> 2 testing_data = json.load(infile)
1 frames
/usr/lib/python3.6/json/__init__.py in loads(s, encoding, cls, object_hook, parse_float, parse_int, parse_constant, object_pairs_hook, **kw)
342 if s.startswith('\ufeff'):
343 raise JSONDecodeError("Unexpected UTF-8 BOM (decode using utf-8-sig)",
--> 344 s, 0)
345 else:
346 if not isinstance(s, (bytes, bytearray)):
JSONDecodeError: Unexpected UTF-8 BOM (decode using utf-8-sig): line 1 column 1 (char 0)想要的输出应该有一个正确的json结构，就像原始的movies_data，这样python就可以将它正确地读取为dict。
你能帮我更正一下我的python代码吗？
提前谢谢你！
回答 1
Stack Overflow用户
回答已采纳
发布于 2021-01-28 00:36:57
问题
- 需要使用json.dumps来创建要写入文件的outut字符串，使用json.dumps字符串格式的
- 即‘{“%s：”%s“}% (review_id，movies_datareview_id)会造成问题。
码
train, test = {}, {} # Dicionaries for storing training and test data
for review_id, review in movies_data.items():
if review_id in test_IDS:
test[review_id] = review
else:
train[review_id] = review
# Output Test
with open("test_movies.json", "w") as outfile_test:
json.dump(test, outfile_test)
# Output training
with open("train_movies.json", "w") as outfile_train:
json.dump(train, outfile_train)结果
输入: test.json的文件内容
{ "review_1": {"tokens": ["Best", "show", "ever", "!"],
"movie_user_4": {"aspects": ["O", "B_A", "O", "O"], "sentiments": ["B_S", "O", "O", "O"]},
"movie_user_6": {"aspects": ["O", "B_A", "O", "O"], "sentiments": ["B_S", "O", "O", "O"]}},
"review_2": {"tokens": ["Its", "a", "great", "show"],
"movie_user_1": {"aspects": ["O", "O", "O", "B_A"], "sentiments": ["O", "O", "B_S", "O"]},
"movie_user_6": {"aspects": ["O", "O", "O", "B_A"], "sentiments": ["O", "O", "B_S", "O"]}},
"review_3": {"tokens": ["I", "love", "this", "actor", "!"],
"movie_user_17": {"aspects": ["O", "O", "O", "B_A", "O"], "sentiments": ["O", "B_S", "O", "O", "O"]},
"movie_user_23": {"aspects": ["O", "O", "O", "B_A", "O"], "sentiments": ["O", "B_S", "O", "O", "O"]}},
"review_4": {"tokens": ["Bad", "movie"],
"movie_user_1": {"aspects": ["O", "B_A"], "sentiments": ["B_S", "O"]},
"movie_user_6": {"aspects": ["O", "B_A"], "sentiments": ["B_S", "O"]}}
}输出: test_movies.json的文件内容
{"review_2": {"tokens": ["Its", "a", "great", "show"], "movie_user_1": {"aspects": ["O", "O", "O", "B_A"], "sentiments": ["O", "O", "B_S", "O"]}, "movie_user_6": {"aspects": ["O", "O", "O", "B_A"], "sentiments": ["O", "O", "B_S", "O"]}}, "review_4": {"tokens": ["Bad", "movie"], "movie_user_1": {"aspects": ["O", "B_A"], "sentiments": ["B_S", "O"]}, "movie_user_6": {"aspects": ["O", "B_A"], "sentiments": ["B_S", "O"]}}}输出: train_movies.json的文件内容
{"review_1": {"tokens": ["Best", "show", "ever", "!"], "movie_user_4": {"aspects": ["O", "B_A", "O", "O"], "sentiments": ["B_S", "O", "O", "O"]}, "movie_user_6": {"aspects": ["O", "B_A", "O", "O"], "sentiments": ["B_S", "O", "O", "O"]}}, "review_3": {"tokens": ["I", "love", "this", "actor", "!"], "movie_user_17": {"aspects": ["O", "O", "O", "B_A", "O"], "sentiments": ["O", "B_S", "O", "O", "O"]}, "movie_user_23": {"aspects": ["O", "O", "O", "B_A", "O"], "sentiments": ["O", "B_S", "O", "O", "O"]}}}页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接：
https://stackoverflow.com/questions/65928838
复制相关文章
相似问题
腾讯云开发者
