我们使用ElasticSearch.NET / NEST来查询ElasticSearch配置。计划是分批获取1000个文档,并在获取下1000个文档之前对其进行处理
但是,每次处理10批后都会失败
ELK Search failed Invalid NEST response built from a unsuccessful (500)如果我们将批处理大小更改为10,000,则批处理大小为100的批处理1次后将失败,批处理大小为100的批处理后将失败,失败始终在10.000个文档之后
代码如下所示
private void ProcessRequest(SearchRequest request)
{
request.Size = 1000;
for (request.From = 0; request.From < 1_000_000; request.From += request.Size)
{
Console.WriteLine(request.From);
var responses = _client.Search<GroupStaticElkDocument>(request);
foreach (var response in responses)
_requestCounter.Add(response.ToRequest());
}
}发布于 2021-04-02 17:00:28
也许你应该试着翻页/滚动
https://stackoverflow.com/questions/66916513
复制相似问题