将appengine java上的日志写入stackdriver-logging
将appengine java上的日志写入stackdriver-logging
提问于 2017-03-23 21:30:15
我有一个运行在appengine上的java应用程序。
我将我的日志记录在json结构中，然后我可以在stack driver上看到我的日志(就像在docs中一样)
package com.foo.bar;
public class MyClass {
private static final Logger log = Logger.getLogger(MyClass.class.getName());
public void myFunc() {
log.info("{msg: 'hello', corId: '123'}");
}下面是我在stackdriver- get上得到的消息：
com.foo.bar.MyClass myFunc: {msg: 'hello', corId: '123'}
在log-request对象中：
protoPayload.line[].logMessage = "com.foo.bar.MyClass myFunc: {msg: 'hello', corId: '123'}"
如何使日志消息只是我正在记录的消息-没有类前缀：{msg: 'hello', corId: '123'}
protoPayload.line[].logMessage = "{msg: 'hello', corId: '123'}"
回答 1
Stack Overflow用户
发布于 2018-02-20 18:18:40
我最终通过logstash将日志从stackdriver发送到alasticsearch。
在logstash中，我解析了我的日志，我还分离了我的日志，使每个日志都作为它自己的记录，而不是一个嵌套的数组参见：How to ship logs from pods on Kubernetes running on top of GCP to elasticsearch/logstash?
我在logstash中用于解析日志的配置：
filter {
if [resource][type] == "gae_app" {
# split the protoPayload.line array, so each log message is a separate entry in Elasticsearch
split {
field => "[protoPayload][line]"
target => "line"
remove_field => [ "httpRequest", "operation", "protoPayload"]
}
# extract `line.logMessage` and `line.severity` fields
mutate {
add_field => {"logMessage" => "%{[line][logMessage]}"}
replace => {"severity" => "%{[line][severity]}"}
remove_field => ["line"]
}
# remove the `com.example.MyClass myFunc: ` prefix from log
grok {
match => { "logMessage" => "^%{DATA}: %{GREEDYDATA:parsedMessage}"}
}
# parse the log message into json, json fields will be located in root
json {
source => "parsedMessage"
target => "jsonPayload"
add_field => {"[jsonPayload][level]" => "%{severity}"}
remove_field => ["parsedMessage", "logMessage"]
}
# uniform GAE logs to the structure of GKE logs
grok {
match => { # check..
"[resource][labels][version_id]" =>
"^%{DATA:[resource][labels][container_name]}-%{GREEDYDATA:[resource][labels][namespace_id]}"}
}
}
}页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接：
https://stackoverflow.com/questions/42977512
复制相关文章
相似问题
腾讯云开发者
