• elk实践

    1、背景

    鉴于现在项目中的日志比较乱，所以建议使用现在较为流行的elk收集日志并展示；

    2、下载、配置与启动

    在下载 Elastic 产品 | Elastic 官网下载filebeat、logstash、elasticSearch、kibana 版本要一致 本人测试用的7.14 mac版本 实际生产使用7.14 linux版本

    2.1、Filebeat:

    tar -zxvf filebeat-7.14.0-darwin-x86_64.tar.gz

    Cd filebeat-7.14.0-darwin-x86_64

    配置：filebeat.yml

    - type: log
  enabled: true
  paths:
    - /Users/admin/IdeaProjects/maijia-tebu/log/info/*.log
    - /Users/admin/IdeaProjects/taosj-aliexpress-data/log/*/*.log
  multiline.pattern: '^[0-9][0-9][0-9][0-9]'
  multiline.negate: true
  multiline.match: after
output.logstash:
  hosts: ["localhost:5044”]

    sudo chown root:root /Users/admin/IdeaProjects/maijia-tebu/log/info root：为执行用户

    sudo chown root filebeat.yml

    测试配置 ./filebeat test config -e

    sudo ./filebeat -e

    配置说明：

    Paths：后面可以配置多个目录，配置的目录不会去递归，只会在最后的子目录里面寻找.log的文件；

    multiline：以 '^[0-9][0-9][0-9][0-9]' 格式后面的识别为一行，这样报错等信息就在一行了；

    output.logstash：logstash的地址；

    sudo chown admin:admin /Users/admin/IdeaProjects/maijia-tebu/log/info admin：为执行用户 给log目录设置权限

    sudo chown root filebeat.yml 给配置文件权限

    ./filebeat test config -e 测试配置

    sudo ./filebeat -e 启动

    2.2、Logstash:

    tar -zxvf logstash-7.14.0-darwin-x86_64.tar.gz

    Cd logstash-7.14.0

    配置：

    Vi ./config/logstash-test.conf

    input {
  beats {
    port => 5044  
  }
}
filter{
   dissect {
      mapping => {
        "message" => "%{log_time}|%{ip}|%{serverName}|%{profile}|%{level}|%{logger}|%{thread}|%{traceId}|%{msg}" //与项目中的日志输出格式相对应
     }
   }
   date{
      match => ["log_time", "yyyy-MM-dd HH:mm:ss.SSS"]
      target => "@timestamp"
   }
}
output {
  elasticsearch {
    hosts => ["localhost:9200"]
    index => "logs-%{+YYYY.MM.dd}"  //创建索引的格式
  }
}

    sudo ./bin/logstash -f config/logstash-test.conf

    2.3、elaticSearch:

    tar -zxvf elasticsearch-7.14.0-darwin-x86_64.tar.gz

    Cd elasticsearch-7.14.0

    Sodu ./bin/elasticSearch

    检查服务：curl http://127.0.0.1:9200

    2.4、kibana：

    tar -zxvf kibana-7.14.0-darwin-x86_64.tar.gz

    Cd kibana-7.14.0-darwin-x86_64

    配置：如果es与kibana不在同一台服务器，在config/kibana.yml，添加 elasticsearch.url: "http://ip:port"

    Sudo ./bin/kibana

    检查：浏览器打开http://127.0.0.1:5601

    3、新建jar包

    新建jar包  写一些工具类

    3.1Snowflake

    1. import com.baomidou.mybatisplus.core.toolkit.ArrayUtils;
    2. import com.baomidou.mybatisplus.core.toolkit.SystemClock;
    3.  
    4. import java.io.Serializable;
    5. import java.util.Date;
    6. public class Snowflake implements Serializable {
    7.     private static final long serialVersionUID = 1L;
    8.  
    9.     private final long twepoch;
    10.  
    11.     private final long workerIdBits = 5L;
    12.  
    13.     private final long dataCenterIdBits = 5L;
    14.     // 最大支持数据中心节点数0~31，一共32个
    15.     @SuppressWarnings({"PointlessBitwiseExpression", "FieldCanBeLocal"})
    16.     private final long maxWorkerId = -1L ^ (-1L << workerIdBits);
    17.  
    18.     @SuppressWarnings({"PointlessBitwiseExpression", "FieldCanBeLocal"})
    19.  
    20.     private final long maxDataCenterId = -1L ^ (-1L << dataCenterIdBits);
    21.  
    22.     // 序列号12位
    23.     private final long sequenceBits = 12L;
    24.  
    25.     // 机器节点左移12位
    26.     private final long workerIdShift = sequenceBits;
    27.  
    28.     // 数据中心节点左移17位
    29.     private final long dataCenterIdShift = sequenceBits + workerIdBits;
    30.  
    31.     // 时间毫秒数左移22位
    32.     private final long timestampLeftShift = sequenceBits + workerIdBits + dataCenterIdBits;
    33.  
    34.     @SuppressWarnings({"PointlessBitwiseExpression", "FieldCanBeLocal"})
    35.  
    36.     private final long sequenceMask = -1L ^ (-1L << sequenceBits);// 4095
    37.  
    38.     private final long workerId;
    39.  
    40.     private final long dataCenterId;
    41.  
    42.     private final boolean useSystemClock;
    43.  
    44.     private long sequence = 0L;
    45.  
    46.     private long lastTimestamp = -1L;
    47.  
    48.     /**
    49.      * 构造
    50.      *
    51.      * @param workerId     终端ID
    52.      * @param dataCenterId 数据中心ID
    53.      */
    54.     public Snowflake(long workerId, long dataCenterId) {
    55.         this(workerId, dataCenterId, false);
    56.  
    57.     }
    58.  
    59.     /**
    60.      * 构造
    61.      *
    62.      * @param workerId         终端ID
    63.      * @param dataCenterId     数据中心ID
    64.      * @param isUseSystemClock 是否使用{@link SystemClock} 获取当前时间戳
    65.      */
    66.     public Snowflake(long workerId, long dataCenterId, boolean isUseSystemClock) {
    67.         this(null, workerId, dataCenterId, isUseSystemClock);
    68.  
    69.     }
    70.  
    71.     /**
    72.      * @param epochDate        初始化时间起点(null表示默认起始日期),后期修改会导致id重复,如果要修改连workerId dataCenterId，慎用
    73.      * @param workerId         工作机器节点id
    74.      * @param dataCenterId     数据中心id
    75.      * @param isUseSystemClock 是否使用{@link SystemClock} 获取当前时间戳
    76.      * @since 5.1.3
    77.      */
    78.     public Snowflake(Date epochDate, long workerId, long dataCenterId, boolean isUseSystemClock) {
    79.         if (null != epochDate) {
    80.             this.twepoch = epochDate.getTime();
    81.  
    82.         } else {
    83. // Thu, 04 Nov 2010 01:42:54 GMT
    84.  
    85.             this.twepoch = 1288834974657L;
    86.  
    87.         }
    88.  
    89.         if (workerId > maxWorkerId || workerId < 0) {
    90.             throw new IllegalArgumentException(format("worker Id can't be greater than {} or less than 0", maxWorkerId));
    91.  
    92.         }
    93.  
    94.         if (dataCenterId > maxDataCenterId || dataCenterId < 0) {
    95.             throw new IllegalArgumentException(format("datacenter Id can't be greater than {} or less than 0", maxDataCenterId));
    96.  
    97.         }
    98.  
    99.         this.workerId = workerId;
    100.  
    101.         this.dataCenterId = dataCenterId;
    102.  
    103.         this.useSystemClock = isUseSystemClock;
    104.  
    105.     }
    106.  
    107.     /**
    108.      * 根据Snowflake的ID，获取机器id
    109.      *
    110.      * @param id snowflake算法生成的id
    111.      * @return 所属机器的id
    112.      */
    113.  
    114.     public long getWorkerId(long id) {
    115.         return id >> workerIdShift & ~(-1L << workerIdBits);
    116.  
    117.     }
    118.  
    119.     /**
    120.      * 根据Snowflake的ID，获取数据中心id
    121.      *
    122.      * @param id snowflake算法生成的id
    123.      * @return 所属数据中心
    124.      */
    125.  
    126.     public long getDataCenterId(long id) {
    127.         return id >> dataCenterIdShift & ~(-1L << dataCenterIdBits);
    128.  
    129.     }
    130.  
    131.     /**
    132.      * 根据Snowflake的ID，获取生成时间
    133.      *
    134.      * @param id snowflake算法生成的id
    135.      * @return 生成的时间
    136.      */
    137.  
    138.     public long getGenerateDateTime(long id) {
    139.         return (id >> timestampLeftShift & ~(-1L << 41L)) + twepoch;
    140.  
    141.     }
    142.  
    143.     /**
    144.      * 下一个ID
    145.      *
    146.      * @return ID
    147.      */
    148.  
    149.     public synchronized long nextId() {
    150.         long timestamp = genTime();
    151.  
    152.         if (timestamp < lastTimestamp) {
    153.             if (lastTimestamp - timestamp < 2000) {
    154. // 容忍2秒内的回拨，避免NTP校时造成的异常
    155.  
    156.                 timestamp = lastTimestamp;
    157.  
    158.             } else {
    159. // 如果服务器时间有问题(时钟后退) 报错。
    160.  
    161.                 throw new IllegalStateException(format("Clock moved backwards. Refusing to generate id for {}ms", lastTimestamp - timestamp));
    162.  
    163.             }
    164.  
    165.         }
    166.  
    167.         if (timestamp == lastTimestamp) {
    168.             sequence = (sequence + 1) & sequenceMask;
    169.  
    170.             if (sequence == 0) {
    171.                 timestamp = tilNextMillis(lastTimestamp);
    172.  
    173.             }
    174.  
    175.         } else {
    176.             sequence = 0L;
    177.  
    178.         }
    179.  
    180.         lastTimestamp = timestamp;
    181.  
    182.         return ((timestamp - twepoch) << timestampLeftShift) | (dataCenterId << dataCenterIdShift) | (workerId << workerIdShift) | sequence;
    183.  
    184.     }
    185.  
    186.     /**
    187.      * 下一个ID(字符串形式)
    188.      *
    189.      * @return ID 字符串形式
    190.      */
    191.     public String nextIdStr() {
    192.         return Long.toString(nextId());
    193.  
    194.     }
    195.  
    196. // ------------------------------------------------------------------------------------------------------------------------------------ Private method start
    197.  
    198.     /**
    199.      * 循环等待下一个时间
    200.      *
    201.      * @param lastTimestamp 上次记录的时间
    202.      * @return 下一个时间
    203.      */
    204.  
    205.     private long tilNextMillis(long lastTimestamp) {
    206.         long timestamp = genTime();
    207.  
    208. // 循环直到操作系统时间戳变化
    209.  
    210.         while (timestamp == lastTimestamp) {
    211.             timestamp = genTime();
    212.  
    213.         }
    214.  
    215.         if (timestamp < lastTimestamp) {
    216. // 如果发现新的时间戳比上次记录的时间戳数值小，说明操作系统时间发生了倒退，报错
    217.  
    218.             throw new IllegalStateException(
    219.  
    220.                     format("Clock moved backwards. Refusing to generate id for {}ms", lastTimestamp - timestamp));
    221.  
    222.         }
    223.  
    224.         return timestamp;
    225.  
    226.     }
    227.  
    228.     /**
    229.      * 生成时间戳
    230.      *
    231.      * @return 时间戳
    232.      */
    233.  
    234.     private long genTime() {
    235.         return this.useSystemClock ? SystemClock.now() : System.currentTimeMillis();
    236.  
    237.     }
    238.  
    239.     public  String format(String target, Object... params) {
    240.         return target.contains("%s") && ArrayUtils.isNotEmpty(params) ? String.format(target, params) : target;
    241.     }
    242. }

    3.2 TraceIdAdvice

    1.  
    2. import com.alibaba.dubbo.rpc.RpcContext;
    3. import org.aopalliance.intercept.MethodInterceptor;
    4. import org.aopalliance.intercept.MethodInvocation;
    5. import org.slf4j.MDC;
    6.  
    7. /**  * 类 描 述：traceId切面
    8. */
    9. public class TraceIdAdvice implements MethodInterceptor {
    10.  
    11.     @Override
    12.     public Object invoke(MethodInvocation invocation) throws Throwable {
    13.         String tid = MDC.get("traceId");
    14.         String rpcTid = RpcContext.getContext().getAttachment("traceId");
    15.  
    16.         if (tid != null) {
    17.             RpcContext.getContext().setAttachment("traceId", tid);
    18.         } else {
    19.             if (rpcTid != null) {
    20.                 MDC.put("traceId",rpcTid);
    21.             }
    22.         }
    23.         Object result = invocation.proceed();
    24.         return result;
    25.     }
    26. }

    3.3 TraceIdAdviceConfig

    1.  
    2. import org.springframework.aop.aspectj.AspectJExpressionPointcutAdvisor;
    3. import org.springframework.beans.factory.annotation.Value;
    4. import org.springframework.context.annotation.Bean;
    5. import org.springframework.context.annotation.Configuration;
    6.  
    7. /** 
    8.  * 类 描 述：traceId切面动态配置
    9. */
    10. @Configuration
    11. public class TraceIdAdviceConfig {
    12.  
    13.     @Value("${traceId.pointcut.property}")
    14.     private String pointcut;
    15.  
    16.     @Bean
    17.     public AspectJExpressionPointcutAdvisor configurabledvisor() {
    18.         AspectJExpressionPointcutAdvisor advisor = new AspectJExpressionPointcutAdvisor();
    19.         advisor.setExpression(pointcut);
    20.         advisor.setAdvice(new TraceIdAdvice());
    21.         return advisor;
    22.     }
    23. }

    3.4 IPConverterConfig

    1. import ch.qos.logback.classic.pattern.ClassicConverter;
    2. import ch.qos.logback.classic.spi.ILoggingEvent;
    3.  
    4. import java.net.InetAddress;
    5. import java.net.NetworkInterface;
    6. import java.net.UnknownHostException;
    7. import java.util.Enumeration;
    8.  
    9. /**
    10.  * 类 描 述：log打出ip
    11.  
    12.  */
    13. public class IPConverterConfig extends ClassicConverter {
    14.  
    15.     private String url;
    16.  
    17.     @Override
    18.     public String convert(ILoggingEvent iLoggingEvent) {
    19.         try {
    20.             if (url == null){
    21.                 String hostAddress = getLocalHostLANAddress().getHostAddress();
    22.                 url = hostAddress;
    23.             }
    24.             return url;
    25.         } catch (UnknownHostException e) {
    26.             e.printStackTrace();
    27.         }
    28.         return null;
    29.     }
    30.  
    31.     // 正确的IP拿法，即优先拿site-local地址
    32.     private static InetAddress getLocalHostLANAddress() throws UnknownHostException{
    33.         try {
    34.             InetAddress candidateAddress = null;
    35.             // 遍历所有的网络接口
    36.             for (Enumeration ifaces = NetworkInterface.getNetworkInterfaces(); ifaces.hasMoreElements();) {
    37.                 NetworkInterface iface = (NetworkInterface) ifaces.nextElement();
    38.                 //服务器上eth0才是正确的ip
    39.                 if (!"eth0".equals(iface.getName())){
    40.                     continue;
    41.                 }
    42.                 // 在所有的接口下再遍历IP
    43.                 for (Enumeration inetAddrs = iface.getInetAddresses(); inetAddrs.hasMoreElements();) {
    44.                     InetAddress inetAddr = (InetAddress) inetAddrs.nextElement();
    45.                     if (!inetAddr.isLoopbackAddress()) {// 排除loopback类型地址
    46.                         if (inetAddr.isSiteLocalAddress()) {
    47.                             // 如果是site-local地址，就是它了
    48.                             return inetAddr;
    49.                         } else if (candidateAddress == null) {
    50.                             // site-local类型的地址未被发现，先记录候选地址
    51.                             candidateAddress = inetAddr;
    52.                         }
    53.                     }
    54.                 }
    55.             }
    56.             if (candidateAddress != null) {
    57.                 return candidateAddress;
    58.             }
    59.             // 如果没有发现 non-loopback地址.只能用最次选的方案
    60.             InetAddress jdkSuppliedAddress = InetAddress.getLocalHost();
    61.             if (jdkSuppliedAddress == null) {
    62.                 throw new UnknownHostException("The JDK InetAddress.getLocalHost() method unexpectedly returned null.");
    63.             }
    64.             return jdkSuppliedAddress;
    65.         } catch (Exception e) {
    66.             e.printStackTrace();
    67.         }
    68.         return null;
    69.     }
    70.  
    71. }

    3.5 TraceIdInterceptor

    1. /**
    2.  * 类 描 述：traceId 用于追踪链路
    3.  
    4.  */
    5. @Slf4j
    6. @Component
    7. public class TraceIdInterceptor implements HandlerInterceptor {
    8.  
    9.     /*@Autowired
    10.     RedisHelper redisHelper;*/
    11.  
    12.     Snowflake snowflake = new Snowflake(1,0);
    13.  
    14.     @Override
    15.     public boolean preHandle(HttpServletRequest request, HttpServletResponse response, Object handler){
    16.         String tid = snowflake.nextIdStr();
    17.         MDC.put("traceId",tid);
    18.         RpcContext.getContext().setAttachment("traceId", tid);
    19.         return true;
    20.     }
    21.  
    22.     @Override
    23.     public void postHandle(HttpServletRequest request, HttpServletResponse response, Object handler, ModelAndView modelAndView){
    24.         MDC.remove("traceId");
    25.     }
    26.  
    27.     @Override
    28.     public void afterCompletion(HttpServletRequest request, HttpServletResponse response, Object handler, Exception ex){}
    29.  
    30.     //生成导入批次号
    31.     /*public  String getTraceId() {
    32.         String dateString = DateUtils.formatYYYYMMDD(new Date());
    33.         Long incr = redisHelper.incr("taosj-common-traceId" + dateString, 24);
    34.         if (incr == 0) {
    35.             incr = redisHelper.incr("taosj-common-traceId" + dateString, 24);
    36.         }
    37.         DecimalFormat df = new DecimalFormat("000000");
    38.         return dateString + df.format(incr);
    39.     }*/
    40. }

    3.6 WebAppConfigurer

    1. import org.springframework.beans.factory.annotation.Autowired;
    2. import org.springframework.context.annotation.Configuration;
    3. import org.springframework.web.servlet.config.annotation.InterceptorRegistry;
    4. import org.springframework.web.servlet.config.annotation.WebMvcConfigurer;
    5.  
    6. /**
    7.  * 类 描 述：TODO
    8.  
    9.  */
    10. @Configuration
    11. public class WebAppConfigurer implements WebMvcConfigurer {
    12.     @Autowired
    13.     private TraceIdInterceptor traceIdInterceptor;
    14.  
    15.     /**
    16.      * 注册拦截器
    17.      */
    18.     @Override
    19.     public void addInterceptors(InterceptorRegistry registry) {
    20.  
    21.         registry.addInterceptor(traceIdInterceptor).addPathPatterns("/**");
    22.                 //.excludePathPatterns("/admin/login")
    23.                 //.excludePathPatterns("/admin/getLogin");
    24.         //  - /**： 匹配所有路径
    25.         //  - /admin/**：匹配 /admin/ 下的所有路径
    26.         //  - /admin/*：只匹配 /admin/login，不匹配 /secure/login/tologin ("/*"只匹配一级子目录，"/**"匹配所有子目录)
    27.     }
    28.  
    29. }

    3.7 jar pom

    1. <dependencies>
    2.         <dependency>
    3.             <groupId>org.springframeworkgroupId>
    4.             <artifactId>spring-contextartifactId>
    5.         dependency>
    6.         <dependency>
    7.             <groupId>org.springframeworkgroupId>
    8.             <artifactId>spring-webmvcartifactId>
    9.         dependency>
    10.         <dependency>
    11.             <groupId>com.alibabagroupId>
    12.             <artifactId>dubboartifactId>
    13.         dependency>
    14.         <dependency>
    15.             <groupId>org.slf4jgroupId>
    16.             <artifactId>slf4j-apiartifactId>
    17.         dependency>
    18.         <dependency>
    19.             <groupId>com.baomidougroupId>
    20.             <artifactId>mybatis-plus-coreartifactId>
    21.         dependency>
    22.         <dependency>
    23.             <groupId>ch.qos.logbackgroupId>
    24.             <artifactId>logback-classicartifactId>
    25.         dependency>
    26.         <dependency>
    27.             <groupId>org.apache.tomcat.embedgroupId>
    28.             <artifactId>tomcat-embed-coreartifactId>
    29.         dependency>
    30.     dependencies>

     4、jar包的使用

    1、pom文件：

    添加自己的jar包

    2、启动类增加类扫描：步骤3的包名 

    3、配置文件增加切面pointcut配置：例如：traceId.pointcut.property=execution(public * com.taosj.tebu.service..*.*(..)) 自己项目的包名

    4、logback-spring文件修改：ip 日志输出格式

    spring.application.name"/>



    应该是把现在正在运行的日志拿过来，所以要把之前的日志删除掉，以及把形成的日志名改掉：

    比如${dir}/info/info.%d{yyyy-MM-dd}.%i.log 改成

    ${dir}/info/info.log.%d{yyyy-MM-dd}.%i

    5、springboot项目logback-spring.xml例子

    1. ​
    2. "1.0" encoding="UTF-8"?>
    3.  
    4. <configuration>
    5.  
    6. <springProfile name="dev">
    7.  
    8. <property name="dir" value="log"/>
    9.  
    10. springProfile>
    11.  
    12. <springProfile name="test">
    13.  
    14. <property name="dir" value="/data/project/taosj-tebu-web/code/logs"/>
    15.  
    16. springProfile>
    17.  
    18. <springProfile name="pre">
    19.  
    20. <property name="dir" value="/data/project/taosj-tebu-web/code/logs"/>
    21.  
    22. springProfile>
    23.  
    24. <springProfile name="prod">
    25.  
    26. <property name="dir" value="/data/project/taosj-tebu-web/code/logs"/>
    27.  
    28. springProfile>
    29.  
    30. <property resource="application.properties"/>
    31.  
    32. <springProperty scope="context" name="serverName" source="spring.application.name"/>
    33.  
    34. <conversionRule conversionWord="ip" converterClass="com.taosj.elk.config.IPConverterConfig"/>
    35.  
    36. <property name="pattern" value="%date{yyyy-MM-dd HH:mm:ss} | %ip | ${serverName} | ${profile} | %highlight(%-5level) | %boldYellow(%thread) | %boldGreen(%logger) | %X{traceId} | %msg%n"/>
    37.  
    38. <property name="pattern_log" value="%d{yyyy-MM-dd HH:mm:ss.SSS}|%ip|${serverName}|${profile}|%level|%logger|%thread|%X{traceId}|%m%n"/>
    39.  
    40. <appender name="INFO_LOG" class="ch.qos.logback.core.rolling.RollingFileAppender">
    41.  
    42. <file>${dir}/info/info.logfile>
    43.  
    44. <rollingPolicy class="ch.qos.logback.core.rolling.SizeAndTimeBasedRollingPolicy">
    45.  
    46. <fileNamePattern>${dir}/info/info.log.%d{yyyy-MM-dd}.%ifileNamePattern>
    47.  
    48. <maxFileSize>100MBmaxFileSize>
    49.  
    50. <maxHistory>10maxHistory>
    51.  
    52. <totalSizeCap>5GBtotalSizeCap>
    53.  
    54. rollingPolicy>
    55.  
    56. <filter class="com.taosj.bizlogback.LoggerFilter">
    57.  
    58. <param name="levelMin" value="20000"/>
    59.  
    60. <param name="levelMax" value="20000"/>
    61.  
    62. filter>
    63.  
    64. <encoder>
    65.  
    66. <pattern>${pattern_log}pattern>
    67.  
    68. <charset>UTF-8charset>
    69.  
    70. encoder>
    71.  
    72. appender>
    73.  
    74. <appender name="DEBUG_LOG" class="ch.qos.logback.core.rolling.RollingFileAppender">
    75.  
    76. <file>${dir}/debug/debug.logfile>
    77.  
    78. <rollingPolicy class="ch.qos.logback.core.rolling.SizeAndTimeBasedRollingPolicy">
    79.  
    80. <fileNamePattern>${dir}/debug/debug.%i.log.%d{yyyy-MM-dd}.%ifileNamePattern>
    81.  
    82. <maxFileSize>100MBmaxFileSize>
    83.  
    84. <maxHistory>10maxHistory>
    85.  
    86. <totalSizeCap>5GBtotalSizeCap>
    87.  
    88. rollingPolicy>
    89.  
    90. <filter class="com.taosj.bizlogback.LoggerFilter">
    91.  
    92. <param name="levelMin" value="10000"/>
    93.  
    94. <param name="levelMax" value="10000"/>
    95.  
    96. filter>
    97.  
    98. <encoder>
    99.  
    100. <pattern>${pattern_log}pattern>
    101.  
    102. <charset>UTF-8charset>
    103.  
    104. encoder>
    105.  
    106. appender>
    107.  
    108. <appender name="ERROR_LOG" class="ch.qos.logback.core.rolling.RollingFileAppender">
    109.  
    110. <file>${dir}/error/error.logfile>
    111.  
    112. <rollingPolicy class="ch.qos.logback.core.rolling.SizeAndTimeBasedRollingPolicy">
    113.  
    114. <fileNamePattern>${dir}/error/error.log.%d{yyyy-MM-dd}.%ifileNamePattern>
    115.  
    116. <maxFileSize>100MBmaxFileSize>
    117.  
    118. <maxHistory>10maxHistory>
    119.  
    120. <totalSizeCap>5GBtotalSizeCap>
    121.  
    122. rollingPolicy>
    123.  
    124. <filter class="com.taosj.bizlogback.LoggerFilter">
    125.  
    126. <param name="levelMin" value="40000"/>
    127.  
    128. <param name="levelMax" value="40000"/>
    129.  
    130. filter>
    131.  
    132. <encoder>
    133.  
    134. <pattern>${pattern_log}pattern>
    135.  
    136. <charset>UTF-8charset>
    137.  
    138. encoder>
    139.  
    140. appender>
    141.  
    142. <appender name="BIZ_LOG" class="ch.qos.logback.core.rolling.RollingFileAppender">
    143.  
    144. <file>${dir}/biz/biz.logfile>
    145.  
    146. <rollingPolicy class="ch.qos.logback.core.rolling.SizeAndTimeBasedRollingPolicy">
    147.  
    148. <fileNamePattern>${dir}/biz/biz.log.%d{yyyy-MM-dd}.%ifileNamePattern>
    149.  
    150. <maxFileSize>100MBmaxFileSize>
    151.  
    152. <maxHistory>10maxHistory>
    153.  
    154. <totalSizeCap>5GBtotalSizeCap>
    155.  
    156. rollingPolicy>
    157.  
    158. <filter class="com.taosj.bizlogback.LoggerFilter">
    159.  
    160. <param name="levelMin" value="50000"/>
    161.  
    162. <param name="levelMax" value="50000"/>
    163.  
    164. filter>
    165.  
    166. <encoder>
    167.  
    168. <pattern>${pattern_log}pattern>
    169.  
    170. <charset>UTF-8charset>
    171.  
    172. encoder>
    173.  
    174. appender>
    175.  
    176. <appender name="console" class="ch.qos.logback.core.ConsoleAppender">
    177.  
    178. <encoder>
    179.  
    180. <pattern>${pattern}pattern>
    181.  
    182. encoder>
    183.  
    184. appender>
    185.  
    186. <springProfile name="dev">
    187.  
    188. <root level="info">
    189.  
    190. <appender-ref ref="INFO_LOG"/>
    191.  
    192. <appender-ref ref="ERROR_LOG"/>
    193.  
    194. <appender-ref ref="DEBUG_LOG"/>
    195.  
    196. <appender-ref ref="BIZ_LOG"/>
    197.  
    198. <appender-ref ref="console"/>
    199.  
    200. root>
    201.  
    202. springProfile>
    203.  
    204. <springProfile name="prod">
    205.  
    206. <root level="info">
    207.  
    208. <appender-ref ref="INFO_LOG"/>
    209.  
    210. <appender-ref ref="ERROR_LOG"/>
    211.  
    212. <appender-ref ref="DEBUG_LOG"/>
    213.  
    214. <appender-ref ref="BIZ_LOG"/>
    215.  
    216. <appender-ref ref="console"/>
    217.  
    218. root>
    219.  
    220. springProfile>
    221.  
    222. <springProfile name="test">
    223.  
    224. <root level="info">
    225.  
    226. <appender-ref ref="INFO_LOG"/>
    227.  
    228. <appender-ref ref="ERROR_LOG"/>
    229.  
    230. <appender-ref ref="DEBUG_LOG"/>
    231.  
    232. <appender-ref ref="BIZ_LOG"/>
    233.  
    234. <appender-ref ref="console"/>
    235.  
    236. root>
    237.  
    238. springProfile>
    239.  
    240. <springProfile name="pre">
    241.  
    242. <root level="info">
    243.  
    244. <appender-ref ref="INFO_LOG"/>
    245.  
    246. <appender-ref ref="ERROR_LOG"/>
    247.  
    248. <appender-ref ref="DEBUG_LOG"/>
    249.  
    250. <appender-ref ref="BIZ_LOG"/>
    251.  
    252. <appender-ref ref="console"/>
    253.  
    254. root>
    255.  
    256. springProfile>
    257.  
    258. configuration>
    259.  
    260. ​

    7、部署时候的小tip：

    7.1：filebeat启动时

    nohup ./filebeat & 这样shell关闭了还是会停

    nohup ./filebeat & disown 要这样启动

    7.2: filebeat推送logstash的地址：

    116.62.126.104 35044 可以查看filebeat.yml配置文件

    7.4:ip

    ip获取的是eth0网卡的ip

    7.4:小问题

    springmvc项目使用log4j不能一开始就注入servername、ip、profile等信息 所以启动等信息没有这些字段，调用接口等是有这些信息的；springboot项目使用logback没有这个问题

     

  • 相关阅读:
    UML是什么？UML概念模型？用例图，类图，活动图，状态图
    模糊控制器实现对某个对象追踪输入
    23_ue4进阶末日生存游戏开发[随机巡逻]
    读后感读后感读后感
    【web-避开客户端控件】（2.3.5）收集使用数据：反编译浏览器扩展
    理论辐照度计算
    Oracle 定时任务job实际应用
    面试、工作中常用sql大全(建议收藏备用)
    集合的增删改查？--Python
    Python大作业——爬虫+可视化+数据分析+数据库（可视化篇）
  • 原文地址：https://blog.csdn.net/gzc_870301/article/details/128012859