pkgsrc/sysutils/beats/Makefile

83 lines
2 KiB
Makefile
Raw Normal View History

# $NetBSD: Makefile,v 1.64 2021/05/08 15:02:35 bsiegert Exp $
DISTNAME= beats-6.8.13
PKGREVISION= 3
CATEGORIES= sysutils
MASTER_SITES= ${MASTER_SITE_GITHUB:=elastic/}
GITHUB_PROJECT= beats
GITHUB_TAG= v${PKGVERSION_NOREV}
beats: Update to 6.8.8. Changes since 6.6.2: Beats version 6.8.8 Add support for Cisco syslog format used by their switch. 10760 Beats version 6.8.7 Fixed bug with elasticsearch/cluster_stats metricset not recording license expiration date correctly. 14541 14591 Make kibana module more resilient to Kibana unavailability. 15258 15270 Beats version 6.8.6 Fix recording of SSL cert metadata for Expired/Unvalidated x509 certs. 13687 Fix marshaling of ms-since-epoch values in elasticsearch/cluster_stats metricset. 14378 Fixed bug with elasticsearch/cluster_stats metricset not recording license ID in the correct field. 14592 Beats version 6.8.5 Convert indexed ms-since-epoch timestamp fields in elasticsearch/ml_job metricset to ints from float64s. 14220 14222 Beats version 6.8.4 Fix delay in enforcing close_renamed and close_removed options. 13488 13907 Fix merging of fields specified in global scope with fields specified under an input’s scope. 3628 13909 Fixed early expiration of templates (Netflow v9 and IPFIX). 13821 Fixed bad handling of sequence numbers when multiple observation domains were exported by a single device (Netflow V9 and IPFIX). 13821 Fixed increased memory usage with large files when multiline pattern does not match. 14068 Mark Kibana usage stats as collected only if API call succeeds. 13881 Beats version 6.8.3 Iterate over journal correctly, so no duplicate entries are sent. 12716 Fix panic in Redis Key metricset when collecting information from a removed key. 13426 Remove _nodes field from under cluster_stats as it’s not being used. 13010 Collect license expiry date fields as well. 11652 Beats version 6.8.2 Process dataset: Do not show non-root warning on Windows. 12740 Host dataset: Export Host fields to gob encoder. 12940 Skipping unparsable log entries from docker json reader 12268 Limit memory usage of Redis replication sessions. https://github.com/elastic/beats/issues/12657[12657 Beats version 6.8.1 Fixed a memory leak when using the add_process_metadata processor under Windows. 12100 Package dataset: Log error when Homebrew is not installed. 11667 Process dataset: Fixed a memory leak under Windows. 12100 Login dataset: Fix re-read of utmp files. 12028 Package dataset: Fixed a crash inside librpm after Auditbeat has been running for a while. 12147 12168 Fix direction of incoming IPv6 sockets. 12248 Package dataset: Auto-detect package directories. 12289 System module: Start system module without host ID. 12373 Host dataset: Fix reboot detection logic. 12591 Fix goroutine leak happening when harvesters are dynamically stopped. 11263 Fix initialization of the TCP input logger. 11605 Fix goroutine leak caused on initialization failures of log input. 12125 Fix memory leak in Filebeat pipeline acker. 12063 Fix goroutine leak on non-explicit finalization of log input. 12164 When TLS is configured for the TCP input and a certificate_authorities is configured we now default to required for the client_authentication. 12584 Avoid generating hints-based configuration with empty hosts when no exposed port is suitable for the hosts hint. 8264 12086 Fix direction of incoming IPv6 sockets. 12248 Validate that kibana/status metricset cannot be used when xpack is enabled. 12264 In the kibana/stats metricset, only log error (don’t also index it) if xpack is enabled. 12353 The elasticsearch/index_summary metricset gracefully handles an empty Elasticsearch cluster when xpack.enabled: true is set. 12489 12487 When TLS is configured for the http metricset and a certificate_authorities is configured we now default to required for the client_authentication. 12584 Fixed a memory leak when using process monitoring under Windows. 12100 Improved debug logging efficiency in PGQSL module. 12150 Add support to the system package dataset for the SUSE OS family. 11634 Add validation for elasticsearch and kibana modules' metricsets when xpack.enabled is set to true. 12386 Beats version 6.8.0 Updates to support changes to licensing of security features. Some Elastic Stack security features, such as encrypted communications, file and native authentication, and role-based access control, are now available in more subscription levels. For details, see https://www.elastic.co/subscriptions. Beats version 6.7.2 Relax validation of the X-Pack license UID value. 11640 Fix a parsing error with the X-Pack license check on 32-bit system. 11650 Fix OS family classification in add_host_metadata for Amazon Linux, Raspbian, and RedHat Linux. 9134 11494 Fix false positives reported in the host.containerized field added by add_host_metadata. 11494 Fix the add_host_metadata’s host.id field on older Linux versions. 11494 Package dataset: dlopen versioned librpm shared objects. 11565 Package dataset: Nullify Librpm’s rpmsqEnable. 11628 Don’t apply multiline rules in Logstash json logs. 11346 Prevent the docker/memory metricset from processing invalid events before container start 11676 Add support to the system package dataset for the SUSE OS family. 11634 Beats version 6.7.1 Initialize the Paths before the keystore and save the keystore into data/{beatname}.keystore. 10706 Remove IP fields from default_field in Elasticsearch template. 11399 Beats version 6.7.0 Port settings have been deprecated in redis/logstash output and will be removed in 7.0. 9915 Update the code of Central Management to align with the new returned format. 10019 Allow Central Management to send events back to kibana. 9382 Fix panic if fields settting is used to configure hosts.x fields. 10824 10935 Introduce query.default_field as part of the template. 11205 Beats Xpack now checks for Basic license on connect. 11296 Filesets with multiple ingest pipelines added in 8914 only work with Elasticsearch >= 6.5.0 10001 Add grok pattern to support redis 5.0.3 log timestamp. 9819 10033 Ingesting Elasticsearch audit logs is only supported with Elasticsearch 6.5.0 and above 8852 Remove ecs option from user_agent processors when loading pipelines with Filebeat 6.7.x into Elasticsearch < 6.7.0. 10655 11362 Remove monitor generator script that was rarely used. 9648 Fix TLS certificate DoS vulnerability. 10303 Fix panic and file unlock in spool on atomic operation (arm, x86-32). File lock was not released when panic occurs, leading to the beat deadlocking on startup. 10289 Adding logging traces at debug level when the pipeline client receives the following events: onFilteredOut, onDroppedOnPublish. 9016 Do not panic when no tokenizer string is configured for a dissect processor. 8895 Fix a issue when remote and local configuration didn’t match when fetching configuration from Central Management. 10587 Add ECS-like selectors and dedotting to docker autodiscover. 10757 10862 Fix encoding of timestamps when using disk spool. 10099 Include ip and boolean type when generating index pattern. 10995 Using an environment variable for the password when enrolling a beat will now raise an error if the variable doesn’t exist. 10936 Cancelling enrollment of a beat will not enroll the beat. 10150 Remove IP fields from default_field in Elasticsearch template. 11399 Package: Disable librpm signal handlers. 10694 Login: Handle different bad login UTMP types. 10865 Fix hostname references in System module dashbords. 11064 User dataset: Numerous fixes to error handling. 10942 Support IPv6 addresses with zone id in IIS ingest pipeline. 9836 error log: 9869 access log: 10029 Fix bad bytes count in docker input when filtering by stream. 10211 Fixed data types for roles and indices fields in elasticsearch/audit fileset 10307 Cover empty request data, url and version in Apache2 modulehttps://github.com/elastic/beats/pull/10846[10846] Fix a bug with the convert_timezone option using the incorrect timezone field. 11055 11164 Change URLPATH grok pattern to support brackets. 11135 11252 Add support for iis log with different address format. 11255 11256 Add fix to parse syslog message with priority value 0. 11010 Host header can now be overridden for HTTP requests sent by Heartbeat monitors. 9516 Fix checks for TCP send/receive data 10777 Do not stop collecting events when journal entries change. 9994 Fix MongoDB dashboard that had some incorrect field names from status Metricset 9795 9715 Fix issue that would prevent collection of processes without command line on Windows. 10196 Fixed data type for tags field in docker/container metricset 10307 Fixed data type for tags field in docker/image metricset 10307 Fixed data type for isr field in kafka/partition metricset 10307 Fixed data types for various hosts fields in mongodb/replstatus metricset 10307 Added function to close sql database connection. 10355 Fix parsing error using GET in Jolokia module. 11075 11071 Fix Winlogbeat escaping CR, LF and TAB characters. 11328 11357 Correctly extract Kinesis Data field from the Kinesis Record. 11141 Add the required permissions to the role when deployment SQS functions. 9152 Affecting all Beats Add ip fields to default_field in Elasticsearch template. 11035 Add cleanup_timeout option to docker autodiscover, to wait some time before removing configurations after a container is stopped. 10374 10905 System module process dataset: Add user information to processes. 9963 Add system package dataset. 10225 Add system module login dataset. 9327 Add entity_id fields. 10500 Add seven dashboards for the system module. 10511 Add field log.source.address and log.file.path to replace source. 9435 Support mysql 5.7.22 slowlog starting with time information. 7892 9647 Add support for ssl_request_log in apache2 module. 8088 9833 Add support for iis 7.5 log format. 9753 9967 Add support for MariaDB in the slowlog fileset of mysql module. 9731 Add convert_timezone to nginx module. 9839 10148 Add support for Percona in the slowlog fileset of mysql module. 6665 10227 Added support for ingesting structured Elasticsearch audit logs 8852 New iptables module that receives iptables/ip6tables logs over syslog or file. Supports Ubiquiti Firewall extensions. 8781 10176 Populate more ECS fields in the Suricata module. 10006 Made monitors.d configuration part of the default config. 9004 Autodiscover metadata is now included in events by default. So, if you are using the docker provider for instance, you’ll see the correct fields under the docker key. 10258 Add field event.dataset which is {module}.{metricset}. Add more TCP statuses to socket_summary metricset. 9430 Remove experimental tag from ceph metricsets. 9708 Add key metricset to the Redis module. 9582 9657 Add DeDot for kubernetes labels and annotations. 9860 9939 Add docker event metricset. 9856 Release Ceph module as GA. 10202 Release windows Metricbeat module as GA. 10163 Release traefik Metricbeat module as GA. 10166 List filesystems on Windows that have an access path but not an assigned letter 8916 10196 Release uswgi Metricbeat module GA. 10164 Release php_fpm module as GA. 10198 Release Memcached module as GA. 10199 Release etcd module as GA. 10200 Release kubernetes apiserver and event metricsets as GA 10212 Release Couchbase module as GA. 10201 Release aerospike module as GA. 10203 Release envoyproxy module GA. 10223 Release mongodb.metrics and mongodb.replstatus as GA. 10242 Release mysql.galera_status as Beta. 10242 Release postgresql.statement as GA. 10242 Release RabbitMQ Metricbeat module GA. 10165 Release Dropwizard module as GA. 10240 Release Graphite module as GA. 10240 Release http.server metricset as GA. 10240 Add support for MySQL 8.0 and tests also for Percona and MariaDB. 10261 Release use of xpack.enabled: true flag in Elasticsearch and Kibana modules as GA. 10222 Release Elastic stack modules (Elasticsearch, Logstash, and Kibana) as GA. 10094 Add remaining memory metrics of pods in Kubernetes metricbeat module 10157 Added 'server' Metricset to Zookeeper Metricbeat module 8938 10341 Add overview dashboard to Zookeeper Metricbeat module 10379 Mark Functionbeat as GA. 10564 Functionbeat can now deploy a function for Kinesis. 10116 Allow functionbeat to use the keystore. 9009 Deprecate field source. Will be replaced by log.source.address and log.file.path in 7.0. 9435 Deprecate field metricset.rtt. Replaced by event.duration which is in nano instead of micro seconds. Support new TLS version negotiation introduced in TLS 1.3. 8647. Journalbeat requires at least systemd v233 in order to follow entries after journal changes (rotation, vacuum).
2020-04-15 15:00:55 +02:00
MAINTAINER= pkgsrc-users@NetBSD.org
HOMEPAGE= https://www.elastic.co/products/beats
COMMENT= Data Shippers for Elasticsearch
LICENSE= apache-2.0
EXTRACT_USING= bsdtar
USE_TOOLS+= gmake
GO_DIST_BASE= ${PKGBASE}-${GITHUB_TAG:S/v//}
GO_SRCPATH= github.com/elastic/beats
.include "../../lang/go/go-vars.mk"
.include "../../mk/bsd.prefs.mk"
PLIST_VARS+= audit
# Components to build/install
BEATS= filebeat heartbeat metricbeat packetbeat
CHECK_PORTABILITY_SKIP+= libbeat/scripts/Makefile # uses [[
# No SunOS compatible event reading supported
.if ${OPSYS} != "SunOS"
BEATS+= auditbeat
PLIST.audit= yes
.endif
.for beat in ${BEATS}
CHECK_RELRO_SKIP+= bin/${beat}
beats: Update to 6.8.8. Changes since 6.6.2: Beats version 6.8.8 Add support for Cisco syslog format used by their switch. 10760 Beats version 6.8.7 Fixed bug with elasticsearch/cluster_stats metricset not recording license expiration date correctly. 14541 14591 Make kibana module more resilient to Kibana unavailability. 15258 15270 Beats version 6.8.6 Fix recording of SSL cert metadata for Expired/Unvalidated x509 certs. 13687 Fix marshaling of ms-since-epoch values in elasticsearch/cluster_stats metricset. 14378 Fixed bug with elasticsearch/cluster_stats metricset not recording license ID in the correct field. 14592 Beats version 6.8.5 Convert indexed ms-since-epoch timestamp fields in elasticsearch/ml_job metricset to ints from float64s. 14220 14222 Beats version 6.8.4 Fix delay in enforcing close_renamed and close_removed options. 13488 13907 Fix merging of fields specified in global scope with fields specified under an input’s scope. 3628 13909 Fixed early expiration of templates (Netflow v9 and IPFIX). 13821 Fixed bad handling of sequence numbers when multiple observation domains were exported by a single device (Netflow V9 and IPFIX). 13821 Fixed increased memory usage with large files when multiline pattern does not match. 14068 Mark Kibana usage stats as collected only if API call succeeds. 13881 Beats version 6.8.3 Iterate over journal correctly, so no duplicate entries are sent. 12716 Fix panic in Redis Key metricset when collecting information from a removed key. 13426 Remove _nodes field from under cluster_stats as it’s not being used. 13010 Collect license expiry date fields as well. 11652 Beats version 6.8.2 Process dataset: Do not show non-root warning on Windows. 12740 Host dataset: Export Host fields to gob encoder. 12940 Skipping unparsable log entries from docker json reader 12268 Limit memory usage of Redis replication sessions. https://github.com/elastic/beats/issues/12657[12657 Beats version 6.8.1 Fixed a memory leak when using the add_process_metadata processor under Windows. 12100 Package dataset: Log error when Homebrew is not installed. 11667 Process dataset: Fixed a memory leak under Windows. 12100 Login dataset: Fix re-read of utmp files. 12028 Package dataset: Fixed a crash inside librpm after Auditbeat has been running for a while. 12147 12168 Fix direction of incoming IPv6 sockets. 12248 Package dataset: Auto-detect package directories. 12289 System module: Start system module without host ID. 12373 Host dataset: Fix reboot detection logic. 12591 Fix goroutine leak happening when harvesters are dynamically stopped. 11263 Fix initialization of the TCP input logger. 11605 Fix goroutine leak caused on initialization failures of log input. 12125 Fix memory leak in Filebeat pipeline acker. 12063 Fix goroutine leak on non-explicit finalization of log input. 12164 When TLS is configured for the TCP input and a certificate_authorities is configured we now default to required for the client_authentication. 12584 Avoid generating hints-based configuration with empty hosts when no exposed port is suitable for the hosts hint. 8264 12086 Fix direction of incoming IPv6 sockets. 12248 Validate that kibana/status metricset cannot be used when xpack is enabled. 12264 In the kibana/stats metricset, only log error (don’t also index it) if xpack is enabled. 12353 The elasticsearch/index_summary metricset gracefully handles an empty Elasticsearch cluster when xpack.enabled: true is set. 12489 12487 When TLS is configured for the http metricset and a certificate_authorities is configured we now default to required for the client_authentication. 12584 Fixed a memory leak when using process monitoring under Windows. 12100 Improved debug logging efficiency in PGQSL module. 12150 Add support to the system package dataset for the SUSE OS family. 11634 Add validation for elasticsearch and kibana modules' metricsets when xpack.enabled is set to true. 12386 Beats version 6.8.0 Updates to support changes to licensing of security features. Some Elastic Stack security features, such as encrypted communications, file and native authentication, and role-based access control, are now available in more subscription levels. For details, see https://www.elastic.co/subscriptions. Beats version 6.7.2 Relax validation of the X-Pack license UID value. 11640 Fix a parsing error with the X-Pack license check on 32-bit system. 11650 Fix OS family classification in add_host_metadata for Amazon Linux, Raspbian, and RedHat Linux. 9134 11494 Fix false positives reported in the host.containerized field added by add_host_metadata. 11494 Fix the add_host_metadata’s host.id field on older Linux versions. 11494 Package dataset: dlopen versioned librpm shared objects. 11565 Package dataset: Nullify Librpm’s rpmsqEnable. 11628 Don’t apply multiline rules in Logstash json logs. 11346 Prevent the docker/memory metricset from processing invalid events before container start 11676 Add support to the system package dataset for the SUSE OS family. 11634 Beats version 6.7.1 Initialize the Paths before the keystore and save the keystore into data/{beatname}.keystore. 10706 Remove IP fields from default_field in Elasticsearch template. 11399 Beats version 6.7.0 Port settings have been deprecated in redis/logstash output and will be removed in 7.0. 9915 Update the code of Central Management to align with the new returned format. 10019 Allow Central Management to send events back to kibana. 9382 Fix panic if fields settting is used to configure hosts.x fields. 10824 10935 Introduce query.default_field as part of the template. 11205 Beats Xpack now checks for Basic license on connect. 11296 Filesets with multiple ingest pipelines added in 8914 only work with Elasticsearch >= 6.5.0 10001 Add grok pattern to support redis 5.0.3 log timestamp. 9819 10033 Ingesting Elasticsearch audit logs is only supported with Elasticsearch 6.5.0 and above 8852 Remove ecs option from user_agent processors when loading pipelines with Filebeat 6.7.x into Elasticsearch < 6.7.0. 10655 11362 Remove monitor generator script that was rarely used. 9648 Fix TLS certificate DoS vulnerability. 10303 Fix panic and file unlock in spool on atomic operation (arm, x86-32). File lock was not released when panic occurs, leading to the beat deadlocking on startup. 10289 Adding logging traces at debug level when the pipeline client receives the following events: onFilteredOut, onDroppedOnPublish. 9016 Do not panic when no tokenizer string is configured for a dissect processor. 8895 Fix a issue when remote and local configuration didn’t match when fetching configuration from Central Management. 10587 Add ECS-like selectors and dedotting to docker autodiscover. 10757 10862 Fix encoding of timestamps when using disk spool. 10099 Include ip and boolean type when generating index pattern. 10995 Using an environment variable for the password when enrolling a beat will now raise an error if the variable doesn’t exist. 10936 Cancelling enrollment of a beat will not enroll the beat. 10150 Remove IP fields from default_field in Elasticsearch template. 11399 Package: Disable librpm signal handlers. 10694 Login: Handle different bad login UTMP types. 10865 Fix hostname references in System module dashbords. 11064 User dataset: Numerous fixes to error handling. 10942 Support IPv6 addresses with zone id in IIS ingest pipeline. 9836 error log: 9869 access log: 10029 Fix bad bytes count in docker input when filtering by stream. 10211 Fixed data types for roles and indices fields in elasticsearch/audit fileset 10307 Cover empty request data, url and version in Apache2 modulehttps://github.com/elastic/beats/pull/10846[10846] Fix a bug with the convert_timezone option using the incorrect timezone field. 11055 11164 Change URLPATH grok pattern to support brackets. 11135 11252 Add support for iis log with different address format. 11255 11256 Add fix to parse syslog message with priority value 0. 11010 Host header can now be overridden for HTTP requests sent by Heartbeat monitors. 9516 Fix checks for TCP send/receive data 10777 Do not stop collecting events when journal entries change. 9994 Fix MongoDB dashboard that had some incorrect field names from status Metricset 9795 9715 Fix issue that would prevent collection of processes without command line on Windows. 10196 Fixed data type for tags field in docker/container metricset 10307 Fixed data type for tags field in docker/image metricset 10307 Fixed data type for isr field in kafka/partition metricset 10307 Fixed data types for various hosts fields in mongodb/replstatus metricset 10307 Added function to close sql database connection. 10355 Fix parsing error using GET in Jolokia module. 11075 11071 Fix Winlogbeat escaping CR, LF and TAB characters. 11328 11357 Correctly extract Kinesis Data field from the Kinesis Record. 11141 Add the required permissions to the role when deployment SQS functions. 9152 Affecting all Beats Add ip fields to default_field in Elasticsearch template. 11035 Add cleanup_timeout option to docker autodiscover, to wait some time before removing configurations after a container is stopped. 10374 10905 System module process dataset: Add user information to processes. 9963 Add system package dataset. 10225 Add system module login dataset. 9327 Add entity_id fields. 10500 Add seven dashboards for the system module. 10511 Add field log.source.address and log.file.path to replace source. 9435 Support mysql 5.7.22 slowlog starting with time information. 7892 9647 Add support for ssl_request_log in apache2 module. 8088 9833 Add support for iis 7.5 log format. 9753 9967 Add support for MariaDB in the slowlog fileset of mysql module. 9731 Add convert_timezone to nginx module. 9839 10148 Add support for Percona in the slowlog fileset of mysql module. 6665 10227 Added support for ingesting structured Elasticsearch audit logs 8852 New iptables module that receives iptables/ip6tables logs over syslog or file. Supports Ubiquiti Firewall extensions. 8781 10176 Populate more ECS fields in the Suricata module. 10006 Made monitors.d configuration part of the default config. 9004 Autodiscover metadata is now included in events by default. So, if you are using the docker provider for instance, you’ll see the correct fields under the docker key. 10258 Add field event.dataset which is {module}.{metricset}. Add more TCP statuses to socket_summary metricset. 9430 Remove experimental tag from ceph metricsets. 9708 Add key metricset to the Redis module. 9582 9657 Add DeDot for kubernetes labels and annotations. 9860 9939 Add docker event metricset. 9856 Release Ceph module as GA. 10202 Release windows Metricbeat module as GA. 10163 Release traefik Metricbeat module as GA. 10166 List filesystems on Windows that have an access path but not an assigned letter 8916 10196 Release uswgi Metricbeat module GA. 10164 Release php_fpm module as GA. 10198 Release Memcached module as GA. 10199 Release etcd module as GA. 10200 Release kubernetes apiserver and event metricsets as GA 10212 Release Couchbase module as GA. 10201 Release aerospike module as GA. 10203 Release envoyproxy module GA. 10223 Release mongodb.metrics and mongodb.replstatus as GA. 10242 Release mysql.galera_status as Beta. 10242 Release postgresql.statement as GA. 10242 Release RabbitMQ Metricbeat module GA. 10165 Release Dropwizard module as GA. 10240 Release Graphite module as GA. 10240 Release http.server metricset as GA. 10240 Add support for MySQL 8.0 and tests also for Percona and MariaDB. 10261 Release use of xpack.enabled: true flag in Elasticsearch and Kibana modules as GA. 10222 Release Elastic stack modules (Elasticsearch, Logstash, and Kibana) as GA. 10094 Add remaining memory metrics of pods in Kubernetes metricbeat module 10157 Added 'server' Metricset to Zookeeper Metricbeat module 8938 10341 Add overview dashboard to Zookeeper Metricbeat module 10379 Mark Functionbeat as GA. 10564 Functionbeat can now deploy a function for Kinesis. 10116 Allow functionbeat to use the keystore. 9009 Deprecate field source. Will be replaced by log.source.address and log.file.path in 7.0. 9435 Deprecate field metricset.rtt. Replaced by event.duration which is in nano instead of micro seconds. Support new TLS version negotiation introduced in TLS 1.3. 8647. Journalbeat requires at least systemd v233 in order to follow entries after journal changes (rotation, vacuum).
2020-04-15 15:00:55 +02:00
CONF_FILES+= share/examples/beats/${beat}.yml \
${PKG_SYSCONFDIR}/${beat}.yml
.endfor
beats: Update to 6.8.8. Changes since 6.6.2: Beats version 6.8.8 Add support for Cisco syslog format used by their switch. 10760 Beats version 6.8.7 Fixed bug with elasticsearch/cluster_stats metricset not recording license expiration date correctly. 14541 14591 Make kibana module more resilient to Kibana unavailability. 15258 15270 Beats version 6.8.6 Fix recording of SSL cert metadata for Expired/Unvalidated x509 certs. 13687 Fix marshaling of ms-since-epoch values in elasticsearch/cluster_stats metricset. 14378 Fixed bug with elasticsearch/cluster_stats metricset not recording license ID in the correct field. 14592 Beats version 6.8.5 Convert indexed ms-since-epoch timestamp fields in elasticsearch/ml_job metricset to ints from float64s. 14220 14222 Beats version 6.8.4 Fix delay in enforcing close_renamed and close_removed options. 13488 13907 Fix merging of fields specified in global scope with fields specified under an input’s scope. 3628 13909 Fixed early expiration of templates (Netflow v9 and IPFIX). 13821 Fixed bad handling of sequence numbers when multiple observation domains were exported by a single device (Netflow V9 and IPFIX). 13821 Fixed increased memory usage with large files when multiline pattern does not match. 14068 Mark Kibana usage stats as collected only if API call succeeds. 13881 Beats version 6.8.3 Iterate over journal correctly, so no duplicate entries are sent. 12716 Fix panic in Redis Key metricset when collecting information from a removed key. 13426 Remove _nodes field from under cluster_stats as it’s not being used. 13010 Collect license expiry date fields as well. 11652 Beats version 6.8.2 Process dataset: Do not show non-root warning on Windows. 12740 Host dataset: Export Host fields to gob encoder. 12940 Skipping unparsable log entries from docker json reader 12268 Limit memory usage of Redis replication sessions. https://github.com/elastic/beats/issues/12657[12657 Beats version 6.8.1 Fixed a memory leak when using the add_process_metadata processor under Windows. 12100 Package dataset: Log error when Homebrew is not installed. 11667 Process dataset: Fixed a memory leak under Windows. 12100 Login dataset: Fix re-read of utmp files. 12028 Package dataset: Fixed a crash inside librpm after Auditbeat has been running for a while. 12147 12168 Fix direction of incoming IPv6 sockets. 12248 Package dataset: Auto-detect package directories. 12289 System module: Start system module without host ID. 12373 Host dataset: Fix reboot detection logic. 12591 Fix goroutine leak happening when harvesters are dynamically stopped. 11263 Fix initialization of the TCP input logger. 11605 Fix goroutine leak caused on initialization failures of log input. 12125 Fix memory leak in Filebeat pipeline acker. 12063 Fix goroutine leak on non-explicit finalization of log input. 12164 When TLS is configured for the TCP input and a certificate_authorities is configured we now default to required for the client_authentication. 12584 Avoid generating hints-based configuration with empty hosts when no exposed port is suitable for the hosts hint. 8264 12086 Fix direction of incoming IPv6 sockets. 12248 Validate that kibana/status metricset cannot be used when xpack is enabled. 12264 In the kibana/stats metricset, only log error (don’t also index it) if xpack is enabled. 12353 The elasticsearch/index_summary metricset gracefully handles an empty Elasticsearch cluster when xpack.enabled: true is set. 12489 12487 When TLS is configured for the http metricset and a certificate_authorities is configured we now default to required for the client_authentication. 12584 Fixed a memory leak when using process monitoring under Windows. 12100 Improved debug logging efficiency in PGQSL module. 12150 Add support to the system package dataset for the SUSE OS family. 11634 Add validation for elasticsearch and kibana modules' metricsets when xpack.enabled is set to true. 12386 Beats version 6.8.0 Updates to support changes to licensing of security features. Some Elastic Stack security features, such as encrypted communications, file and native authentication, and role-based access control, are now available in more subscription levels. For details, see https://www.elastic.co/subscriptions. Beats version 6.7.2 Relax validation of the X-Pack license UID value. 11640 Fix a parsing error with the X-Pack license check on 32-bit system. 11650 Fix OS family classification in add_host_metadata for Amazon Linux, Raspbian, and RedHat Linux. 9134 11494 Fix false positives reported in the host.containerized field added by add_host_metadata. 11494 Fix the add_host_metadata’s host.id field on older Linux versions. 11494 Package dataset: dlopen versioned librpm shared objects. 11565 Package dataset: Nullify Librpm’s rpmsqEnable. 11628 Don’t apply multiline rules in Logstash json logs. 11346 Prevent the docker/memory metricset from processing invalid events before container start 11676 Add support to the system package dataset for the SUSE OS family. 11634 Beats version 6.7.1 Initialize the Paths before the keystore and save the keystore into data/{beatname}.keystore. 10706 Remove IP fields from default_field in Elasticsearch template. 11399 Beats version 6.7.0 Port settings have been deprecated in redis/logstash output and will be removed in 7.0. 9915 Update the code of Central Management to align with the new returned format. 10019 Allow Central Management to send events back to kibana. 9382 Fix panic if fields settting is used to configure hosts.x fields. 10824 10935 Introduce query.default_field as part of the template. 11205 Beats Xpack now checks for Basic license on connect. 11296 Filesets with multiple ingest pipelines added in 8914 only work with Elasticsearch >= 6.5.0 10001 Add grok pattern to support redis 5.0.3 log timestamp. 9819 10033 Ingesting Elasticsearch audit logs is only supported with Elasticsearch 6.5.0 and above 8852 Remove ecs option from user_agent processors when loading pipelines with Filebeat 6.7.x into Elasticsearch < 6.7.0. 10655 11362 Remove monitor generator script that was rarely used. 9648 Fix TLS certificate DoS vulnerability. 10303 Fix panic and file unlock in spool on atomic operation (arm, x86-32). File lock was not released when panic occurs, leading to the beat deadlocking on startup. 10289 Adding logging traces at debug level when the pipeline client receives the following events: onFilteredOut, onDroppedOnPublish. 9016 Do not panic when no tokenizer string is configured for a dissect processor. 8895 Fix a issue when remote and local configuration didn’t match when fetching configuration from Central Management. 10587 Add ECS-like selectors and dedotting to docker autodiscover. 10757 10862 Fix encoding of timestamps when using disk spool. 10099 Include ip and boolean type when generating index pattern. 10995 Using an environment variable for the password when enrolling a beat will now raise an error if the variable doesn’t exist. 10936 Cancelling enrollment of a beat will not enroll the beat. 10150 Remove IP fields from default_field in Elasticsearch template. 11399 Package: Disable librpm signal handlers. 10694 Login: Handle different bad login UTMP types. 10865 Fix hostname references in System module dashbords. 11064 User dataset: Numerous fixes to error handling. 10942 Support IPv6 addresses with zone id in IIS ingest pipeline. 9836 error log: 9869 access log: 10029 Fix bad bytes count in docker input when filtering by stream. 10211 Fixed data types for roles and indices fields in elasticsearch/audit fileset 10307 Cover empty request data, url and version in Apache2 modulehttps://github.com/elastic/beats/pull/10846[10846] Fix a bug with the convert_timezone option using the incorrect timezone field. 11055 11164 Change URLPATH grok pattern to support brackets. 11135 11252 Add support for iis log with different address format. 11255 11256 Add fix to parse syslog message with priority value 0. 11010 Host header can now be overridden for HTTP requests sent by Heartbeat monitors. 9516 Fix checks for TCP send/receive data 10777 Do not stop collecting events when journal entries change. 9994 Fix MongoDB dashboard that had some incorrect field names from status Metricset 9795 9715 Fix issue that would prevent collection of processes without command line on Windows. 10196 Fixed data type for tags field in docker/container metricset 10307 Fixed data type for tags field in docker/image metricset 10307 Fixed data type for isr field in kafka/partition metricset 10307 Fixed data types for various hosts fields in mongodb/replstatus metricset 10307 Added function to close sql database connection. 10355 Fix parsing error using GET in Jolokia module. 11075 11071 Fix Winlogbeat escaping CR, LF and TAB characters. 11328 11357 Correctly extract Kinesis Data field from the Kinesis Record. 11141 Add the required permissions to the role when deployment SQS functions. 9152 Affecting all Beats Add ip fields to default_field in Elasticsearch template. 11035 Add cleanup_timeout option to docker autodiscover, to wait some time before removing configurations after a container is stopped. 10374 10905 System module process dataset: Add user information to processes. 9963 Add system package dataset. 10225 Add system module login dataset. 9327 Add entity_id fields. 10500 Add seven dashboards for the system module. 10511 Add field log.source.address and log.file.path to replace source. 9435 Support mysql 5.7.22 slowlog starting with time information. 7892 9647 Add support for ssl_request_log in apache2 module. 8088 9833 Add support for iis 7.5 log format. 9753 9967 Add support for MariaDB in the slowlog fileset of mysql module. 9731 Add convert_timezone to nginx module. 9839 10148 Add support for Percona in the slowlog fileset of mysql module. 6665 10227 Added support for ingesting structured Elasticsearch audit logs 8852 New iptables module that receives iptables/ip6tables logs over syslog or file. Supports Ubiquiti Firewall extensions. 8781 10176 Populate more ECS fields in the Suricata module. 10006 Made monitors.d configuration part of the default config. 9004 Autodiscover metadata is now included in events by default. So, if you are using the docker provider for instance, you’ll see the correct fields under the docker key. 10258 Add field event.dataset which is {module}.{metricset}. Add more TCP statuses to socket_summary metricset. 9430 Remove experimental tag from ceph metricsets. 9708 Add key metricset to the Redis module. 9582 9657 Add DeDot for kubernetes labels and annotations. 9860 9939 Add docker event metricset. 9856 Release Ceph module as GA. 10202 Release windows Metricbeat module as GA. 10163 Release traefik Metricbeat module as GA. 10166 List filesystems on Windows that have an access path but not an assigned letter 8916 10196 Release uswgi Metricbeat module GA. 10164 Release php_fpm module as GA. 10198 Release Memcached module as GA. 10199 Release etcd module as GA. 10200 Release kubernetes apiserver and event metricsets as GA 10212 Release Couchbase module as GA. 10201 Release aerospike module as GA. 10203 Release envoyproxy module GA. 10223 Release mongodb.metrics and mongodb.replstatus as GA. 10242 Release mysql.galera_status as Beta. 10242 Release postgresql.statement as GA. 10242 Release RabbitMQ Metricbeat module GA. 10165 Release Dropwizard module as GA. 10240 Release Graphite module as GA. 10240 Release http.server metricset as GA. 10240 Add support for MySQL 8.0 and tests also for Percona and MariaDB. 10261 Release use of xpack.enabled: true flag in Elasticsearch and Kibana modules as GA. 10222 Release Elastic stack modules (Elasticsearch, Logstash, and Kibana) as GA. 10094 Add remaining memory metrics of pods in Kubernetes metricbeat module 10157 Added 'server' Metricset to Zookeeper Metricbeat module 8938 10341 Add overview dashboard to Zookeeper Metricbeat module 10379 Mark Functionbeat as GA. 10564 Functionbeat can now deploy a function for Kinesis. 10116 Allow functionbeat to use the keystore. 9009 Deprecate field source. Will be replaced by log.source.address and log.file.path in 7.0. 9435 Deprecate field metricset.rtt. Replaced by event.duration which is in nano instead of micro seconds. Support new TLS version negotiation introduced in TLS 1.3. 8647. Journalbeat requires at least systemd v233 in order to follow entries after journal changes (rotation, vacuum).
2020-04-15 15:00:55 +02:00
BUILD_DEFS+= VARBASE
BEATS_DIR?= ${VARBASE}/db/beats
BEATS_LOGDIR?= ${VARBASE}/log/beats
FILES_SUBST+= BEATS_DIR=${BEATS_DIR}
FILES_SUBST+= BEATS_LOGDIR=${BEATS_LOGDIR}
PKG_SYSCONFSUBDIR= beats
SMF_INSTANCES+= ${BEATS}
OWN_DIRS+= ${BEATS_DIR} ${BEATS_LOGDIR}
MAKE_ENV+= GOPATH=${WRKDIR}:${PREFIX}/gopkg
MAKE_ENV+= CGO_LDFLAGS="-L${BUILDLINK_PREFIX.libpcap}/lib ${COMPILER_RPATH_FLAG}${BUILDLINK_PREFIX.libpcap}/lib"
# The build system defaults to -i which modifies system files!
MAKE_ENV+= GOBUILD_FLAGS=
BUILD_TARGET= #
INSTALLATION_DIRS+= bin share/examples/beats
do-build:
.for beat in ${BEATS}
cd ${WRKSRC}/${beat} && ${BUILD_MAKE_CMD}
.endfor
do-install:
.for beat in ${BEATS}
${INSTALL_PROGRAM} ${WRKSRC}/${beat}/${beat} ${DESTDIR}${PREFIX}/bin
Update sysutils/beats to 6.0.0. === Beats version 6.0.0 ==== Breaking changes Affecting all Beats - The log directory (`path.log`) for Windows services is now set to `C:\ProgramData\[beatname]\logs`. - The _all field is disabled in Elasticsearch 6.0. - Fail if removed setting output.X.flush_interval is explicitly configured. - Rename the `/usr/bin/beatname.sh` script (e.g. `metricbeat.sh`) to `/usr/bin/beatname`. - Beat does not start if elasticsearch index pattern was modified but not the template name and pattern. - Fail if removed setting output.X.flush_interval is explicitly configured. - Rename `kubernetes` processor to `add_kubernetes_metadata`. - Rename `.full.yml` config files to `*.reference.yml`. - The `scripts/import_dashboards` is removed from packages. Use the `setup` command instead. - Change format of the saved kibana dashboards to have a single JSON file for each dashboard - Rename `configtest` command to `test config`. - Remove setting `queue_size` and `bulk_queue_size`. - Remove setting `dashboard.snapshot` and `dashboard.snapshot_url`. - Beats can no longer be launched from Windows Explorer (GUI), command line is required. Filebeat - Rename `input_type` field to `prospector.type` - The `@metadata.type` field, added by the Logstash output, is now hardcoded to `doc` and will be removed in future versions. Metricbeat - Change all `system.cpu..pct` metrics to be scaled by the number of CPU cores. - Remove filters setting from metricbeat modules. - Added `type` field to filesystem metrics. Heartbeat - Renamed the heartbeat RPM/DEB name to `heartbeat-elastic`. Packetbeat - Remove not-working `runoptions.uid` and `runoptions.gid` options in Packetbeat. - Remove the already unsupported `pf_ring` sniffer option. Auditbeat - Changed file metricset config to make `file.paths` a list instead of a dictionary. ==== Bugfixes Affecting all Beats - Fix data race accessing watched containers. - Do not require template if index change and template disabled - Fix missing ACK in redis output. - Fix the `/usr/bin/beatname` script to accept `-d ""` as a parameter. - Combine `fields.yml` properties when they are defined in different sources. - Keep Docker & Kubernetes pod metadata after container dies while they are needed by processors. - Fix `fields.yml` lookup when using `export template` with a custom `path.config` param. - Remove runner creation from every reload check - Fix add_kubernetes_metadata matcher registry lookup. - Register kubernetes `field_format` matcher and remove logger in `Encode` API - Fix go plugins not loaded when beat starts - Add support for `initContainers` in `add_kubernetes_metadata` processor. - Eliminate deprecated _default_ mapping in 6.x - Fix pod name indexer to use both namespace, pod name to frame index key - Don't stop with error loading the ES template if the ES output is not enabled. - Fix race condition in internal logging rotator. - Normalize all times to UTC to ensure proper index naming. - Fix issue with loading dashboards to ES 6.0 when .kibana index did not already exist. - Fix importing the dashboards when the limit for max open files is too low. - Fix configuration documentation for kubernetes processor - Fix misspelling in `add_locale` configuration option for abbreviation. Filebeat - Fix machine learning jobs setup for dynamic modules. - Fix default paths for redis 4.0.1 logs on macOS - Fix Filebeat not starting if command line and modules configs are used together. - Fix double `@timestamp` field when JSON decoding was used. - Fix issue where the `fileset.module` could have the wrong value. - Fix race condition on harvester stopping with reloading enabled. - Fix recursive glob config parsing and resolution across restarts. - Allow string characters in user agent patch version (NGINX and Apache) - Fix grok pattern in filebeat module system/auth without hostname. Winlogbeat - Removed validation of top-level config keys. Metricbeat - Use `beat.name` instead of `beat.hostname` in the Host Overview dashboard. - Fix the loading of 5.x dashboards. - Fix a memory allocation issue where more memory was allocated than needed in the windows-perfmon metricset. - Don't start metricbeat if external modules config is wrong and reload is disabled - The MongoDB module now connects on each fetch, to avoid stopping the whole Metricbeat instance if MongoDB is not up when starting. - Fix kubernetes events module to be able to index time fields properly. - Fixed `cmd_set` and `cmd_get` being mixed in the Memcache module. - Added missing mongodb configuration file to the `modules.d` folder. - Fix wrong MySQL CRUD queries timelion visualization - Add new metrics to CPU metricsset - Fix issue affecting Windows services timing out at startup. - Fix incorrect docker.diskio.total metric calculation. - Vsphere module: used memory field corrected. - Set correct format for percent fields in memory module. - Fix a debug statement that said a module wrapper had stopped when it hadn't. - Use MemAvailable value from /proc/meminfo on Linux 3.14. - Fix panic when events were dropped by filters. - Add filtering to system filesystem metricset to remove relative mountpoints like those from Linux network namespaces. - Remove unnecessary print statement in schema apis. - Fix type of field `haproxy.stat.check.health.last`. Heartbeat - Fix monitor.name being empty by default. - Fix wrong event timestamps. Packetbeat - Fix missing length check in the PostgreSQL module. - Fix panic in ACK handler if event is dropped on blocked queue - Update flow timestamp on each packet being received. - Enabled /proc/net/tcp6 scanning and fixed ip v6 parsing. - Enable memcache filtering only if a port is specified in the config file. Auditbeat - Fix `file.max_file_size` config option for the audit file metricset. ==== Added Affecting all Beats - Enable flush timeout by default. - Add @metadata.version to events send to Logstash. - Add setting to enable/disable the slow start in logstash output. - Update init scripts to use the `test config` subcommand instead of the deprecated `-configtest` flag. - Get by default the credentials for connecting to Kibana from the Elasticsearch output configuration. - Added `cloud.id` and `cloud.auth` settings, for simplifying using Beats with the Elastic Cloud. - Add lz4 compression support to kafka output. - Add newer kafka versions to kafka output. - Configure the index name when loading the dashboards and the index pattern. - New cli subcommands interface. - Allow source path matching in `add_docker_metadata` processor. - Add support for analyzers and multifields in fields.yml. - Add support for JSON logging. - Add `test output` command, to test Elasticsearch and Logstash output settings. - Introduce configurable event queue settings: queue.mem.events, queue.mem.flush.min_events and queue.mem.flush.timeout. - Enable pipelining in Logstash output by default. - Added 'result' field to Elasticsearch QueryResult struct for compatibility with 6.x Index and Delete API responses. - The sample dashboards are now included in the Beats packages. - Add `pattern` option to be used in the fields.yml to specify the pattern for a number field. - Upgraded to Golang 1.8.3. - Added the possibility to set Elasticsearch mapping template settings from the Beat configuration file. - Add a variable to the SysV init scripts to make it easier to change the user. - Add the option to write the generated Elasticsearch mapping template into a file. - Add `instance_name` in GCE add_cloud_metadata processor. - Add `add_docker_metadata` processor. - Add `logging.files` `permissions` option. Filebeat - Add Kubernetes manifests to deploy Filebeat. - Changed the number of shards in the default configuration to 3. - Don't start filebeat if external modules/prospectors config is wrong and reload is disabled - Add `filebeat.registry_flush` setting, to delay the registry updates. - Add experimental Redis module. - Nginx module: use the first not-private IP address as the remote_ip. - Load Ingest Node pipelines when the Elasticsearch connection is established, instead of only once at startup. - Add support for loading Xpack Machine Learning configurations from the modules, and added sample configurations for the Nginx module. - Add udp prospector type. - Enabled Cgo which means libc is dynamically compiled. - Add Beta module config reloading mechanism - Remove spooler and publisher components and settings. - Added ability to sort harvested files. - Add experimental Redis slow log prospector type. Winlogbeat - Changed the number of shards in the default configuration to 3. - Add the ability to use LevelRaw if Level isn't populated in the event XML. Metricbeat - Add Kubernetes manifests to deploy Metricbeat. - Auto-select a hostname (based on the host on which the Beat is running) in the Host Overview dashboard. - Add `filesystem.ignore_types` to system module for ignoring filesystem types. - Add support to exclude labels from kubernetes pod metadata. - Add random startup delay to each metricset to avoid the thundering herd problem. - Add the ability to configure audit rules to the kernel module. - Add the ability to configure kernel's audit failure mode. - Add experimental Aerospike module. - Vsphere module: collect custom fields from virtual machines. - Add `test modules` command, to test modules expected output. - Add `processors` setting to metricbeat modules. - Support `npipe` protocol (Windows) in Docker module. - Add macOS implementation of the system diskio metricset. - Add process_summary metricset that records high level metrics about processes. - Add `kube-state-metrics` based metrics to `kubernetes` module - Add debug logging to Jolokia JMX metricset. - Add events metricset for kubernetes metricbeat module - Change Metricbeat default configuration file to be better optimized for most users. - Add experimental RabbitMQ module. - Add Kibana dashboard for the Kubernetes modules. Heartbeat - Changed the number of shards in the default configuration to 1. - Enabled Cgo which means libc is dynamically compiled. Packetbeat - Changed the number of shards in the default configuration to 3. Auditbeat - Changed the number of shards in the default configuration to 3. - Add support for receiving audit events using a multicast socket. - Added `file.hash_types` config option for controlling the hash types. - Added the ability to specify byte unit suffixes to `file.max_file_size`. - Add file integrity metricset to the audit module. ==== Deprecated Affecting all Beats - The `@metadata.type` field, added by the Logstash output, is deprecated, hardcoded to `doc` and will be removed in future versions. Filebeat - The `filebeat.config_dir` option is deprecated. Use `filebeat.config.prospector` options instead. - Deprecate `input_type` prospector config. Use `type` config option instead. === Beats version 5.6.4 - Fix race condition in internal logging rotator. - Add support for enabling TLS renegotiation. - Add setting to enable/disable the slow start in logstash output. - Packetbeat: Fix missing length check in the PostgreSQL module.
2017-11-20 16:55:16 +01:00
${INSTALL_DATA} ${WRKSRC}/${beat}/${beat}.reference.yml \
${DESTDIR}${PREFIX}/share/examples/beats
${INSTALL_DATA} ${WRKSRC}/${beat}/${beat}.yml \
${DESTDIR}${PREFIX}/share/examples/beats
.endfor
.include "../../lang/go/go-package.mk"
.include "../../net/libpcap/buildlink3.mk"
.include "../../mk/bsd.pkg.mk"