curben
/
phishing-filter
mirror of https://gitlab.com/malware-filter/phishing-filter.git
1
0
Fork 0
Code Issues Releases Wiki Activity
1,290 Commits 2 Branches 0 Tags 1.2 GiB
Commit Graph

66 Commits

Author SHA1 Message Date
MDLeom 07ca1adfd1
refactor: lazy load os-release 2023-05-20 11:23:07 +00:00
MDLeom 667fad0b6f
style: remove debug message 2023-05-20 11:15:29 +00:00
MDLeom 13289d3365
fix: dash does not support pipefail 2023-05-20 10:38:47 +00:00
MDLeom eac902123e
fix: check installed grep is GNU variant 2023-05-20 09:51:12 +00:00
MDLeom eebf51ac47
fix: check existent of busybox 
if dos2unix is not installed
 2023-05-20 09:44:54 +00:00
MDLeom ca23363ef4
fix: reprocess decoded safelink 
- extend 1ea3ce51f5
- also include scope of 0578e6c16a
 2023-05-20 08:20:22 +00:00
MDLeom 0578e6c16a
fix: handle URL of top domains without path 
- ref #62, #43, #44
- 745c81b134, c623542b9a, 8923941376
were not effective previously
 2023-05-19 10:34:04 +00:00
MDLeom 7dbdc85163
fix: sed syntax to recognise newline 
https://gitlab.com/malware-filter/urlhaus-filter/-/issues/79
 2023-04-29 04:11:14 +00:00
MDLeom 8aa4d2334c
fix: cloudflare radar dataset is now in csv format 
instead of zip
 2023-01-16 07:09:35 +00:00
MDLeom b5048417b0
style(sed): avoid backslash in insert option 
- simpler and more readable
- https://unix.stackexchange.com/a/99351
 2022-12-17 00:19:11 +00:00
MDLeom 97cec9d0e8
feat: add csv file for Splunk lookup 
- https://docs.splunk.com/Documentation/Splunk/9.0.2/Knowledge/Aboutlookupsandfieldactions
 2022-12-17 00:06:59 +00:00
MDLeom 53c62b74c3
docs(header): switch date format from RFC 5322 to ISO 8601 
- universally readable
 2022-12-16 08:18:00 +00:00
MDLeom 1ea3ce51f5
feat: decode O365 safelink 
- https://support.microsoft.com/en-us/office/advanced-outlook-com-security-for-microsoft-365-subscribers-882d2243-eab9-4545-a58a-b36fee4a46e2
 2022-12-04 03:53:09 +00:00
MDLeom 5a4a8bb9bc
refactor: xmlstarlet -> html-xml-utils 2022-12-01 10:00:32 +00:00
MDLeom e653ba90c6
fix: remove extra curl option 2022-11-26 01:31:21 +00:00
MDLeom 4bf534bdbc
feat: add Cloudflare Radar top 1m domains dataset 2022-11-25 07:19:20 +00:00
MDLeom c376e2a08f
feat: fallback to busybox dos2unix 2022-11-03 08:48:16 +00:00
MDLeom e51886ff44
feat: fallback to busybox dos2unix 2022-11-03 08:46:39 +00:00
MDLeom a50b2be515
fix: disable phishunt 
- closes #43
- closes #45
 2022-11-03 08:41:25 +00:00
MDLeom eea9efd0f1
style: alias "curl -L" 2022-10-10 09:15:57 +00:00
MDLeom 93824af81b
fix: add user agent to phishtank request 
https://phishtank.org/developer_info.php
 2022-10-10 09:13:39 +00:00
MDLeom c523b653bb
fix: make PHISHTANK_API optional 
- add TOC
 2022-10-03 03:44:53 +00:00
MDLeom e68268f506
fix: remove mitchellkrogza/Phishing.Database source 
- close #35
 2022-09-27 09:43:30 +00:00
MDLeom 8fa366b37f
feat(sources): add phishunt.io & mitchellkrogza/Phishing.Database 
- inspired by Phishing.Army
 2022-07-31 08:29:10 +00:00
MDLeom b4229b2d56
fix: migrate to malware-filter group 
- BREAKING CHANGE
- gitlab.com/malware-filter/phishing-filter
 2022-05-21 03:04:56 +00:00
MDLeom 61762c4272
docs: to be migrated to gitlab.com/malware-filter 
- https://about.gitlab.com/blog/2021/11/11/public-project-minute-limits
- https://about.gitlab.com/blog/2022/02/04/ultimate-perks-for-open-source-projects
 2022-05-11 07:50:55 +00:00
MDLeom d7253c825e
fix: remove oisd exclusion list 
- captcha
 2022-03-28 10:29:01 +00:00
MDLeom dc834ed04a
fix: use GNU grep instead of busybox 2022-01-13 06:02:34 +00:00
MDLeom 0e7c5bb2af
Revert "fix: oisd.nl is down at the moment" 
This reverts commit d931f137e2.
 2022-01-09 08:33:16 +00:00
MDLeom d931f137e2
fix: oisd.nl is down at the moment 2022-01-09 07:35:42 +00:00
MDLeom 8bb0e6e990
refactor(actions): replicate gitlab ci 2022-01-09 07:32:09 +00:00
MDLeom 6cb2cbff6e refactor: deploy filters to gitlab pages 
- 8c94ddba40
 2022-01-08 03:01:41 +00:00
MDLeom aaab4b82fb
refactor: url encode space on the source 2022-01-02 01:15:46 +00:00
MDLeom ac81d8394e
fix: url encode space 
- Closes #11
 2022-01-02 01:10:57 +00:00
MDLeom 0a633e3c57
fix: stricter IPv4 matching 
- avoid excluding domains with IPv4, e.g. static.21.101.69.159.clients.your-server.de
 2021-07-18 09:59:09 +00:00
MDLeom 9fbb4b4686
feat: dnscrypt-proxy blocklists 
- support names and IPs
- https://github.com/DNSCrypt/dnscrypt-proxy
 2021-07-18 09:55:58 +00:00
MDLeom 0e9845b69a
fix: remove port number and deduplicate entries 
- Fixes #8
 2021-06-20 07:38:55 +00:00
MDLeom 43ac6158f1 fix: cleanup oisd-exlusion files 2021-05-05 10:05:18 +00:00
MDLeom 7cba69f1d5 fix: add oisd exclusion list 
- https://oisd.nl/excludes.php
 2021-05-05 10:05:17 +00:00
MDLeom 421e52d340
docs: switch mirror to curben.gitlab.io/malware-filter 
- 40647d12e7
 2021-04-02 03:43:28 +00:00
MDLeom 22c10b4018
feat: DNS Response Policy Zone (RPZ) 
- syntax based on https://rpz.oisd.nl/basic/
 2021-04-02 03:37:21 +00:00
MDLeom cf3a820b24 refactor: dedup ip removal function 2021-04-02 03:21:25 +00:00
MDLeom 3417d86243
docs: limitation of snort2 2021-03-20 00:57:45 +00:00
MDLeom 153970064d
fix: unique sid 
- resolve conflict with urlhaus-filter
 2021-03-20 00:56:59 +00:00
MDLeom 7cea93d141
refactor: simpler sed 2021-03-19 22:10:54 +00:00
MDLeom 4d0b92434b feat: add Snort3 ruleset 2021-03-19 19:04:02 +00:00
MDLeom 2024c75550
docs: link to license section 
- license differs on components and sources
 2021-03-18 22:04:01 +00:00
MDLeom cc9b306076
fix: prod 2021-03-18 18:51:43 +00:00
MDLeom d258cbd714
fix(snort/suricata): escape colons 
- trim snort rule to 2047 chars
 2021-03-18 18:49:50 +00:00
MDLeom d76146515c
feat: add Snort2 and Suricata rulesets 2021-03-18 17:44:15 +00:00