Patches provided by Matthew Luckie in PR pkg/50654.
ChangeLogs:
https://mailman.caida.org/pipermail/scamper-announce/2015-October/000004.htmlhttps://mailman.caida.org/pipermail/scamper-announce/2015-December/000005.htmlhttps://mailman.caida.org/pipermail/scamper-announce/2016-January/000006.html
tbit
* add support for initial congestion window (ICW) inferences
* add new tests to check response to packets that could have been
sent by a blind attacker
* add a TCP fast-open implementation, with both experimental
and official option values
* add support for testing HTTPS and BGP. drop FTP, DNS, and SMTP
* add sc_tbitblind driver that was used for IMC 2015 paper
trace
* add tx timestamp to hop records
* add dl option, to replace dlts option removed from scamper.
* process UDP responses, if a UDP probe method is used.
ping:
* add tcp-syn ping method.
* fix memory leak when payloads are specified in ping.
sc_ipiddump
* report IPID values from traceroute measurements, where available
* report the source IP address used to probe the destination
sc_filterpolicy:
* add a new scamper driver to test systems for congruent filtering policy
http://www.caida.org/tools/measurement/scamper/man/sc_filterpolicy.1.pdf
scamper:
* update scamper maximum PPS to 10,000 (from 1000). Its not 2002 anymore.
* bind to requested source port with UDP sockets.
* set SO_SNDBUF once, when a probe socket is created.
* remove dlts option which was only used by traceroute.
* drop divert socket from privsep, which was not used in scamper anywhere.
* shift socket creation glue from scamper_privsep.c to
scamper_udp4.c, scamper_icmp6.c, etc.
* fix memory leak when receiving TCP responses in tracelb.
* do not use the global address cache in tracelb: use a local one.
* in qsort with 3-way partition, do not compare items against
themselves.
* improve performance of warts_addr_t code
* use calloc instead of malloc() -> memset(0) on systems where calloc
is available.
* do not use the global address cache in ping: most responses are
either from the destination, or from the same IP address, so
optimize for that.
From https://rommie.caida.org/pipermail/scamper-announce/2015-August/000003.html
* provide the ability for scamper's control socket to bind to a
specific address. this allows external systems to contact and drive
scamper processes. a more secure solution will follow in a month or
two.
* when converting the source port of a control socket client to a
string, print it in host byte order rather than network byte order
* add a TBT (too-big-trick) option to ping, use it in sc_speedtrap. a
simple optimisation to send up to M packets to get N fragmented
responses.
* if an input list to sc_speedtrap contains the same IP address twice,
ignore the duplicate address, rather than crash later.
* use a quicksort with a 3-way partition. will make scamper more
efficient in many places.
* add sc_warts2csv for samknows
* fix sc_tracediff so that it doesn't crash if the two warts files
being compared traceroute to different sets of addresses. reported
by Job Snijders.
20141101:
* fix passing file descriptors through sockets on NetBSD, so that
scamper can actually work with privsep on NetBSD.
* use arc4random on all platforms where available. silences build on
OpenBSD.
* increase size of flags array for warts_dealias_data_t so that all
of the prefixscan flags can fit. pointed out by OpenBSD gcc.
* silence build on NetBSD by casting parameter to isspace from char
to int.
* silence a couple spurious clang scan-build warnings with assert
statements.
20141031:
In this Halloween release of scamper:
* work to make scamper compile and work on windows again. use
O_BINARY so that output warts files are not corrupted, set the timer
granularity to 1ms, and handle polling/reading files outside of
select(). Thanks to Philip Ramsey of Renesys for reporting these
bugs and supplying the O_BINARY and timer fixes. as part of trying
to track down the output corruption I added malloc_zero everywhere,
in vain, but kept it in scamper out of an abundance of caution.
* detangle scamper_fd_t from scamper_writebuf_t.
* in ping,
- set a timeout after sending a PTB
- print reply_ipid in json output for ipv6 echo replies, bump
json version.
* update scamper -O options in the usage statement, and in the
manual page
20140530:
* FreeBSD 10 onwards no longer byte swaps some fields in the quotation of
a received ICMP error message. chase this in scamper.
* Minor modifications to make scamper compile on Windows 7 using
Visual Studio Express 2013 for Windows Desktop.
* print ping flags in sc_wartsdump and scamper's json output.
email alias tied to this mailing list, please let me know.
20140404:
* allow scamper to be built in debug mode on FreeBSD after version 10.
* in scamper-ping, support a probe frequency smaller than once every
second. minimum is now once a millisecond.
* handle fragmented responses in linux and sunos correctly.
this is important for IPv6 IP-ID based alias resolution techniques
(e.g. speedtrap, ally, radargun) on those platforms.
* numerous bugfixes and improvements to sc_ally pair-wise alias
resolution utility, the most important being that it will reliably
complete now.
from PR pkg/48546
scamper-dealias:
* many slight improvements to the implementation of the 'ally' alias
resolution algorithm.
* add flag to prefixscan that says the alias was inferred using a common
source address
* for json output, print flags, bump version.
scamper-ping:
* record ICMP parameter problem responses to ping.
* for json output, print tx time on probes.
sc_attach:
* add support for starting as a daemon.
* add support for specifying a command which will be used with each address
* document these options in manual page
sc_analysis_dump:
* update manual page to document unintuitive behaviour of -e option.
misc:
* getopt returns an int, not a char. important on arm. fixed in
sc_wartscat, sc_speedtrap, and sc_analysis_dump,
* silence benign warnings from clang on MacOS and cppcheck.
PR pkg/48156
* add a sc_warts2json utility program that prints out JSON renderings
of trace, ping, and dealias objects in scamper warts files. this is
useful when developing simple analysis programs in perl. the
initial implementation of JSON output for ping and trace was
supplied by Internap. Thanks a lot Internap!
* add a sc_speedtrap utility program that resolves a set of IPv6
interfaces for aliases (which interfaces belong to the same router).
documented in sc_speedtrap(1) man page.
http://www.caida.org/~mjl/pubs/speedtrap.pdf
* add a sc_ipiddump utility program that prints out all IPIDs received
in ping and dealias objects. documented in sc_ipiddump(1) man page.
in ping and dealias objects. documented in sc_ipiddump(1) man page.
in scamper:
* output json objects with -O json
* add -O debugfileappend, causing the debugfile to be appended to
rather than truncated
* do not output debugging information to stderr if NDEBUG was
specified
* drain fds that are not used by any measurement but have not been
closed yet
* improve the use of poll()
* allow a control socket client to specify its mixing priority
* correctly interpret the neighbour discovery cache sysctl on MacOS.
* fix build on MacOS systems without IPFW.
* fixes prompted by clang static analysis.
* fixes prompted by clang static analysis.
in sc_analysis_dump:
* improvements to the comment header printed automatically at the start
* add -M option to print out MPLS headers in ICMP extensions.
* add -Q option to print out Quoted IP TTL
* add -T option to print out the IP TTL of the response packet
in scamper-ping
* implement stats function so that the stats printed are not junk
* add an -M <mtu> option which causes scamper to send a PTB in
response to a packet larger than the given size.
* add a -P icmp-time option which causes ping to send ICMP timestamp
requests.
requests.
in scamper-sting:
* various improvements in the hole filling phase.
* add -U <userid>
in scamper-dealias:
* implement IPv6 support for Ally and RadarGun which is induced by
sending ICMP echo packets larger than a given pseudo MTU size
(causing a responses to be fragmented and thus an ID field revealed.
* implement IPv6 support for Mercator
* be more strict in declaring two interfaces to be aliases: infer
the byte ordering by determining if the shortest distance in a
sequence of ID values is in byte-swapped or not, and then using
that byte ordering mode.
* provide documentation for libscamperfile
* fix ping -O spoof
* fix tracelb and sniff bugs that cause scamper to crash
* fix sc_analysis_dump, sc_warts2pcap, and sc_wartscat man pages
* fix sc_warts2text to read from stdin if no files specified
* add -a (all) -m (pair method) and -n (use dns) options to sc_tracediff
* initial draft of a man page for the warts file format.
man 5 warts.
* provide -O copyout option to scamper itself, which allows all
data written over the control socket in "attach" mode to also
be sent to a named file. useful for debugging. documented
in the scamper man page.
* provide ability to specify the source address of a PTB in tbit.
* in attach mode, each command now returns a command ID as part
of the OK response. a command may be halted before it completes
by issuing a halt command over the same control socket.
* when sanity checking the probe size requested in ping, take
account of the timestamp IP option correctly. noticed by
Alistair.
* fix scamper man page to say -d can be used to set the ICMP checksum
value in Paris traceroute. noticed by Alistair.
* add scamper_addr_netaddr, a routine to mask the network portion of
an IP address in a scamper_addr_t.
* fix scamper's ping to actually set the tos byte that is passed in.
noticed by Alistair.
* fix scamper's ping to record ICMPv6 PTB messages.
* fix the result code set on sniff tasks when a sniff task is halted.
* fix compiler warnings
* correct copyright notices to reflect that, until 2006,
I have copyright. No change to GPLv2 license.
* Switch from select(2) to poll(2) by default, which is useful
when more than a thousand fds are monitored for events.
Force the use of select instead of poll by invoking scamper
with -O select.
* Add support for kqueue (BSD) and epoll (Linux). To use,
specify -O kqueue or -O epoll when scamper is invoked.
* Fix a bug that could allow scamper to enter an infinite
loop if a packet with malformed IP options is received.
* Add support for raw IP sockets, and use these to send
TCP probes in traceroute if the datalink socket can't be
used to transmit.
* Set SO_REUSEADDR on TCP sockets.
* Add a new traceroute method: IPv6 fragment traceroute.
specify the offset to encode in the fragment offset with -o
* Fix file support so that if '-' is specified as the source of
addresses to probe stdin is read, rather than stdout. ensure
the file is closed if an error is encountered when opening a
file.
* Fix bug in MDA traceroute where some TCP responses from the
target were ignored.
* Fix a potential memory leak in the neighbour discovery code
* Implement code to calculate statistics (min/mean/max/stddev)
on ping results.
* Detach the writebuf before closing an attached control socket
* Silence all clang static analysis warnings.
* do not output scamper_debug to stderr if NDEBUG has been specified
* fix logic when -O rawtcp is used with tcptraceroute
* fix scamper event loop to drain sockets that are currently
unreferenced
* fix scamper event loop to handle POLLHUP
* fix double-frees in scamper_sources.c
* fix small memory leak in scamper_sources.c, noticed by Stephen
* fix uname_wrap on 64bit systems, noticed by Stephen
* do not print "cat" when the -e option is used with sc_analysis_dump.
* fix mixing of sources according to their priority.
* when building the scamper binary, do not use the libscamperfile
library. instead, build all code into scamper to ensure scamper
itself will always work.
PR#44929.
The main changes are to sc_tracediff, a program that displays traceroutes side
by side that have changed. There are bug fixes to sc_tracediff, as well as
enhancements.
patch provided by Matthew Luckie via PR#44919.
A lot of changed in scamper since 2008.
For some idea about what is in scamper today, please check the website,
in particular the scamper man page.
and IPv6 addresses in parallel to fill a specified packets-per-second rate.
scamper can do ICMP based Path MTU discovery. scamper starts with the
outgoing interface's MTU and discovers the location of PMTU bottlenecks.
Recent revision of scamper do a PMTU search when an ICMP fragmentation
required message is not returned to establish the PMTU to the next point
in the network, followed by a TTL limited search to infer the hop
where failure appears to occur.
Reviewed by Johnny Lam.
