wireshark/wiretap
Guy Harris f71f968438 Clean up some things.
Rename ascend_seek() to ascend_find_next_packet(), to indicate what it
does; it doesn't seek to an arbitrary place, it tries to find the
starting offset of the next packet when reading sequentially.

Don't have it set the header type - that's the job of the parser.

Don't set the "next packet seek start" when doing random access I/O -
that field is only for sequential I/O, and we don't want random I/O
happening at the same time (which can happen in Wireshark) interfering.

Clean up comments.

Change-Id: I2808479eeec074afa16945ffb577b91d8cb356f7
Reviewed-on: https://code.wireshark.org/review/29975
Reviewed-by: Guy Harris <guy@alum.mit.edu>
2018-10-02 11:20:57 +00:00
..
.editorconfig Add EditorConfig settings for most C files 2016-03-08 10:46:35 +00:00
5views.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
5views.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
CMakeLists.txt Try to discourage the use of APIs via counting. 2018-09-19 16:07:03 +00:00
README
README.airmagnet
README.developer Add a systemd Journal Export Format parser and dissector. 2018-08-31 05:20:27 +00:00
aethra.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
aethra.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
ascend-int.h Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
ascend.y Clean up some things. 2018-10-02 11:20:57 +00:00
ascend_scanner.l Fix handling of some ISDN calls. 2018-10-01 19:58:49 +00:00
ascendtext.c Clean up some things. 2018-10-02 11:20:57 +00:00
ascendtext.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
atm.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
atm.h Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
ber.c wiretap: remove redundant ws_buffer_assure_space 2018-09-29 17:20:25 +00:00
ber.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
btsnoop.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
btsnoop.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
camins.c wiretap: camins: add support for timestamps 2018-05-30 04:25:08 +00:00
camins.h Fix some source headers, reformat SPDX license lines in comment block. 2018-02-18 22:50:37 +00:00
capsa.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
capsa.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
catapult_dct2000.c catapult dct2000: don't dump comments one char at a time, and other fussing 2018-02-27 06:08:21 +00:00
catapult_dct2000.h Fix comment end after SPDX identifier 2018-05-01 06:56:37 +00:00
commview.c Fix some source headers, reformat SPDX license lines in comment block. 2018-02-18 22:50:37 +00:00
commview.h Fix some source headers, reformat SPDX license lines in comment block. 2018-02-18 22:50:37 +00:00
cosine.c cosine.c: fix compilation with gcc 8 2018-05-02 20:02:47 +00:00
cosine.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
csids.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
csids.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
daintree-sna.c Fix some source headers, reformat SPDX license lines in comment block. 2018-02-18 22:50:37 +00:00
daintree-sna.h Fix comment end after SPDX identifier 2018-05-01 06:56:37 +00:00
dbs-etherwatch.c Put the FILE_T first in the arguments to parse_dbs_etherwatch_packet(). 2018-10-01 00:58:11 +00:00
dbs-etherwatch.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
dct3trace.c Fix comment end after SPDX identifier 2018-05-01 06:56:37 +00:00
dct3trace.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
dpa400.c Remove unnecessary clearing of *err. 2018-09-30 19:41:34 +00:00
dpa400.h wiretap: DPA-400 logfile support 2018-05-10 22:33:24 +00:00
erf.c Relax ERF heuristic 2018-07-31 04:32:17 +00:00
erf.h Use common indenting space in heading 2018-05-01 06:55:55 +00:00
eyesdn.c Rename the pseudo-header for X.25, V.120, and Frame Relay. 2018-09-26 00:15:26 +00:00
eyesdn.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
file_access.c Make systemd journal entries events. 2018-09-26 21:31:13 +00:00
file_wrappers.c wiretap: Add a file_gets variant that returns a pointer to the NUL terminator 2018-05-07 06:44:24 +00:00
file_wrappers.h wiretap: Add a file_gets variant that returns a pointer to the NUL terminator 2018-05-07 06:44:24 +00:00
hcidump.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
hcidump.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
i4b_trace.h spdx: more licenses converted. 2018-03-09 04:50:23 +00:00
i4btrace.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
i4btrace.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
ipfix.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
ipfix.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
iptrace.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
iptrace.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
iseries.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
iseries.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
json.c json: fix typo. 2018-05-21 09:31:55 +00:00
json.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
k12.c Use proper unsigned constant for bit shift 2018-06-04 09:18:26 +00:00
k12.h Fix comment end after SPDX identifier 2018-05-01 06:56:37 +00:00
k12text.l Fix comment end after SPDX identifier 2018-05-01 06:56:37 +00:00
lanalyzer.c Get rid of TestBigEndian and AC_C_BIGENDIAN. 2018-03-13 19:09:36 +00:00
lanalyzer.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
libpcap.c Get rid of unused flag argument. 2018-09-25 23:20:39 +00:00
libpcap.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
logcat.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
logcat.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
logcat_text.c Always explicitly set tm_isdst before calling mktime(). 2018-05-09 16:33:21 +00:00
logcat_text.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
merge.c Add support for reading and writing the new if_hardware IDB option. 2018-08-11 02:09:15 +00:00
merge.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
mime_file.c Eliminate some unneeded header checks. 2018-05-16 22:03:09 +00:00
mime_file.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
mp2t.c Eliminate some unneeded header checks. 2018-05-16 22:03:09 +00:00
mp2t.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
mpeg.c Eliminate some unneeded header checks. 2018-05-16 22:03:09 +00:00
mpeg.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
mplog.c Fix some source headers, reformat SPDX license lines in comment block. 2018-02-18 22:50:37 +00:00
mplog.h Fix some source headers, reformat SPDX license lines in comment block. 2018-02-18 22:50:37 +00:00
netmon.c Declare lead_surrogate only in the block where it's used. 2018-06-22 07:44:58 +00:00
netmon.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
netscaler.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
netscaler.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
netscreen.c netscreen.c: fix compilation with gcc 8 2018-05-02 17:52:03 +00:00
netscreen.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
nettl.c Fix some source headers, reformat SPDX license lines in comment block. 2018-02-18 22:50:37 +00:00
nettl.h Fix some source headers, reformat SPDX license lines in comment block. 2018-02-18 22:50:37 +00:00
nettrace_3gpp_32_423.c nettrace: Improve error printout at parse error. 2018-09-24 13:39:03 +00:00
nettrace_3gpp_32_423.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
network_instruments.c wiretap: remove redundant ws_buffer_assure_space 2018-09-29 17:20:25 +00:00
network_instruments.h spdx: more licenses converted. 2018-03-09 04:50:23 +00:00
netxray.c Rename the pseudo-header for X.25, V.120, and Frame Relay. 2018-09-26 00:15:26 +00:00
netxray.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
ngsniffer.c Rename the pseudo-header for X.25, V.120, and Frame Relay. 2018-09-26 00:15:26 +00:00
ngsniffer.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
packetlogger.c Fix some source headers, reformat SPDX license lines in comment block. 2018-02-18 22:50:37 +00:00
packetlogger.h Fix comment end after SPDX identifier 2018-05-01 06:56:37 +00:00
pcap-common.c Make the ERF code in pcap_get_phdr_size() more like the reading code. 2018-09-26 20:05:09 +00:00
pcap-common.h Get rid of unused flag argument. 2018-09-25 23:20:39 +00:00
pcap-encap.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
pcapng.c pcapng: Fix a buffer length. 2018-10-01 18:16:15 +00:00
pcapng.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
pcapng_module.h Make systemd journal entries events. 2018-09-26 21:31:13 +00:00
peekclassic.c Fix some source headers, reformat SPDX license lines in comment block. 2018-02-18 22:50:37 +00:00
peekclassic.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
peektagged.c Fix some source headers, reformat SPDX license lines in comment block. 2018-02-18 22:50:37 +00:00
peektagged.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
pppdump.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
pppdump.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
radcom.c Rename the pseudo-header for X.25, V.120, and Frame Relay. 2018-09-26 00:15:26 +00:00
radcom.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
rfc7468.c "It's not a valid text line" means "it's not an RFC 7468 file", not "it's bad". 2018-08-09 10:04:56 +00:00
rfc7468.h RFC 7468 is PEM-inspired, but it's not PEM. 2018-08-01 07:02:34 +00:00
ruby_marshal.c wiretap: add support for ruby marshal object files. 2018-06-07 04:54:49 +00:00
ruby_marshal.h wiretap: add support for ruby marshal object files. 2018-06-07 04:54:49 +00:00
snoop.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
snoop.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
stanag4607.c Small cleanup of the sequential read routine. 2018-09-30 19:06:09 +00:00
stanag4607.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
systemd_journal.c Make systemd journal entries events. 2018-09-26 21:31:13 +00:00
systemd_journal.h Add a systemd Journal Export Format parser and dissector. 2018-08-31 05:20:27 +00:00
tnef.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
tnef.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
toshiba.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
toshiba.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
visual.c Rename the pseudo-header for X.25, V.120, and Frame Relay. 2018-09-26 00:15:26 +00:00
visual.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
vms.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
vms.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
vwr.c Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
vwr.h replace SPDX identifier GPL-2.0+ with GPL-2.0-or-later. 2018-02-08 14:57:36 +00:00
wtap-int.h Generalize wtap_pkthdr into a structure for packet and non-packet records. 2018-02-09 00:29:51 +00:00
wtap.c wtap: fix regression in wtap_read_packet_bytes 2018-10-01 10:55:55 +00:00
wtap.h Make systemd journal entries events. 2018-09-26 21:31:13 +00:00
wtap_opttypes.c Add support for reading and writing the new if_hardware IDB option. 2018-08-11 02:09:15 +00:00
wtap_opttypes.h Add support for reading and writing the new if_hardware IDB option. 2018-08-11 02:09:15 +00:00

README

NOTE: this documents the original intent behind libwiretap.  Currently,
it is being developed solely as a library for reading capture files,
rather than packet capture.  The list of file formats is also
out-of-date.

Wiretap is a library that is being developed as a future replacement for
libpcap, the current standard Unix library for packet capturing. Libpcap
is great in that it is very platform independent and has a wonderful
BPF optimizing engine. But it has some shortcomings as well. These
shortcomings came to a head during the development of Wireshark
(http://www.wireshark.org/), a packet analyzer. As such, I began developing
wiretap so that:

1. The library can easily be amended with new packet filtering objects.
Libpcap is very TCP/IP-oriented. I want to filter on IPX objects, SNA objects,
etc. I also want any decent programmer to be able to add new filters to the
library.

2. The library can read file formats from many packet-capturing utilities.
Libpcap only reads Libpcap files.

3. The library can capture on more than one network interface at a time, and
save this trace in one file.

4. Network names can be resolved immediately after a trace and saved in the
trace file. That way, I can ship a trace of my firewall-protected network to a
colleague, and he'll see the proper hostnames for the IP addresses in the
packet capture, even though he doesn't have access to the DNS server behind my
LAN's firewall.

5. I want to look into the possibility of compressing packet data when saved
to a file, like Sniffer.

6. The packet-filter can be optimized for the host OS. Not all OSes have BPF;
SunOS has NIT and Solaris has DLPI, which both use the CMU/Stanford
packet-filter pseudomachine. RMON has another type of packet-filter syntax
which we could support.

Wiretap is very good at reading many file formats, as per #2
above. Wiretap has no filter capability at present; it currently doesn't
support packet capture, so it wouldn't be useful there, and filtering
when reading a capture file is done by Wireshark, using a more powerful
filtering mechanism than that provided by BPF.


File Formats
============

Libpcap
-------
The "libpcap" file format was determined by reading the "libpcap" code;
wiretap reads the "libpcap" file format with its own code, rather than
using the "libpcap" library's code to read it.

Sniffer (compressed and uncompressed)
-------
The uncompressed Sniffer format is documented in the Sniffer manual.
Unfortunately, Sniffer manuals tend to document only the format for
the Sniffer model they document. Token-Ring and ethernet seems to work
well, though.  If you have an ATM Sniffer file, both Guy and Gilbert
would be *very* interested in receiving a sample. (see 'AUTHORS' file
for our e-mail addresses).

LANalyzer
---------
The LANalyzer format is available from http://www.novell.com. Search
their knowledge base for "Trace File Format".

Network Monitor
---------------
Microsoft's Network Monitor file format is supported, at least under
Ethernet and token-ring. If you have capture files of other datalink
types, please send them to Guy.

"snoop"
-------
The Solaris 2.x "snoop" program's format is documented in RFC 1761.

"iptrace"
---------
This is the capture program that comes with AIX 3.x and 4.x.  AIX 3 uses
the iptrace 1.0 file format, while AIX4 uses iptrace 2.0.  iptrace has
an undocumented, yet very simple, file format.  The interesting thing
about iptrace is that it will record packets coming in from all network
interfaces; a single iptrace file can contain multiple datalink types.

Sniffer Basic (NetXRay)/Windows Sniffer Pro
-------------------------------------------
Network Associates' Sniffer Basic (formerly NetXRay from Cinco Networks)
file format is now supported, at least for Ethernet and token-ring. 
Network Associates' Windows Sniffer Pro appears to use a variant of that
format; it's supported to the same extent.

RADCOM WAN/LAN Analyzers
------------------------
Olivier Abad has added code to read Ethernet and LAPB captures from
RADCOM WAN/LAN Analyzers (see http://www.radcom-inc.com/).

Lucent/Ascend access products
-----------------------------
Gerald

HP-UX nettl
-----------
nettl is used on HP-UX to trace various streams based subsystems.  Wiretap
can read nettl files containing IP frames (NS_LS_IP subsystem) and LAPB
frames (SX25L2 subsystem). It has been tested with files generated on
HP-UX 9.04 and 10.20.
Use the following commands to generate a trace :
# IP capture. 0x30000000 means PDU in and PDU out :
nettl -tn 0x30000000 -e NS_LS_IP -f tracefile
# X25 capture. You must specify an interface :
nettl -tn 0x30000000 -e SX25l2 -d /dev/x25_0 -f tracefile
# stop capture. subsystem is NS_LS_IP or SX25L2 :
nettl -tf -e subsystem

One may be able to specify "-tn pduin pduout" rather than
"-tn 0x30000000"; the nettl man page for HP-UX 10.30 implies that it
should work.

There is also basic support for nettl files containing NS_LS_DRIVER, 
NS_LS_TCP, NS_LS_UDP, NS_LS_LOOPBACK, unknown type 0xb9, and NS_LS_ICMP.
However, NS_LS_ICMP will not be decoded since WTAP lacks a raw ICMP 
encapsulation type.


Toshiba ISDN Router
-------------------
An under-documented command that the router supports in a telnet session
is "snoop" (not related to the Solaris "snoop" command). If you give
it the "dump" option (either by letting "snoop" query you for its next
argument, or typing "snoop dump" on the command line), you'll get a hex
dump of all packets across the router (except of your own telnet session
-- good thinking Toshiba!). You can select a certain channel to sniff
(LAN, B1, B2, D), but the default is all channels.  You save this hex
dump to disk with 'script' or by 'telnet | tee'. Wiretap will read the
ASCII hex dump and convert it to binary data.

ISDN4BSD "i4btrace" utility
---------------------------
Bert Driehuis

Cisco Secure Intrusion Detection System iplogging facility
-----------------------------------------------------------
Mike Hall

pppd logs (pppdump-format files)
--------------------------------
Gilbert

VMS TCPTRACE
------------
Compaq VMS's TCPIPTRACE format is supported.  This is the capture program
that comes with TCP/IP or UCX as supplied by Compaq or Digital Equipment
Corporation.

Under UCX 4.x, it is invoked as TCPIPTRACE.  Under TCPIP 5.x, it is invoked
as TCPTRACE.

TCPTRACE produces an ascii text based format, that has changed slightly over
time.

DBS Etherwatch (text format)
----------------------------
Text output from DBS Etherwatch is supported.  DBS Etherwatch is available
from: http://www.users.bigpond.com/dbsneddon/software.htm.

Catapult DCT2000 (.out files)
-----------------------------
DCT2000 test systems produce ascii text-based .out files for ports
that have logging enabled. When being read, the data part of the message is
prefixed with a short header that provides some context (context+port,
direction, original timestamp, etc).

You can choose to suppress the reading of non-standard protocols
(i.e. messages between layers rather than the well-known link-level protocols
usually found on board ports).


Gilbert Ramirez <gram@alumni.rice.edu>
Guy Harris <guy@alum.mit.edu>

STANAG 4607
-----------
Initial support for the STANAG 4607 protocol.  Documentation at:
http://www.nato.int/structur/AC/224/standard/4607/4607.htm