AutoGadgetFS - USB Testing Made Easy - Hacking Land

What’s AutoGadgetFS ?

AutoGadgetFS is an open source framework that allows users to assess USB devices and their associated hosts/drivers/software without an in-depth knowledge of the USB protocol. The tool is written in Python3 and utilizes RabbitMQ and WiFi access to enable researchers to conduct remote USB security assessments from anywhere around the globe. By leveraging ConfigFS, AutoGadgetFS allows users to clone and emulate devices quickly, eliminating the need to dig deep into the details of each implementation. The framework also allows users to create their own fuzzers on top of it.

Requirments:

Host machine running Linux (Debian/Ubuntu/Kali)
Raspberry Pi Zero with WIFI support
Target machine options:
- Virtual Machine
- Standalone machine
2 x USB micro cables
Target USB device
Hardware debugger ( Optional )

The Setup:

Device testing only:

Minimal agfs in the middle setup:

Complete agfs in the middle setup with debugging support:

USB Device class support:

USB HID Devices fully supported (Man in the middle)

Device only testing .. All USB devices (NO Man in the middle)

Future releases... All USB devices (Man in the middle)

Capabilities:

Find, Select and Attach to a USB device with ease.

Emulate any USB HID device .

Perform AGFS in the middle sniffing for HID devices ( save communication to disk ).

Device sniffing ( Any device ).

Multiple Fuzzers allow you to Fuzz a device or a host.

Random fuzzers ( with fixed or random length packets ).

Smart Fuzzers that learn from previous USB communications.

Describe Fuzzer to tell the Fuzzer which bytes to Fuzz leaving the rest of the packet the same.

Gadget Fuzzer.

Sequential Fuzzer.

Control transfer Enumerator.

Replay of packets from a file.

Replay of packets from a saved USBLyzer capture.

Visual way of presenting packets to allow ease of reverse engineering of the communication.
Alerts for device in DFU mode, or if the device leaks information.
USB device and host can be anywhere on the internet.
Monitor sudden interface changes.

RoadMap:

Sniff control transfer requests to a device and reply to them.
MITM and emulate all types of devices.
Console/QT based interface.
More Interfaces/endpoints support on the RPI zero W.
Support more boards like the greatfet.
Move to a custom board.
Work on making raspberry pi have full support for usb device emulation with all interfaces.
correlate sent and received packets via sequence numbers.

Installation:

Linux Machine:

Note: WSL/WSL2 is not supported due to issues with USB pass-through.

Install Python3, ipython3 ,git, pip and rabbitMQ server

sudo apt install python3 ipython3 git python3-pip rabbitmq-server dfu-utilsudo service rabbitmq-server start

Clone the repository

git clone https://github.com/ehabhussein/AutoGadgetFScd AutoGadgetFS

Install the requirements

sudo -H pip3 install -r requirements.txt

Downgrade prompt toolkit for better ipython experience:

sudo python3 -m pip install prompt-toolkit~=2.0

Enable the web interface for rabbitMQ

sudo rabbitmq-plugins enable rabbitmq_managementhttp://localhost:15672/ to reach the web interface

login to the web interface with the credentials guest:guest
- NOTE: if you are not installing rabbitMQ on localhost add the following user and login with it:
```
sudo rabbitmqctl add_user autogfs usb4eversudo rabbitmqctl set_user_tags autogfs administrator
```
- Upload the rabbitMQ configuration file
  - In the overview tab scroll to the bottom to import definitions
  - Upload the file found in: rabbitMQbrokerconfig/rabbitmq-Config.json
```
sudo service rabbitmq-server restart
```

Test the installation

sudo ipython3Python 3.7.7 (default, Apr  1 2020, 13:48:52)Type 'copyright', 'credits' or 'license' for more informationIPython 7.9.0 -- An enhanced Interactive Python. Type '?' for help.In [1]: import libagfsIn [2]: x = libagfs.agfs()***************************************AutoGadgetFS: USB testing made easy***************************************Enter IP address of the rabbitmq server: 127.0.0.1In [3]: exitsudo `python3` agfsconsole.py***************************************AutoGadgetFS: USB testing made easy***************************************Enter IP address of the rabbitmq server: 127.0.0.1Give your project a name?!:

Patch Pyusb langID ( Not needed unless you get pyusb errors for langID ):
- Edit the file /usr/local/lib/python3/dist-packages/usb/util.py
  - make changes to the def get_string method to look like below:
```
if 0 == len(langids):    return "Error Reading langID"    #raise ValueError("The device has no langid")if langid is None:    langid = langids[0]elif langid not in langids:    return "Error Reading langID"    #raise ValueError("The device does not support the specified langid")
```
  - If you prefer to use patch apply the following patch to the file: AutoGadgetFS/pyusb_patches/pyusb_langid.patch

Raspberry Pi Zero W:

Obtain a copy of Raspian Lite Edition
- Burn the Image to the SD card using BalenaEtcher
Mount the SD card on your machine and make the following changes:
- In the /path/to/sdcard/boot/config.txt file add to the very end of the file:
```
enable_uart=1dtoverlay=dwc2
```
- In the /path/to/sdcard/boot/cmdline.txt add right after rootwait
```
modules-load=dwc2
```
- it should look like this make sure its on the same line:
```
console=serial0,115200 console=tty1 root=PARTUUID=6c586e13-02 rootfstype=ext4 elevator=deadline fsck.repair=yes rootwait modules-load=dwc2
```
Enable ssh:
- in the /path/to/sdcard/boot directory create an empty file name ssh:
```
sudo touch /path/to/sdcard/boot/ssh
```

Enable Wifi:

in the /path/to/sdcard/boot directory create an file named wpa_supplicant.conf:
```
sudo vim /path/to/sdcard/boot/wpa_supplicant.conf
```

Add the following contents:

ctrl_interface=DIR=/var/run/wpa_supplicant GROUP=netdevupdate_config=1country=USnetwork={            ssid="<your wifi SSID>"            psk="<your wifi password>"            key_mgmt=WPA-PSK         }

Unmount the SD card and place it back into the Raspberry Pi Zero and power it on.

Copy the content of AutogadgetFS/Pizero/ to the Pi zero: username: pi & password: raspberry

cd AutogadgetFS/Pizero/scp gadgetfuzzer.py removegadget.sh requirements.txt router.py [email protected]<pi-ipaddress>:/home/pi

SSH into the PI Zero and setup requirements for AutoGadgetFS:

ssh [email protected]<pi-ip-address>chmod +x removegadget.shsudo apt updatesudo apt install python3 python3-pipsudo -H pip3 install -r requirements.txt

Upgrading the latest kernel and adding modules (* This step is optional for the current release): ( This will take a very long time compiling on the Pi Zero, unless you choose to cross compile the kernel see Compiling options)

sudo bashapt install git bc bison flex libssl-dev make libncurses5-dev screenscreenmkdir Downloadscd Downloads/git clone --depth=1 https://github.com/raspberrypi/linuxcd linux/make bcmrpi_defconfigmake menuconfig

Enable the Modules and save the config:

Build and use the kernel:

make zImage modules dtbsmake modules_installcp arch/arm/boot/dts/*.dtb /boot/cp arch/arm/boot/dts/overlays/*.dtb* /boot/overlays/cp arch/arm/boot/dts/overlays/README /boot/overlays/cp arch/arm/boot/zImage /boot/kernel.imgreboot

And you're done!

AutoGadgetFS tutorial:

Click to visit the tutorial

Screenshots:

Man in the Middle:

USB device fuzzing:

Host side fuzzing with code covereage:

Fuzzer based on a selection of bytes:

Smart fuzzer based on learning traffic:

In [44]: x.devSmartFuzz(engine="smart",samples=5,filename="/home/raindrop/PycharmProjects/AutoGadgetFs/binariesdb/Nud-Nuvoton-1046-20764-1590421333.5169587-Nuvoton-1046-20764-1590421600.8067    ...: 274-device.bin")                                                                                                                                                                     [+]General StatisticsFull charset                : !"#$%&'()*+,-./0123456789:;<=>[email protected][\]^_`abcdefghijklmnopqrstuvwxyz{|}~Discarded charset           : !"#$%&'()*+,-./:;<=>[email protected][\]^_`ghijklmnopqrstuvwxyz{|}~Final charset               : 0123456789abcdefWord Length                 : 128Lower Case index usage      : 92%Lower Case index locations  : [1, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37,    38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 121, 122, 124, 125, 127]Upper Case index usage      : 0%Upper Case index locations  : []Digit index usage           : 96%Digit index locations       : [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 12   3, 126]NonAN index usage           : 0%NonAN index locations       : []Counter statistics          : Uppercase: 0 , Lowercase: 133071, Digits:212017 , NonAlphaNumeric:0All char Frequencies        : character:5 found:5012 timescharacter:2 found:22563 timescharacter:3 found:12197 timescharacter:8 found:15008 timescharacter:4 found:13275 timescharacter:0 found:98056 timescharacter:1 found:17861 timescharacter:f found:87823 timescharacter:d found:7221 timescharacter:7 found:9614 timescharacter:a found:11148 timescharacter:6 found:10472 timescharacter:b found:8189 timescharacter:9 found:7959 timescharacter:c found:9172 timescharacter:e found:9518 times***********************generated:5 Packets***********************Out[44]: ['5608305852bf2ffd61770e2c827542f20be0b0fcba09db916bd07e1734b04cb0352b1d278068064d19f033bfad6fa90e53d865693fd4fee0214f00000eb0aa2c', '3b08   3595f276e2f1353a535c32f0f59516fc9328f7673bb80262c4da11c93683afe6dcff8a7a83018d78f41498a0da4d141ebd39c361b1724f2b00000eb0aa2c', '0120961963495c4dab9470738b497eddde07b0d70b357795ad9554d7964761969a6d997205e17eada6fa84eb33dcfb11412f75e04c195001283900000eb0aa2c', '091065d52127bbc6e840e02f8e1316f1c4d9c92a23931c00cdbb8c158368852ef8fabd461b98812b51ec84e1ccc5c04aaa366fbafabec623bd3500000eb0aa2c', '7300cc61151b7af27a578e766f49bebb2de68c48b37a00df1030ae464f456928eedd035303e697208bf58217af728a2a346fda5c8aef0335b82e00000eb0aa2c'In [46]: x.edap.packets                                                                                                                                                                       Out[46]: ['5608305852bf2ffd61770e2c827542f20be0b0fcba09db916bd07e1734b04cb0352b1d278068064d19f033bfad6fa90e53d865693fd4fee0214f00000eb0aa2c', '3b083595f276e2f1353a535c32f0f59516fc9328f7673bb80262c4da11c93683afe6dcff8a7a83018d78f41498a0da4d141ebd3   9c361b1724f2b00000eb0aa2c', '0120961963495c4dab9470738b497eddde07b0d70b357795ad9554d7964761969a6d997205e17eada6fa84eb33dcfb11412f75e04c195001283900000eb0aa2c', '091065d52127bbc6e840e02f8e1316f1c4d9c92a23931c00cdbb8c158368852ef8fabd461b98812b51ec84e1ccc5c04aaa366fbafabec623bd3500000eb0aa2c', '7300cc61151b7af27a578e766f49bebb2de68c48b37a00df1030ae464f456928eedd035303e697208bf58217af728a2a346fda5c8aef0335b82e00000eb0aa2c']

Help method:

In [15]: x.help("")                                                                                                                                               Currently supported methods:__________________________________________________________________________________________________________________________________________________________________Method               ||-->Description----------------------------------------------------------------------------------------------------------------------------MITMproxy            ||-->This method creates a connection to the RabbitMQ and listen on received messages on the todev queue____________________________________________________________________________________________________________________________MITMproxyRQueues     ||-->This method reads from the queue todev and sends the request to the device its self.________________________________________________________   ____________________________________________________________________SmartFuzz            ||-->This method is generates packets based on what it has learned from a sniff from either the host or the device____________________________________________________________________________________________________________________________chgIntrfs            ||-->This method allows you to change and select another interface____________________________________________________________________________________________________________________________clearqueues          ||-->this method clears all the queues on the rabbitMQ queues that are set up____________________________________________________________________________________________________________________________clonedev             ||-->This method does not need any parameters it only saves a backup of the device incase you need to share it or use it later._____________________________________   _______________________________________________________________________________________createctrltrsnfDB    ||-->creates a SQLite database containing values that were enumerated from control transfer enumeration____________________________________________________________________________________________________________________________createdb             ||-->create the sqlite table and columns from usblyzer captures____________________________________________________________________________________________________________________________decodePacketAscii    ||-->This method decodes packet bytes back to Ascii____________________________________________________________________________________________________________________________describeFuzz         ||-->This method allows you to describe a packet and select which bytes will be fuzzed___________________________________________________________________________________________________   _________________________devEnumCtrltrnsf     ||-->This method enumerates all possible combinations of a control transfer request____________________________________________________________________________________________________________________________devReset             ||-->This method Resets the device____________________________________________________________________________________________________________________________devWrite             ||-->To use this with a method you would write to a device make sure to run the startSniffReadThread(self,endpoint=None, pts=None, queue=None,channel=None)____________________________________________________________________________________________________________________________devctrltrnsf         ||-->This method allows you to send ctrl transfer requests to the target device_________________________________________________________________________________________________________________   ___________deviceInfo           ||-->gets the complete info only for any usb connected to the host____________________________________________________________________________________________________________________________deviceInterfaces     ||-->get all interfaces and endpoints on the device____________________________________________________________________________________________________________________________devrandfuzz          ||-->this method allows you to create fixed or random size packets created using urandom____________________________________________________________________________________________________________________________devseqfuzz           ||-->This method allows you to create sequential incremented packets and send them to the device____________________________________________________________________________________________________________________________findSelect           ||-->This method enumera   tes all USB devices connected and allows you to select it as a target device as well as its endpoints____________________________________________________________________________________________________________________________help                 ||-->AutogadgetFS Help method____________________________________________________________________________________________________________________________hostwrite            ||-->This method writes packets to the host either targeting a software or a driver in control of the device____________________________________________________________________________________________________________________________hstrandfuzz          ||-->this method allows you to create fixed or random size packets created using urandom and send them to the host queue____________________________________________________________________________________________________________________________monInterfaceChng     ||-->Me   thod in charge of monitoring interfaces for changes this is called from def startMonInterfaceChng(self)____________________________________________________________________________________________________________________________newProject           ||-->creates a new project name if you were testing something else____________________________________________________________________________________________________________________________releasedev           ||-->releases the device and re-attaches the kernel driver____________________________________________________________________________________________________________________________removeGadget         ||-->This method removes the gadget from the raspberryPI____________________________________________________________________________________________________________________________replaymsgs           ||-->This method searches the USBLyzer parsed database and give you the option rep   lay a message or all messages from host to device____________________________________________________________________________________________________________________________searchmsgs           ||-->This method allows you to search and select all messages for a pattern which were saved from a USBlyzer database creation____________________________________________________________________________________________________________________________setupGadgetFS        ||-->setup variables for gadgetFS : Linux Only, on Raspberry Pi Zero best option____________________________________________________________________________________________________________________________showMessage          ||-->shows messages if error or warn or info____________________________________________________________________________________________________________________________sniffdevice          ||-->read the communication between the device to hosts______   ______________________________________________________________________________________________________________________startMITMusbWifi     ||-->Starts a thread to monitor the USB target Device____________________________________________________________________________________________________________________________startMonInterfaceChng||-->This method Allows you to monitor a device every 10 seconds in case it suddenly changes its interface configuration.____________________________________________________________________________________________________________________________startQueuewrite      ||-->initiates a connection to the queue to communicate with the host____________________________________________________________________________________________________________________________startSniffReadThread ||-->This is a thread to continuously read the replies from the device and dependent on what you pass to the method either pts or que   ue____________________________________________________________________________________________________________________________stopMITMusbWifi      ||-->Stops the man in the middle thread between the host and the device____________________________________________________________________________________________________________________________stopMonInterfaceChang||-->Stops the interface monitor thread____________________________________________________________________________________________________________________________stopQueuewrite       ||-->stop the thread incharge of communicating with the host machine____________________________________________________________________________________________________________________________stopSniffing         ||-->Kills the sniffing thread strted by startSniffReadThread()____________________________________________________________________________________________________________________________usblyzerparse        ||-->This method will parse your xml exported from usblyzer and then import them into a database____________________________________________________________________________________________________________________________In [16]: x.help("findSelect")                                                                                                                                                                 ****[+]Help for findSelect Method:[-]Signature: findSelect(self, chgint=None)[+]findSelect Help:This method enumerates all USB devices connected and allows you to select it as a target device as well as its endpoints****

AutoGadgetFS console. A much simpler way to use AGFS: