torspy

torspy is a robust Python package fortified with powerful algorithms, designed for seamless exploration of websites, including both normal and .onion sites via the Tor network. Its arsenal includes adept scraping of HTML from URLs, precise text localization within the acquired content, and proficient storage of findings. Moreover, torspy boasts formidable subdomain scanning capabilities, enabling thorough reconnaissance across diverse subdomains. Additionally, it excels at detecting hidden directories, further enhancing its efficacy in navigating and extracting valuable information from the web. torspy also features advanced content analysis, comprehensive link extraction, detailed service information retrieval, and efficient content downloading, making it an indispensable tool for web exploration and analysis.

Index

• Torspy: Issues and Solutions
• Command 01 How to view the HTML of a page on the Onion site
• Command 02 How to clone an entire page and save it to a file
• Command 03 How to move files into directory
• Command 04 To search for content
• Command 05 Search content and save file
• Command 06 Search content and save file -d path
• Command 07 directories
• Command 08 directories and file
• Command 09 subdomain
• Command 10 subdomain and file
• Command 11 analyzes
• Command 12 How to transfer the analyzed data to a file
• Command 13 downloads content from an onion site
• Command 14 finds links on an onion site
• Command 15 Command to convert all links into one file
• Command 16 gets service info of an onion site
• Command 17 help

Advantages

• torspy is easy to use

• Many hidden directories can be found using torspy

• Each request torspy makes for your purpose will be anonymous

• torspy can be used to extract required text or content from the website

• HTML files can be downloaded using torspy

• With torspy you can search for the files you need

• torspy is the leading package for dark web scraping.

• Finding links from onion sites

• Finding services from onion sites

• Download files from onion sites

• Analyzing onion sites

- torspy is the leading package for dark web scraping.

Disadvantages

• Since requests are made using the Tor network, this tool will run slowly

• The probability of finding hidden directories, subdomains and files is less than 20%

• Sometimes you have to wait some time for this tool to work

• Some processes may take time to complete

When using torspy tool you must use Tor otherwise it won't work : $ tor

Coding

• Python : Link
• Bash : Link

Installation

You can install torspy via pip:

pip install torspy

Usage

Command-Line Interface

torspy allows you to interact with .onion sites from the command line:

Command 01

• To display the content of a .onion site:

torspy http://example.onion

• When the above command is run, a request goes through the Tor network to that onion site, and then the HTML page of the onion site is displayed on your terminal.

command 02

• To save the displayed content to a file:

torspy http://example.onion -s file.html

• The -s flag indicates saving, and you can specify any file name.

• The above command transfers the entire HTML code that were printed on your terminal to another file

• Also you can change the name of file.html to any name of your choice

command 03

• How to move this file to a directory of your choice

torspy http://example.onion -s file.html -d /path/home/

• -d stands for directory

• Given after -d is your path and if you run the above command your file will move to the given path

command 04

• Search only the content you need from Onion sites

torspy http://example.onion --find “search query”

• If you enter the above command it will search only the content you need from the given onion site and print it.

• The command --find means to search

command 05

• • To search for specific text within the content and save the results to a file

torspy http://example.onion --find “search query” -s search_results.html

• If you enter the above command it will search for the content you need from the site you provided and then transfer all that content to another file.

command 06

• How to search for content and move it to another directory

torspy http://example.onion --find “important information” -s results.html -d /path/to/directory

• If you run the above command it will search for the content you need from the given onion site and then move it to a file and then move it to the directory you specified.

Message

• important Remember that when trying to find subdomains, as well as trying to find directories, the success rate is only 20%.
• Finding directories and subdomains for onion sites is more challenging than for regular websites because onion sites are part of the dark web, which is intentionally designed to be less accessible and more private.

command 07

• Command that finds the directories on the onion site

torspy http://example.onion --dir directories-list.txt

• This process may take some time

• If you run the command above it will search for directories from the onion sites you provided

• The command --dir stands for directories

• This command performs directories scanning on the .onion site using the list of directories provided in the directories-list.txt file.

command 08

• How to move all the lists of directories you got into another file

torspy http://example.onion --dir directories-list.txt -s output.txt

• If you run the above command all the directory lists you get will be moved to another file

• Also you can move this file to other directory or other path using -d command

command 09

• Command that finds subdomains in onion site

torspy http://example.onion --sub subdomain-list.txt

• This process may take some time

• If you run the command above it will search for subdomains from the onion sites you provided

• The command --sub stands for subdomains

• This command performs subdomains scanning on the .onion site using the list of subdomains provided in the subdomains-list.txt file.

command 10

• How to move all the lists of subdomains you got into another file

torspy http://example.onion --sub subdomain-list.txt -s output.txt

• If you run the above command all the subdomains lists you get will be moved to

• another file

• Also you can move this file to other directory or other path using -d command

command 11

• Command that analyzes content of an onion site

torspy http://example.onion --analyze

• If you run the command above it will analyze the content of the onion site you provided.
• The command –-analyze performs content analysis on the .onion site.

command 12

• How to transfer the analyzed data to a file

torspy http://example.onion --analyze -s file-name.html

• You can name the file whatever you want { chnage file-name.html }

command 13

• Command that downloads content from an onion site

torspy http://example.onion --download -s filename

• If you run the command above it will download the content of the onion site you provided and save it to the specified file.
• The command –-download performs content downloading.
• example : torspy http://example.onion –-download -s index.html , torspy http://example.onion –-download -s data.jpg
• The command -s specifies the file name to save the downloaded content.

command 14

• Command that finds links on an onion site

torspy http://example.onion --links

• If you run the command above it will find all links on the onion site you provided.
• The command –-links performs link extraction.

command 15

• Command to convert all links into one file

torspy http://example.onion --links -s file-link.txt

• After running the above command all the links will be changed to the file you have given

command 16

• Command that gets service info of an onion site

torspy http://example.onion --service

• If you run the command above it will retrieve service info of the onion site you provided.
• The command –-service performs service information retrieval.
• You can use -s to save

command 17

• For more information on available options, you can use the --help flag:

torspy --help

Using torspy in a Bash Script

• You can incorporate torspy into your Bash scripts for automated tasks. Here's an example script that fetches content from a list of .onion URLs and saves it to individual files:

#!/bin/bash

# List of .onion URLs
urls=("http://example1.onion" "http://example2.onion" "http://example3.onion")

# Loop through each URL
for url in "${urls[@]}"; do
    # Fetch content and save to a file
    torspy "$url" -s "${url##*/}.html"
done

Integrating torspy with Other Languages

Ruby

• You can call the torspy command-line tool from Ruby using the system method:

system("torspy http://example.onion -s output.html")

Python

• You can use the subprocess module to call torspy from a Python script:

import subprocess

subprocess.run(["torspy", "http://example.onion", "-s", "output.html"])

PHP

• You can use the shell_exec function to call torspy from PHP:

<?php
shell_exec("torspy http://example.onion -s output.html");
?>

Node.js

• You can use the child_process module to call torspy from Node.js:

const { exec } = require('child_process');

exec('torspy http://example.onion -s output.html', (error, stdout, stderr) => {
    if (error) {
        console.error(`Error: ${error.message}`);
        return;
    }
    if (stderr) {
        console.error(`Stderr: ${stderr}`);
        return;
    }
    console.log(`Output: ${stdout}`);
});

How torspy Works

torspy utilizes the following process to interact with .onion sites:

Checking Site Existence: It verifies if the .onion site exists and is reachable through the Tor network.

Fetching HTML Content: It retrieves the HTML content of the .onion site using Tor for anonymity.

Scraping and Searching: If specified, torspy searches for specific text within the content and extracts matching results.

Saving Results: Optionally, torspy allows you to save the retrieved content, either the entire HTML or the search results, to a file.

Contributing to torspy

If you're interested in contributing to torspy, you can:

• Report issues encountered while using torspy.
• Suggest new features or enhancements.
• Submit pull requests with improvements or fixes.

Thank You, TorSpy Users!

We at TorSpy are incredibly grateful for your support and trust in our cybersecurity tool. Your feedback and engagement drive us to continually improve and enhance our service. Together, we're making the digital world a safer place. Thank you for being a part of the TorSpy community!

Disclaimer

This tool is intended for ethical use only. The author is not responsible for any misuse or damage caused by this tool. Users are responsible for ensuring their activities comply with all relevant laws and regulations.