OpenSpider · Beta

Try OpenSpider 1.0

The OpenSpider 1.0 beta is open to SEO freelancers, in-house teams and agencies. It is free, and the source code is on GitHub under the Apache 2.0 licence. Try the crawler on your own websites and tell us what works and what does not.

Installers on GitHub ↗Send feedback

Download and install

All installers are on the GitHub releases page ↗. The latest version is at the top. Under “Assets”, pick the file for your system:

macOS 13 or later: the universal DMG (file name ends in _universal.dmg) runs on Apple silicon and Intel. Open the DMG and drag OpenSpider to the Applications folder.
Windows 10 (1809 or later) or 11, x64: the setup EXE (_x64-setup.exe) installs for your user account without administrator rights. The MSI package (.msi) installs for all accounts on the computer and requires administrator rights. Windows on ARM uses the x64 installer under emulation.
Linux: core and command line only, as an archive (_linux-x86_64.tar.gz); no desktop app.

The download page explains how to check the files against SHA256SUMS.

First launch

macOS: the app is signed and notarized by Apple. When you open it for the first time, macOS asks once whether you want to open an app downloaded from the internet. Confirm if the source shown is your download from GitHub.

Windows: the installers are signed. Because the signing certificate is new, Microsoft Defender SmartScreen may still warn at first. Click “More info”, check the publisher shown and choose “Run anyway”. See the user guide for details.

Before you start

Beta software: back up important crawls before you update the app. File → “Save crawl as…” creates a copy of the crawl file.

During the beta, OpenSpider updates itself through its built-in update function: at startup the app checks for a new beta at most once a day and installs it only after you confirm. To check manually, use Help → “Check for updates”. You do not need to download new versions yourself.

Four test tasks

These four workflows help us most. Feel free to try anything else as well.

Crawl your own website, ideally one with 10,000 URLs or more.
Pause the running crawl and resume it.
Export results, for example a table or a report.
Quit the app, start it again and reopen the crawl (File → “Recently opened”).

Send feedback

Bugs, ideas, praise: all feedback helps. The form sends your input straight to our own server, without third parties. In the app, Help → “Send feedback…” opens this page with your version number. Please do not enter customer data or other people’s personal data; you can leave out client domains.

Please describe your feedback (5,000 characters at most).

The email address is not valid. Leave the field empty if you do not want follow-up questions.

Some entries were not valid. Please choose a system and type and check the version (64 characters at most).

The feedback is too large. Please shorten the text and send it again.

Several submissions came from your connection within the last hour. Please try again later.

Your feedback could not be stored right now. Please try again later.

System (required)

OpenSpider version

Shown in the app under Help → “About OpenSpider”, for example 1.0.0-beta.1.

Type of feedback

Bug Idea Praise Other

Description (required)

5,000 characters at most. For a bug: what did you do, what happened, what did you expect?

What did you test? (optional)

For example the approximate number of URLs, crawl mode or export format. 1,000 characters at most.

Email for follow-up questions (optional)

Only if we may reply to you about your feedback.

I consent to OpenSpider storing and evaluating my input to improve the software and, if I provide an email address, contacting me with follow-up questions. I can withdraw my consent at any time. Details in the privacy policy. (required)

Technical users can also report bugs and ideas directly as a GitHub issue ↗ (public, so without customer data). Contributions via pull request are welcome, see CONTRIBUTING.md ↗.

Update privacy during the beta

Betas are normal GitHub releases until 1.0, with latest.json and latest-beta.json. There is no UI channel selector. Automatic checks send only version, operating system and architecture; no user identifier or crawl data, and no telemetry. GitHub sees the IP address required for the connection. Checks can be disabled in Settings → Updates or with OPENSPIDER_DISABLE_UPDATE_CHECK=1. The CLI and scheduled runs never check automatically. See update behavior and privacy. The privacy policy explains what happens to the information you enter in the form.