CrawlHawk

1. The Operator

Effective date: 31 May 2026 | Last updated: 31 May 2026

These Terms and Conditions (the "Terms") govern access to and use of the CrawlHawk service (the "Service") available at crawlhawk.com, operated by New Horizon Platforms Kft. (the "Operator", "we", "us", "our"). By creating an account, accessing or using the Service, you ("you", "User") agree to these Terms.

New Horizon Platforms Kft.

Registered office: Hullám utca 8. 1. em. 10. ajtó, 6721 Szeged, Hungary

Company registration number: 06-09-029974 (Court of Registry of the Szeged Tribunal)

EU VAT number: HU32654488

Email: support@crawlhawk.com

Full operator details are available in our Legal Notice.

2. What CrawlHawk Is — and What It Is Not

CrawlHawk IS:

  • a web-based crawling and link-discovery service that processes publicly accessible web pages on User instruction;
  • an XML sitemap generator;
  • an AI-assisted product data extraction tool for publicly accessible product pages;
  • a credit-based software service where one-time credit purchases unlock processing capacity;
  • a software-as-a-service tool that returns structured results (URLs, links, sitemaps, extracted data) to the User for download.

CrawlHawk IS NOT, AND DOES NOT ACT AS:

  • a marketplace, store or e-commerce platform;
  • a broker, agent, intermediary or facilitator between Users;
  • a content publisher of any third-party website or page that a User chooses to crawl;
  • a verifier, certifier or guarantor of the lawfulness, accuracy, completeness or rights status of any content available on third-party websites;
  • a circumvention tool for technical access controls, paywalls, login walls, anti-bot protections or rights-protection measures deployed in violation of applicable law;
  • a service that grants the User any right in or to the content available on third-party websites — the User remains solely responsible for ensuring that any crawl, extraction or downstream use is authorised and lawful.

The User chooses the targets, the User bears responsibility. CrawlHawk processes URLs that the User instructs it to process. The Operator does not select, endorse, vet or warrant any third-party website that a User chooses to crawl, nor any data extracted from such a website.

EU regulatory classification. The exclusions above describe the Operator's commercial role. They do not affect the classification of the Service — where applicable — as a "hosting service" within the meaning of Article 3(g) of the Digital Services Act, to the extent it stores User-submitted requests and crawl results on behalf of the User. CrawlHawk does not generally make User-submitted Crawl Results available to the public, and does not by virtue of its hosting role qualify as an "online platform" within the meaning of Article 3(i) of the Digital Services Act. If the Service later offers optional features that enable Users to share Crawl Results publicly, such features may be subject to additional terms and may be assessed separately under applicable hosting, online platform or other intermediary service rules. The Operator's compliance with the DSA does not transform the Service into a publisher of third-party content.

3. Definitions

  • "Account" means a User account on the Service.
  • "Credits" means the units of processing capacity purchased by Users and used to perform crawls, sitemap generations, product extractions and other operations on the Service.
  • "Credit Pack" means a one-time purchase of a specified quantity of Credits.
  • "Crawl" means a single processing job submitted by the User, defined by a starting URL, a scope, optional filters and an output configuration.
  • "Crawl Results" means the structured output (URLs, links, status codes, files, images, AI-extracted product data, sitemaps and other artefacts) produced by a Crawl.
  • "Target Website" or "Target" means the third-party website, sub-domain, path or page that the User instructs the Service to process.
  • "Free Tier" means the free quota of processed URLs available to new Users without payment, as described on the Service.

4. Eligibility and Account Registration

You may register an Account if you are at least 18 years old, have full legal capacity, and either act for a business or are an individual entrepreneur acting in your business or professional capacity, or you are a consumer using the Service for your own lawful purposes.

By registering on behalf of a legal entity, you represent and warrant that you are authorised to bind that entity to these Terms.

You agree to:

  • provide accurate, current and complete information at registration;
  • keep your information up to date;
  • maintain the confidentiality of your login credentials (including API keys, where applicable);
  • be responsible for all activity that occurs under your Account, including all Crawls submitted and all Credits consumed;
  • notify us immediately at support@crawlhawk.com of any unauthorised access or suspected breach.

5. The Service — Functionality

5.1 Crawling and Link Discovery

The Service crawls publicly accessible web pages that the User specifies, within the scope chosen by the User (full domain, main domain, sub-domain, single path, single page), and identifies internal links, external links, broken links, orphan links, file links and image links. Results are returned as structured data for download.

5.2 XML Sitemap Generation

The Service generates XML sitemaps from crawled URLs for use with search engines or other purposes.

5.3 AI Product Scraper

The Service may use AI-assisted extraction to convert product pages into structured data. AI extraction depends on the structure and availability of content on the Target Website and is not warranted for accuracy, completeness, currency or fitness for any particular purpose. Pages with poorly structured data, dynamic loading patterns, anti-bot protections or non-standard layouts may produce partial, incomplete or empty results.

5.4 Advanced and Protected Processing

For Target Websites that require JavaScript rendering, browser execution or advanced anti-bot handling, the Service may invoke advanced processing modes. These modes may consume more Credits per processed URL and may rely on third-party infrastructure providers (such as Zyte). Advanced processing is offered as a technical capability to enable the Service to work with a wider range of websites; it is not a representation by the Operator that any particular Target Website may lawfully be crawled in this manner. The User is solely responsible for ensuring that such processing is authorised and lawful with respect to each Target.

5.5 Export Formats

Crawl Results may be exported in CSV, JSON, Excel, HTML, PDF and XML sitemap formats, depending on the type of result.

5.6 API Access

The Operator may offer programmatic API access to the Service. Where available, API access is subject to these Terms, to any additional API-specific terms and rate limits published by the Operator, and to the same Credit-consumption logic as the web interface.

5.7 Contact Data Extraction (where available)

The Service may offer features that extract contact information displayed on Target Websites, such as company-level email addresses, telephone numbers, postal addresses and contact page URLs. Where such extracted information includes personal data of identified or identifiable natural persons (for example, the name, position, direct email address or direct telephone number of an individual), the following applies: by running such an extraction, the User expressly represents and warrants that the User has a valid and documented lawful basis under Article 6 GDPR (such as the consent of the persons concerned or a properly assessed legitimate interest) for the collection and processing of the personal data of the natural persons appearing on the crawled Target Website; that the User will comply with its information obligations under Articles 13 and 14 GDPR towards the persons concerned; and that the User will honour the rights of the data subjects under Chapter III GDPR. The User acts as data controller in respect of such personal data, as set out in Section 12 of the Privacy Policy and in the Data Processing Agreement. The Operator may suspend, restrict or refuse extractions that it reasonably believes to involve unlawful processing of personal data, in accordance with the Acceptable Use Policy.

5.8 Changes to Service Features

The Operator continuously develops the Service and may add, modify, suspend or discontinue individual features, processing modes, export formats or integrations at any time. Material feature removals will be communicated through the Service where reasonably practicable. Changes to features do not affect the validity of Credits already purchased: purchased Credits remain usable for the features available on the Service at the time of use, and the commitments in Sections 7.1, 7.2 and 7.3 (no recurring subscription, Credits never expire, all features included) are not affected by this Section.

6. User Responsibility for Crawl Targets

This Section is a fundamental term of these Terms and applies to every Crawl submitted to the Service.

By submitting a URL or a Crawl configuration, you represent and warrant that:

  • you have the legal right and authority to instruct an automated system to access, retrieve, process, copy, store and analyse the content of the Target Website for the purposes of your Crawl;
  • your Crawl does not violate the terms of service, robots exclusion protocol (robots.txt), automated-access policies or other access conditions of the Target Website, unless you have explicit written authorisation from the Target Website operator to disregard them;
  • your Crawl does not circumvent any technical access control, paywall, login wall, IP block, CAPTCHA or rights-protection measure in a manner prohibited by applicable law;
  • your Crawl complies with all applicable laws, including but not limited to laws on computer misuse, unauthorised access, intellectual property, database rights (including the sui generis database right under Directive 96/9/EC), trade secrets, personal data protection (including the GDPR) and unfair competition;
  • where the Crawl is directed at content protected by copyright, related rights or database rights, you have a lawful basis for the intended use (such as a licence, a statutory exception including the text-and-data mining exceptions under Articles 3 and 4 of Directive (EU) 2019/790, or other applicable law);
  • your Crawl is not designed or used to overload, disrupt, damage or impair the operation of any Target Website, server or network.

You acknowledge that the Operator does not vet Target Websites. The Operator has no practical means to verify your authority to crawl any given Target. The fact that the Service technically permits a Crawl is not a representation that the Crawl is lawful or authorised. Responsibility for that determination rests with you.

7. Credits, Free Tier and Pricing

7.1 Credit-Based Model

The Service operates on a one-time Credit Pack model. There is no recurring subscription. You purchase a Credit Pack of a chosen size, and Credits are consumed as you use the Service. As a general rule, one Credit equals one processed URL, although certain advanced processing modes (such as JavaScript rendering, protected-website handling or AI Product Scraper extraction) may consume additional Credits per processed URL, as indicated in the Service.

7.2 Credits Never Expire

Credits remaining in your Account do not expire and remain available for use until consumed, subject to the operation of the Service and to these Terms. Termination of the Account for breach of these Terms or the Acceptable Use Policy may result in forfeiture of unused Credits as set out in Section 13.

7.3 All Features Included

Every Credit Pack unlocks access to all Service features, including crawling, sitemap generation, AI Product Scraper, export formats and (where available) API access. Specific advanced operations may consume additional Credits.

7.4 Free Tier

New Users may receive a Free Tier quota of processed URLs at no cost, as described on the Service. The Free Tier is offered for the purpose of allowing Users to evaluate the Service. The Operator reserves the right to limit, change or discontinue the Free Tier at any time. Use of the Free Tier is subject to these Terms and to the Acceptable Use Policy in the same manner as paid use.

7.5 Pricing and Currency

Credit Pack prices are displayed on the Service in EUR, USD or other supported currencies, and, unless explicitly indicated otherwise, are exclusive of value added tax (VAT). VAT is applied in accordance with applicable Hungarian and EU law. For valid B2B customers established in another EU Member State, the EU reverse charge mechanism may apply where the customer provides a valid EU VAT number.

8. Payment, Invoicing and Taxes

Payments for Credit Packs are processed by Stripe Payments Europe, Limited ("Stripe"). The Operator does not store full payment card data; payment processing is governed by Stripe's own terms and privacy policy.

The Operator issues an electronic invoice for every payment in accordance with Hungarian accounting and tax law. Invoices are issued in the Operator's name through Billingo Technologies Zrt. as our e-invoicing service provider, and are reported to the Hungarian Tax Authority (NAV) Online Számla system as required by law. Invoices are made available in your Account and/or sent to the email address associated with your Account.

If a payment fails or is reversed (including chargebacks), the Operator may reverse the corresponding Credit allocation, suspend access to the Account, or take other appropriate action.

9. Crawl Results — Storage, Ownership and Use

Storage. Crawl Results are stored on the Service for up to 90 days following completion of the Crawl, after which they are deleted. The Operator may extend or shorten this period for technical, security or legal reasons. Users are encouraged to download Crawl Results promptly.

Ownership and rights. As between you and the Operator, the User retains such rights as the User has in the Crawl Results. However, Crawl Results commonly consist of, reproduce, or describe third-party content, and the User's rights in the Crawl Results are limited by the rights of those third parties. Nothing in these Terms grants you any right in or to the content of any Target Website. You are solely responsible for ensuring that your collection, retention, copying, modification, distribution, publication or other use of Crawl Results complies with applicable law and with the rights of third parties.

Licence to the Operator. You grant the Operator a worldwide, non-exclusive, royalty-free licence to host, store, process, transmit and deliver the Crawl Results to you and (where you instruct) to your designated downstream destinations, solely as necessary to provide the Service to you. The Operator may retain technical metadata and aggregated, anonymised statistics about Crawl operations indefinitely for purposes of service improvement, security and abuse prevention.

10. Acceptable Use

Use of the Service is subject to our Acceptable Use Policy, which is incorporated into these Terms by reference. The Acceptable Use Policy is a fundamental term of these Terms. Violation of the Acceptable Use Policy may result in action under Section 13 below, including suspension or termination of the Account and forfeiture of unused Credits in cases of serious or repeated breach.

11. Operator's Intellectual Property

The Service, including its software, design, layout, graphics, logos and the "CrawlHawk" name and brand, are owned by or licensed to the Operator and are protected by intellectual property laws. Subject to your compliance with these Terms, you are granted a limited, non-exclusive, non-transferable, revocable licence to access and use the Service for its intended purpose.

You may not, without our prior written consent:

  • copy, modify, distribute, sell, rent or sub-license the Service or any part of it;
  • reverse engineer, decompile or disassemble any part of the Service;
  • use the Service to build a competing product or service;
  • use any robot, spider, scraper, crawler or other automated means to access, harvest or extract data from the Service itself (this restriction does not affect your authorised use of the Service to crawl third-party websites).

12. Privacy, Cookies and Notice and Action

The processing of personal data by the Operator is described in our Privacy Policy and Cookie Policy. By using the Service you acknowledge that you have read those policies.

In accordance with Article 16 of the DSA and Section 13 of the Ekertv., notices of allegedly illegal content available through the Service may be submitted in accordance with our Copyright and IP Policy at support@crawlhawk.com.

Where the User causes the Service to process personal data of third parties (as described in Section 12 of the Privacy Policy), including through contact data extraction features, the Data Processing Agreement published on the Service applies to that processing between the User (as controller) and the Operator (as processor), and is incorporated into these Terms by reference.

13. Suspension, Restriction and Termination

The Operator may, at its reasonable discretion, suspend, restrict or terminate your access to the Service, in whole or in part, where:

  • you breach these Terms or the Acceptable Use Policy;
  • we are required to do so by law or by a binding order of a competent authority or court;
  • continued provision of the service would expose the Operator, other Users, Target Websites or third parties to legal, security, infrastructure, fraud or reputational risk;
  • your payment fails or is reversed and is not remedied within a reasonable time;
  • your activity overloads, disrupts or threatens to disrupt the Service or the infrastructure of any Target Website.

Where reasonably possible and not prohibited by law, we will give you prior notice and an opportunity to remedy the issue. Where the Account is terminated for serious or repeated breach of these Terms or the Acceptable Use Policy, unused Credits in the Account may be forfeited without refund. For consumer accounts, this is subject to mandatory consumer-protection rules. You may close your Account at any time through your Account settings or by contacting support@crawlhawk.com.

14. Disclaimers

To the fullest extent permitted by applicable law, the Service is provided "as is" and "as available" without warranties of any kind, whether express, implied or statutory, including any implied warranty of merchantability, fitness for a particular purpose or non-infringement. The Operator does not warrant that:

  • the Service will be uninterrupted, secure, error-free or that any defects will be corrected;
  • Crawl Results will be complete, accurate, up to date or representative of the Target Website at any given moment;
  • AI Product Scraper extractions will be correct, complete or fit for any particular purpose;
  • any particular Target Website will be reachable, crawlable or processable by the Service, now or in the future;
  • advanced or protected processing will succeed for any particular Target.

The Service depends on the availability and behaviour of third-party websites, which may change at any time without notice. The Operator has no control over Target Websites and accepts no responsibility for their content, availability, accuracy, completeness, lawfulness or behaviour.

15. Limitation of Liability

To the fullest extent permitted by applicable law, the Operator and its directors, officers, employees and agents shall not be liable for any indirect, incidental, special, consequential, exemplary or punitive damages, including but not limited to loss of profit, loss of revenue, loss of business, loss of goodwill, loss of data or business interruption, arising out of or in connection with your use of the Service, even if the Operator has been advised of the possibility of such damages.

The Operator's aggregate liability arising out of or in connection with these Terms or the Service shall not exceed the greater of (i) the total amount paid by you to the Operator in the twelve (12) months preceding the event giving rise to liability, or (ii) one hundred euros (EUR 100).

Nothing in these Terms excludes or limits the Operator's liability for death or personal injury caused by negligence, for fraud or fraudulent misrepresentation, or for any other liability that cannot be excluded or limited under applicable law. Where the User is a consumer, mandatory consumer-protection rights of the User's habitual residence are not affected.

16. Indemnification

You agree to indemnify, defend and hold harmless the Operator and its directors, officers, employees and agents from and against any claim, demand, loss, damage, cost or expense (including reasonable legal fees) arising from:

  • your use of the Service, including your choice of Target Websites and the configuration of your Crawls;
  • your breach of these Terms, the Acceptable Use Policy or applicable law;
  • any claim by an operator of a Target Website, a rights holder in respect of content available on a Target Website, or any other third party, arising from or relating to your Crawls or your use of Crawl Results;
  • any claim by a data subject in respect of personal data that you caused the Service to process.

17. Changes to These Terms

The Operator may modify these Terms from time to time. The Operator will provide advance notice of material changes by email and/or through the Service at least 15 days before the changes take effect, except where shorter notice is required by law or where changes are required to address an immediate security, legal or safety risk. If you do not agree to the modified Terms, you may terminate your Account before the effective date. Continued use of the Service after the effective date constitutes acceptance of the modified Terms.

18. Governing Law and Jurisdiction

These Terms are governed by the laws of Hungary, without regard to conflict-of-laws principles, and where applicable by directly applicable EU law. The UN Convention on Contracts for the International Sale of Goods does not apply.

Any dispute arising out of or in connection with these Terms shall be subject to the exclusive jurisdiction of the courts of Hungary having competence at the registered seat of the Operator. Where the User is a consumer, this jurisdiction clause does not deprive the consumer of the protection afforded by the mandatory rules of the consumer's habitual residence, and the consumer may bring proceedings in the courts of that Member State.

Consumer dispute resolution. Consumers may seek redress through the Csongrád-Csanád County Conciliation Board (6721 Szeged, Párizsi krt. 8-12., Hungary) or another competent ADR entity listed in the European Commission's Consumer Redress database. The previous EU Online Dispute Resolution Platform was discontinued as of 20 July 2025 by Regulation (EU) 2024/3228.

19. Miscellaneous

Severability. If any provision of these Terms is held invalid or unenforceable, the remaining provisions remain in full force and effect.

No waiver. Failure to enforce any right is not a waiver of that right.

Assignment. You may not assign these Terms without our prior written consent. The Operator may assign these Terms to any affiliate or in connection with a merger, acquisition or sale of assets.

Force majeure. Neither party shall be liable for any failure or delay in performance caused by events beyond its reasonable control.

Entire agreement. These Terms, together with the documents referenced herein (Acceptable Use Policy, Privacy Policy, Cookie Policy, Refund Policy, Disclaimer, Copyright and IP Policy), constitute the entire agreement between you and the Operator regarding the Service.

Language. These Terms are made available in English. Where translations are provided for convenience, the English version prevails in case of inconsistency, except where mandatory consumer law provides otherwise.

20. Contact

For any question regarding these Terms, please contact us at support@crawlhawk.com.