lwthiker/curl-impersonate on Hacker News

There are projects that do this already e.g. https://github.com/lwthiker/curl-impersonate

comment by ycombinatrix · 2026-10-12 · in Fingerprints are the new cookies

…fingerprint as chrome or firefox. There's also CylceTLS[1] for a more programmatic approach. [0]: https://github.com/lwthiker/curl-impersonate [1]: https://github.com/Danny-Dasilva/CycleTLS

comment by psanford · 2026-08-18 · in Show HN: A local MitM proxy to control TLS fingerprints

…now. At best they identify the family of browser, and spoofing it is table stakes for bad actors. https://github.com/lwthiker/curl-impersonate

comment by mike_d · 2025-11-22 · in The privacy nightmare of browser fingerprinting

…I'm curious if people are actually getting by running old versions for production use cases. [1] https://github.com/lwthiker/curl-impersonate

comment by supriyo-biswas · 2025-11-09 · in Show HN: I built an HTTP client that perfectly mimics Chrome 142

…| md5sum e114898baa410d15f0ff7f9f85cbcd9d - I'm aware of curl-impersonate https://github.com/lwthiker/curl-impersonate which works around these kinds of things (and makes working with cloudflare much nicer), but serious scrapers use

comment by geocar · 2025-10-03 · in How I block all 26M of your curl requests

Try this then: https://github.com/lwthiker/curl-impersonate

comment by Trung0246 · 2025-08-05 · in Perplexity is using stealth, undeclared crawlers to evade no-crawl directives

There are tools like curl-impersonate: https://github.com/lwthiker/curl-impersonate out there that allow you to pretend to be any browser you like. Might take a bit of trial and error, but this mechanism could be bypassed with some…

comment by EPendragon · 2025-07-17 · in I was wrong about robots.txt

▲ 545

Curl-impersonate: Special build of curl that can impersonate the major browsers

story by mmh0000 · 2025-04-03 · 155 comments

Curl-impersonate does this https://github.com/lwthiker/curl-impersonate

comment by ghxst · 2025-02-06 · in Tell HN: Cloudflare is blocking Pale Moon and other non-mainstream browsers

…succeed) to imitate the TLS handshake (and settings for HTTP/2) of a normal browser, though. [1] https://github.com/lwthiker/curl-impersonate

comment by schroeding · 2025-02-05 · in Tell HN: Cloudflare is blocking Pale Moon and other non-mainstream browsers

…execution of JS using DOM stuff would be a much more effective deterrent to prevent scraping. [1] https://github.com/lwthiker/curl-impersonate

comment by supriyo-biswas · 2025-01-18 · in Google begins requiring JavaScript for Google Search

It says "Firefox(In progress)", and the original project this was forked from has it: https://github.com/lwthiker/curl-impersonate

comment by crtasm · 2024-12-31 · in Curl-Impersonate

https://github.com/lwthiker/curl-impersonate

comment by barbolo · 2024-11-30 · in Breaking the 4Chan CAPTCHA

…[0] for Cloudflare bot detection to stay out of my way. And then curl to alert me via Pushover. [0] https://github.com/lwthiker/curl-impersonate

comment by hunter2_ · 2024-08-30 · in The secret inside One Million Checkboxes

▲ 1

Show HN: Python-cronet – a Python wrapper for Chromium's network library

story by zlagen · 2024-04-03 · 0 comments

…triggers on things beyond the HTTP request, like the less fancy TLS handshake of regular curl) -- https://github.com/lwthiker/curl-impersonate * The user doesn't have curl installed, but has wget / lynx / some headless browser / etc. and…

comment by hunter2_ · 2024-04-02 · in About the Tailscale.com outage on March 7, 2024

> us[e] Akamai to block scraping Would https://github.com/lwthiker/curl-impersonate help? Haven’t tried with Akamai, but did help with another widely used CDN that shall remain unnamed (but has successfully infused me with burning hate for…

comment by mananaysiempre · 2024-03-27 · in Recent 'MFA Bombing' Attacks Targeting Apple Users

▲ 1

Curl-impersonate: Mimic real browsers' TLS handshake with curl

story by rane · 2023-09-08 · 0 comments

which is what https://github.com/lwthiker/curl-impersonate does: it's a special build of curl that can impersonate Chrome & Firefox

comment by homarp · 2023-08-27 · in Block YouTube ads on AppleTV by decrypting and stripping ads from Profobuf

Use this to evade it: https://github.com/lwthiker/curl-impersonate Greetings from a country whose (almost) entire IP space is blacklisted by Cloudflare!

comment by thegeomaster · 2023-08-27 · in Block YouTube ads on AppleTV by decrypting and stripping ads from Profobuf

…TLS handshake (like curl, scrapers, or even old browsers which by chance can do TLS 1.2). https://github.com/lwthiker/curl-impersonate

comment by foul · 2023-07-25 · in Apple already shipped attestation on the web, and we barely noticed

I haven’t seen a custom build of Wget, but for Curl there is curl-impersonate[1]. [1] https://github.com/lwthiker/curl-impersonate

comment by mananaysiempre · 2023-03-21 · in Web fingerprinting is worse than I thought

curl-impersonate https://github.com/lwthiker/curl-impersonate is great for avoiding TLS fingerprinting

comment by jonatron · 2023-01-07 · in Devirtualizing nike.com's bot protection

https://github.com/lwthiker/curl-impersonate might help.

comment by stevewatson301 · 2022-09-13 · in Planning Go 1.20 cryptography work

…Mouse in the article. That has been the case with yt-dlp and other video download utilities. [1] - https://github.com/lwthiker/curl-impersonate [2] - https://github.com/yt-dlp/yt-dlp

comment by LinuxBender · 2022-09-02 · in Curl’s TLS Fingerprint

…will often return some JS challenge and not the real content. curl-impersonate helps with that. [1] https://github.com/lwthiker/curl-impersonate

comment by lwthiker · 2022-08-10 · in Ask HN: What are the best tools for web scraping in 2022?

I think it's two-fold: rise of tools like curl-impersonate ( https://github.com/lwthiker/curl-impersonate ) and the very consistent Firefox TLS fingerprint across platforms. Unlike Chromium (where you could differentiate a Linux, Mac or…

comment by zinekeller · 2022-05-21 · in Firefox appears to be flagged as suspicious by Cloudflare

The first problem can be solved with curl-impersonate: https://github.com/lwthiker/curl-impersonate "A special compilation of curl that makes it impersonate Chrome & Firefox", and it now can also impersonate Edge and Safari. Previously…

comment by epitactic · 2022-03-11 · in How to use undocumented web APIs

This tool claims to replicate Firefox/Chrome's TLS handshake signature: https://github.com/lwthiker/curl-impersonate I haven't tried it, haven't really come across a service that blocks curl, but I'll be keeping an eye on it in case I need…

comment by abdusco · 2022-03-10 · in How to use undocumented web APIs

▲ 249

Show HN: Curl modified to impersonate Firefox and mimic its TLS handshake

story by lwthiker · 2022-02-17 · 57 comments