Hacker GitHub

← All repos

rspeer/python-ftfy

View on GitHub ↗ ★ 4,066 Python

Fixes mojibake and other glitches in Unicode text, after the fact.

14 mentions on Hacker News by 4 people: 2 stories, 12 comments · first 2013-09-10 · latest 2020-01-13

Mentions per year 14 mentions · busiest year 2015 (4)
20082026
AllStoriesComments NewestTopOldest
  1. This seems kind of philosophically similar to FTFY, https://github.com/LuminosoInsight/python-ftfy , except for CSV files instead of botched text strings.
    comment by etaioinshrdlu · 2020-01-13 · in CleverCSV: A Drop-In Replacement for Python's CSV Module
  2. ▲ 2
    Ftfy (Python) Fixes mojibake and other glitches in Unicode text, after the fact
    story by etaioinshrdlu · 2019-11-10 · 0 comments
  3. Maybe not what you remember, but maybe this helps? https://github.com/LuminosoInsight/python-ftfy/blob/master/R...
    comment by anon1253 · 2018-05-27 · in Ask HN: What interesting thought did you read on HN but couldn't find later?
  4. …don't have any control over your input; it's someone else's mistake, but it's your problem now. [1] https://github.com/LuminosoInsight/python-ftfy
    comment by rspeer · 2018-01-09 · in Ftfy – fix Unicode that's broken in various ways
  5. …of ftfy, and there won't be until JS can represent all Unicode characters without surrogates. [1] https://github.com/LuminosoInsight/python-ftfy
    comment by rspeer · 2016-12-27 · in Problems with CSVs
  6. ftfy (fixes text for you): https://github.com/LuminosoInsight/python-ftfy Auto-detects Unicode mistakes (particularly mojibake), and if there's enough information left to fix them, it fixes them. Particularly useful for Web scraping and…
    comment by rspeer · 2016-11-16 · in Ask HN: What simple tools or products are you most proud of making?
  7. …want a Python library that can do this automatically with an extremely low rate of false positives: https://github.com/LuminosoInsight/python-ftfy
    comment by rspeer · 2016-03-26 · in UTF-8 Encoding Debugging Chart
  8. …[1] to the language that gave us the word "mojibake". The ambiguous cases actually happen . [1] http://github.com/LuminosoInsight/python-ftfy Suppose you found this string (which someone actually tweeted) encoded in Shift-JIS: (|| * m…
    comment by rspeer · 2015-12-08 · in The "Bush hid the facts" bug
  9. …On the master branch, it's recently gained a module for aligning monospaced Unicode in a terminal: https://github.com/LuminosoInsight/python-ftfy/blob/master/f... The result works pretty well in my gnome-terminal and Mac OS Terminal. You…
    comment by rspeer · 2015-09-11 · in When monospace fonts aren't: The Unicode character width nightmare
  10. Automating this fix is precisely what I'm showing off. And yes, it's damn useful for web scraping. https://github.com/LuminosoInsight/python-ftfy
    comment by rspeer · 2015-05-28 · in The WTF-8 encoding
  11. …and outputs good Unicode. [langcodes]: https://github.com/LuminosoInsight/langcodes [python-ftfy]: https://github.com/LuminosoInsight/python-ftfy
    comment by rspeer · 2015-04-24 · in Ask HN: Brag about open-source projects you're proud of
  12. ▲ 101
    Python-ftfy: Given Unicode text, make its representation possibly less broken
    story by rspeer · 2014-08-16 · 40 comments
  13. …you're just going to run into that sort of thing. In python, that's why projects like this exist: https://github.com/LuminosoInsight/python-ftfy They let you correct Unicode content that was decoded with the wrong encoding.
    comment by pudquick · 2014-03-11 · in Python web scraping
  14. …use them until 3.3 because narrow builds will quietly replace them with nonsense that doesn't run ( https://github.com/LuminosoInsight/python-ftfy/commit/86aa65... ). And the very reason this came up was in a workaround for a different bug…
    comment by rspeer · 2013-09-10 · in Node's Unicode Dragon