I thought this would mean I could use my subscription, as OpenAI/Codex supports this kind of authentication flow, and it's very easy to integrate with that as a service, and users login with the OpenAI authentication flow, or via device codes.
Instead this asks for an API key, which is very different from "Use your OpenAI subscription" and to be honest, I'm not sure how anyone who has a OpenAI subscription could mistake this for such. Has this even been tested once?
Maybe I missed something obvious, I had a five second look and closed it when it seemed to be outright intentionally misleading.
There are two parts to the processing. The processing of the document itself is done on your OpenAI/Codex subscription. Additionally, you have to submit an API key for the text-to-speech processing. There you can use a Gemini key or an OpenAI key.
I did something very similar to this, for myself, but which takes a web page for an article, cleans up the text to preserve the article only, and converts it using TTS, then adds it to a cloud bucket with an RSS stream, and I use that RSS link as a podcast in Apple Podcast.
Oh man. I did something similar but didn’t do the last mile with the cloud bucket and RSS stream and that seems key. I never have the energy to manually copy the mp3s over to the phone.
I did something similar and just put the files on an old laptop and used Tailscale. That gives me an https URL and Apple Podcasts downloads the files fine.
Very good. I have a listening experience close to elevenlabs. But sometimes you can get "failed" segments so you need to detect them and retry/repair automatically. One example is the fading volume.
I do similar things, just use ElevenLabs for tts - a good selection of voices.
A good protip - tell an agent to rewrite the article slightly for better listening flow. Some subtle changes in sentence structure etc can make listening way more pleasant.
“Never ever” is crazy talk. Just put a couple of dollars in a prepaid account and assume it may all get used up. “Standard practices” won’t get you far in life.
I consider "Create a throwaway" to be in line with the guideline posted above. It does violate it literally but not in spirit - the guideline is not to use an API key with the ability to draw unlimited or a very large amount of funds.
Why? It's easy and predictable. Generate a key with a spend cap plus short expiry and you're set. I much prefer that to having to fork over my email with an OAuth flow.
You can generate a specific API key, and make sure to monitor it by setting a budget limit to it.
They should explain this to people in their form to avoid people pasting their main key.
There was a guy who made a "has your SSH key been compromised? Paste your private key here" website as a joke, which lasted about a week until his low budget host killed it.
Claude has gotten pretty sensitive to copyright. In addition to the no song lyrics that was posted in another article, I also find it will not generally transcribe podcasts (you have to play with model versions and even effort inside that).
At home this is super easy, use one of the multiple TTS models out there and provide a clean clip of Morgan Freeman's voice. Typically around 10 seconds will do. I just run a python script to daily scan my FreshRSS sources, compile my news and generate a 'podcast' that's about 10 minutes for a morning listen. Currently using F5-TTS, but there are lot's of other models out there as well.
Thanks! Currently, I'm using Gemini TTS and Kokoro TTS as a free option. Kokoro is fast and I can run it on my own server, but I'm not using it as a standard yet because Gemini supports more languages and has more voices available. But text-to-speech processing is the biggest bottleneck at the moment.
I went the route of handling epub first (really, anything pandoc can convert to epub) on ebookaloud, and it took quite a few iterations to get consistent parsing across a wide corpus of test documents.
My experience is that gathering and testing with that corpus was about 30% of the overall effort. I have not yet gathered the motivation to tackle pdf: it’s more of a layout format than a text format. Not just tables but multi-column layouts and similar oddities leave a pile of imperfect heuristics in their wake.
Multi-lingual support is even worse. I was working with arabic script in pdf years ago and they don’t even capture the encoded text, just rendering instructions due to the high number of ligatures. I don’t know if things have improved since then.
It was always harder to get it to sound right, I had built Lissin around this thesis itself. You can throw in a PDF or a link and can get a podcast, deepdive or just narration with different voices in Lissin.
For those interested in better voices, you can try and let me know.
If someone sends me AI generated audio they're reccomending, I from then on out see them differently and not in a good way. I dont even want to read the outputs of an LLM let alone listen to them. Wild.
Let me guess, you can already build such a system yourself quite trivially by getting an FTP account, mounting it locally with curlftpfs and then use SVN or CVS on the mounted filesystem?
How well does it handle pronunciation, especially of things like proper nouns? This has been one of the harder parts I've found. On a financial web site I saw one example where the generated audio pronounced initiates as a noun instead of a verb. It's a subtle difference but can significantly change the meaning if worded wrong.
I was trying to use TTS to regenerate some old audiobooks and getting names pronounced correctly is pretty hard unless the model supports something like SSML.
I love using https://convert.to.it/ for all of my converting needs; everything is client-side in the browser with over 400 file extension options to choose from.
You'll have to read the license agreement for openAI or Google on their tts
Or look into open source tts models with liberal commercial licenses
Generally I'd stay away from the site/project/repo in the OP and just do your own research on this (because the OP site is vibe coded in a sleazy way that's unnecessarily used car salesman-y and doesn't offer anything you couldn't just do better yourself with one codex or chatgpt prompt)
Edit: to be clear there's a lot of different tts providers, they probably all offer tts you can use commercially, you can look at benchmarks for the providers and then the specific TOS
KeenLore is my emotive audiobook creator, which I've been working on for the past several months to help me narrate my sci-fi novel. Here's a slightly outdated demo video:
I've since added character ages (child to supercentenarian voices, consistent relative to their base adult voice), crowd chants (2 to 100 people works flawlessly), case sensitivity for character aliases (to help detect quotation attributions), custom phonetics, and English speaking characters can have a variety of accents applied. Will soon have Chatterbox driving the novel's narration. Screenshot:
embedding-shape | 11 hours ago
I thought this would mean I could use my subscription, as OpenAI/Codex supports this kind of authentication flow, and it's very easy to integrate with that as a service, and users login with the OpenAI authentication flow, or via device codes.
Instead this asks for an API key, which is very different from "Use your OpenAI subscription" and to be honest, I'm not sure how anyone who has a OpenAI subscription could mistake this for such. Has this even been tested once?
Maybe I missed something obvious, I had a five second look and closed it when it seemed to be outright intentionally misleading.
wastewastewaste | 11 hours ago
edit: i guess this explains it, its sorta half half
Your subscription will be used for:
Your API key will be used for:[OP] janpmz | 11 hours ago
scrollop | 9 hours ago
Much less interesting.
kaoD | 3 hours ago
xenocratus | 11 hours ago
_ink_ | 11 hours ago
robot_jesus | 11 hours ago
[OP] janpmz | 11 hours ago
exe34 | 10 hours ago
cj00 | 9 hours ago
umeshunni | 4 hours ago
brumar | 10 hours ago
aaroninsf | 5 hours ago
brumar | an hour ago
sebzim4500 | 10 hours ago
kingforaday | 9 hours ago
kolinko | 10 hours ago
A good protip - tell an agent to rewrite the article slightly for better listening flow. Some subtle changes in sentence structure etc can make listening way more pleasant.
sgallant | 9 hours ago
BeetleB | 9 hours ago
https://blog.nawaz.org/posts/2024/Apr/reading-articles-via-p...
I use the TTS on Google Cloud. It's effectively free.
FrinkleFrankle | 3 hours ago
x______________ | 11 hours ago
draugadrotten | 10 hours ago
For example, these audiobook generators runs fully offline. https://github.com/Finrandojin/alexandria-audiobook https://github.com/senigami/audiobook-studio.pinokio https://github.com/topics/audiobook-generator
fnord77 | 10 hours ago
xnorswap | 9 hours ago
That should be everybody!
There are standard practices for delegating responsibility, never ever be pasting API keys into websites.
throwaway_19sz | 9 hours ago
munk-a | 5 hours ago
14u2c | 4 hours ago
yohannparis | 8 hours ago
walrus01 | 8 hours ago
https://www.reddit.com/media?url=https%3A%2F%2Fi.redd.it%2Fx...
1vuio0pswjnm7 | 6 hours ago
Send me your data and I will check and see if anyone else has it
Now I have your data but that doesn't count
Onavo | 6 hours ago
simianwords | 5 hours ago
AndrewKemendo | 4 hours ago
laylower | 11 hours ago
springtimesun | 11 hours ago
KellyCriterion | 11 hours ago
AbsurdCensor | 11 hours ago
properbrew | 10 hours ago
Thanks for listing the model you're using, I've not really done any TTS stuff and this sounds like a fun thing to spin up.
jaccola | 11 hours ago
matthorse | 11 hours ago
I'd love to see an actual result what it can do
brunorsini | 11 hours ago
[OP] janpmz | 11 hours ago
Via MCP more voices are available (all OpenAI and Gemini voices, depending on which api key you use).
brunorsini | 10 hours ago
kubrickslair | 8 hours ago
ph4rsikal | 11 hours ago
[OP] janpmz | 11 hours ago
abel0x | 10 hours ago
[OP] janpmz | 10 hours ago
abel0x | 10 hours ago
flatline | 8 hours ago
My experience is that gathering and testing with that corpus was about 30% of the overall effort. I have not yet gathered the motivation to tackle pdf: it’s more of a layout format than a text format. Not just tables but multi-column layouts and similar oddities leave a pile of imperfect heuristics in their wake.
Multi-lingual support is even worse. I was working with arabic script in pdf years ago and they don’t even capture the encoded text, just rendering instructions due to the high number of ligatures. I don’t know if things have improved since then.
amaldavid | 9 hours ago
For those interested in better voices, you can try and let me know.
https://apps.apple.com/app/apple-store/id6758897526?pt=12810...
lifeisloving | 9 hours ago
BeetleB | 9 hours ago
lifeisloving | 8 hours ago
tupac_speedrap | 6 hours ago
wing-_-nuts | 7 hours ago
exolab | 9 hours ago
therepanic | 9 hours ago
[OP] janpmz | 9 hours ago
malfist | 9 hours ago
https://news.ycombinator.com/item?id=9224
satvikpendem | 9 hours ago
hirako2000 | 9 hours ago
For a wrapper around costly LLM providers.
For a result one could get with voicebox for free.
cj00 | 8 hours ago
I was trying to use TTS to regenerate some old audiobooks and getting names pronounced correctly is pretty hard unless the model supports something like SSML.
subless | 8 hours ago
Source: https://github.com/p2r3/convert
MadameMinty | 7 hours ago
55555 | 8 hours ago
[OP] janpmz | 8 hours ago
https://pdftomp3.com/published/player.html?publication_id=6a...
butz | 7 hours ago
sureMan6 | 7 hours ago
Or look into open source tts models with liberal commercial licenses
Generally I'd stay away from the site/project/repo in the OP and just do your own research on this (because the OP site is vibe coded in a sleazy way that's unnecessarily used car salesman-y and doesn't offer anything you couldn't just do better yourself with one codex or chatgpt prompt)
Edit: to be clear there's a lot of different tts providers, they probably all offer tts you can use commercially, you can look at benchmarks for the providers and then the specific TOS
remix2000 | 7 hours ago
trencedamp | 6 hours ago
Kwpolska | 5 hours ago
[OP] janpmz | 4 hours ago
https://youtu.be/1qiH_SeDyyc
mandeepj | 3 hours ago
GrayHerring | 2 hours ago
thangalin | 2 hours ago
https://www.youtube.com/watch?v=WAeHgE94rVo
I've since added character ages (child to supercentenarian voices, consistent relative to their base adult voice), crowd chants (2 to 100 people works flawlessly), case sensitivity for character aliases (to help detect quotation attributions), custom phonetics, and English speaking characters can have a variety of accents applied. Will soon have Chatterbox driving the novel's narration. Screenshot:
https://i.ibb.co/GffgfnCL/narrating.png
It's self-hosted, fully local, based on software having permissive licenses and open weights. Runs on a lowly 8GB NVIDIA T1000 (and 96 GB of RAM).
m4rtink | an hour ago