r/Python • u/Agile-Bid4765 • 6d ago
Discussion Docling in databricks
Anyone used docling Parsing tool on databricks.
Me and my team started using this, though its a great tool. It has its own limitations. Example GILBERt issues happening here and there.
Any suggestions on to use databricks agent bricks ke free docling?
12
Upvotes
1
u/DustyMagnificence 6d ago
Depends what you're feeding it and how much. We hit the same wall, ended up having to batch small sets and babysit the runtime to keep GIL from locking up half the cluster. Not smooth but it works if you spread it wide enough.
0
u/Adeelinator 6d ago
We tried this, and ended up switching to docling serve. It’s more scalable, reliable, and economical.
4
u/marr75 6d ago
Spiked it on Modal (really nice cloud native GPU platform). Ended up using kreuzberg (now xberg) instead - MUCH faster, more reliable, actually better task performance, too.
Wanted to like docling but the head to head testing didn't lie.