r/rstats

Kreuzberg v4.7.0 is here. Kreuzberg is a Rust-core document intelligence library that works with Python, TypeScript/Node.js, Go, Ruby, Java, C#, PHP, Elixir, R, C, and WASM. 

We’ve added several features, integrated OpenWEBUI, and made a big improvement in quality across all formats. There is also a new markdown rendering layer and new HTML output, which we now support. And much more (which you can find in our the release notes).

The main highlight is code intelligence and extraction. Kreuzberg now supports 248 formats through our tree-sitter-language-pack library. This is a step toward making Kreuzberg an engine for agents too. You can efficiently parse code, allowing direct integration as a library for agents and via MCP. Agents work with code repositories, review pull requests, index codebases, and analyze source files. Kreuzberg now extracts functions, classes, imports, exports, symbols, and docstrings at the AST level, with code chunking that respects scope boundaries. 

Regarding markdown quality, poor document extraction can lead to further issues down the pipeline. We created a benchmark harness using Structural F1 and Text F1 scoring across over 350 documents and 23 formats, then optimized based on that. LaTeX improved from 0% to 100% SF1. XLSX increased from 30% to 100%. PDF table SF1 went from 15.5% to 53.7%. All 23 formats are now at over 80% SF1. The output pipelines receive is now structurally correct by default. 

Kreuzberg is now available as a document extraction backend for OpenWebUI (by popular request!), with options for docling-serve compatibility or direct connection.

In this release, we’ve added unified architecture where every extractor creates a standard typed document representation. We also included TOON wire format, which is a compact document encoding that reduces LLM prompt token usage by 30 to 50%, semantic chunk labeling, JSON output, strict configuration validation, and improved security. GitHub: https://github.com/kreuzberg-dev/kreuzberg. 

And- Kreuzberg Cloud out soon, this will be the hosted version is for teams that want the same extraction quality without managing infrastructure. more here: https://kreuzberg.dev

Contributions are always very welcome

INTERACTIVE PLOT: https://ikashnitsky.phd/x/d3/05-experimental.html
Tools: R, d3, perplexity
Data: Our World in Data
R code: https://github.com/ikashnitsky/30daychart2026/blob/main/src/05-experimental.r
Perplexity chat: https://www.perplexity.ai/search/day-5-experimental-for-today-i-ldYZ2qw3Q3qBmwhhF902CQ

A few weeks ago I shared (https://github.com/nbafrank/uvr), a fast R package and project manager written in Rust. The response was great with a lot of specific, actionable feedback. I've been focused on implementing features based on what you asked for. Here's what's new.

R companion package — use uvr without touching the terminal

This was the #1 request (thanks u/BothSinger886). Many R users — especially scientists — live in the console, not the terminal. Now you can manage your entire project from R:

# install.packages("pak") 
pak::pak("nbafrank/uvr-r")
library(uvr) 
uvr::init() 
uvr::add("tidyverse") 
uvr::add("DESeq2", bioc = TRUE) 
uvr::sync()

Every uvr command has an R equivalent: `init()`, `add()`, `remove_pkgs()`, `sync()`, `lock()`, `run()`. If the CLI binary isn't installed, it prompts you to install it automatically. No terminal required.

Positron just works (Rstudio is wip)

`uvr init` and `uvr sync` now generate a `.Rprofile` that sets up the project library path automatically. Open your project in Positron and it picks up the right library — no configuration needed.

For Positron, uvr also writes `.vscode/settings.json` with the project's R interpreter path, so the correct R version appears in the IDE without manual setup.

Smarter error handling

- Typo protection`uvr add tidyvese` (typo) used to write the bad name to your manifest before failing resolution. Now the manifest rolls back automatically on failure — your `uvr.toml` stays clean.

- 4-component versions Packages like `data.table` (version `1.18.2.1`) now resolve correctly against version constraints. This was a subtle semver edge case that broke real workflows.

`uvr run --with` for one-off dependencies

Like `uv run --with` in Python. Need a package for a quick script without adding it to your project?

uvr run --with gt script.R

The package is installed to a temporary cache and available only for that run.

What's next

- Windows support— compiles and runs on Windows now, full testing in progress

- DESCRIPTION file support — use `DESCRIPTION` as an alternative manifest alongside `uvr.toml`

- Continued benchmarking and hardening

The full feature set: R version management, CRAN + Bioconductor + GitHub packages, P3M pre-built binaries, lockfile, dependency tree, `uvr doctor`, `uvr export` (to renv.lock), `uvr import` (from renv.lock), shell completions, self-update, and more.

Install in one line:

curl -fsSL https://raw.githubusercontent.com/nbafrank/uvr/main/install.sh | sh

Or from R:

pak::pak("nbafrank/uvr-r")
uvr::install_uvr()

GitHub: https://github.com/nbafrank/uvr

R package: https://github.com/nbafrank/uvr-r

Happy to answer questions. Your feedback last time shaped all of this — keep it coming.

Please try this out and test it yourself. I am using Positron for all of this and it's been going well. RStudio integration seems a bit more complex to me but if anyone wants to help please do

Kreuzberg v4.7.0 is here. Kreuzberg is an open-source Rust-core document intelligence library with bindings for Python, TypeScript/Node.js, Go, Ruby, Java, C#, PHP, Elixir, R, C, and WASM. 

We’ve added several features, integrated OpenWEBUI, and made a big improvement in quality across all formats. There is also a new markdown rendering layer and new HTML output, which we now support. And many other fixes and features (find them in our the release notes).

The main highlight is code intelligence and extraction. Kreuzberg now supports 248 formats through our tree-sitter-language-pack library. This is a step toward making Kreuzberg an engine for agents. You can efficiently parse code, allowing direct integration as a library for agents and via MCP. AI agents work with code repositories, review pull requests, index codebases, and analyze source files. Kreuzberg now extracts functions, classes, imports, exports, symbols, and docstrings at the AST level, with code chunking that respects scope boundaries. 

Regarding markdown quality, poor document extraction can lead to further issues down the pipeline. We created a benchmark harness using Structural F1 and Text F1 scoring across over 350 documents and 23 formats, then optimized based on that. LaTeX improved from 0% to 100% SF1. XLSX increased from 30% to 100%. PDF table SF1 went from 15.5% to 53.7%. All 23 formats are now at over 80% SF1. The output pipelines receive is now structurally correct by default. 

Kreuzberg is now available as a document extraction backend for OpenWebUI, with options for docling-serve compatibility or direct connection. This was one of the most requested integrations, and it’s finally here. 

In this release, we’ve added unified architecture where every extractor creates a standard typed document representation. We also included TOON wire format, which is a compact document encoding that reduces LLM prompt token usage by 30 to 50%, semantic chunk labeling, JSON output, strict configuration validation, and improved security. GitHub: https://github.com/kreuzberg-dev/kreuzberg. 

Contributions are always very welcome!

https://kreuzberg.dev/