u/AnshMNSoni

I grew up as a curious kid who used to break toys just to understand how they worked.

Then slowly life became:
marks,
rankings,
JEE,
competition,
pressure,
internships,
comparison,
and constantly trying to prove myself.

Somewhere during JEE prep, I randomly asked myself:

And honestly, that question never left me.

I wrote a blog about growing up, parental sacrifices, fake internships, engineering life, self-doubt, and slowly learning to compete with myself instead of others.

Not trying to sound motivational or inspirational — just honest.

Maybe someone here will relate to it.

Read Full Blog 👇

21 Years of Becoming Myself https://medium.com/@anshsoni702/21-years-of-becoming-myself-0c68c53d9be1

Thankyou.

Instead of building a traditional search engine with indexed data, I tried something different:

👉 Fetch data live from APIs and distribute processing

So I built this system:

Gateway fetches data from Wikipedia and Stack Overflow
Splits content into chunks
Sends chunks to multiple worker nodes
Nodes process data in parallel
Gateway aggregates results

Stack:

FastAPI
Docker
Async requests (httpx, asyncio)

Challenges I faced:

Handling async failures
Node communication issues
Aggregating partial results
Debugging distributed behavior

Now I’m working on:

Scaling beyond a single machine
Dynamic node discovery
Better ranking

Visit GitHub: https://github.com/AnshMNSoni/Disee.git

Curious:

👉 Would you index this data instead, or keep it real-time?

Thankyou.

Distributed Search Engine

I turn 21, and instead of celebrating achievements, I ended up reflecting on my entire journey.