My Blog

Local RAG

I get interested in RAG since I implemented some slack bot for our internal support channel. I always want to fully understand what it is, especially what is "embedding". I found this video is probably the best resource for me to try something locally.

I end up with something similar to the video, a 100 line python file that implements the RAG, messy but works. And the "embedding" is just a mapping from words and sentences to a high dimension space (as vectors, or just points in that space). It is used for getting relevant documents, basically as a ranking algorithm. Essentially you can have a RAG without embeddings, any ranking algorithm will do. But embedding probably yields a good result? I don't know. I trust the IR guys to do their job.

What I really want is for the RAG to consume all my local epubs, so I can ask questions about these books. Maybe I can have a virtual author that talks to me, and teach me. That would be really fun.

Also, I was using gemini a lot for this task, can only recommend it.

Other articles

Why change something when it was working?

Published: Fri 23 February 2024
By lgylym

In Daily Logs.

I noticed that in my team when I came back from a long leave. Suddenly things are working differently, and the reason seems to be because we have a new manager (thus new management style).

I guess one need to have it in their own ways. But why?

It is …
read more
The Next Big Thing?

Published: Sun 04 February 2024
By lgylym

In Daily Logs.

tags: ideas

Due to recent layoffs, I start to think about what would I want to do if I get hit. I'm thinking in the line of data systems.

I always want to have something that myself want to use, and right now it is my distrust to SAAS products. So my …
read more
Game PC?

Published: Fri 02 February 2024
By lgylym

In Daily Logs.

Somehow I want to have a game PC now. Not that I have any time nor do I really play games. Is this midlife crisis?

I did spend quite some time on games 20 years ago. Maybe it is just how I want to relive the old times.

BTW, seems …
read more
Pelican build without content
Published: Thu 01 February 2024
By lgylym

In Daily Logs.

Turns out I have to let pelican support markdown explicitly by
```
python -m pip install "pelican[markdown]"
```
Per the doc that I don't read (of course).
read more
Hello World

Published: Wed 31 January 2024
By lgylym

In Daily Logs.

It is time to find a permanent place for everything I have.
read more

Other articles

links

social