Liftoff

.gitignore

@@ -0,0 +1,160 @@
+# Byte-compiled / optimized / DLL files
+__pycache__/
+*.py[cod]
+*$py.class
+
+# C extensions
+*.so
+
+# Distribution / packaging
+.Python
+build/
+develop-eggs/
+dist/
+downloads/
+eggs/
+.eggs/
+lib/
+lib64/
+parts/
+sdist/
+var/
+wheels/
+share/python-wheels/
+*.egg-info/
+.installed.cfg
+*.egg
+MANIFEST
+
+# PyInstaller
+#  Usually these files are written by a python script from a template
+#  before PyInstaller builds the exe, so as to inject date/other infos into it.
+*.manifest
+*.spec
+
+# Installer logs
+pip-log.txt
+pip-delete-this-directory.txt
+
+# Unit test / coverage reports
+htmlcov/
+.tox/
+.nox/
+.coverage
+.coverage.*
+.cache
+nosetests.xml
+coverage.xml
+*.cover
+*.py,cover
+.hypothesis/
+.pytest_cache/
+cover/
+
+# Translations
+*.mo
+*.pot
+
+# Django stuff:
+*.log
+local_settings.py
+db.sqlite3
+db.sqlite3-journal
+
+# Flask stuff:
+instance/
+.webassets-cache
+
+# Scrapy stuff:
+.scrapy
+
+# Sphinx documentation
+docs/_build/
+
+# PyBuilder
+.pybuilder/
+target/
+
+# Jupyter Notebook
+.ipynb_checkpoints
+
+# IPython
+profile_default/
+ipython_config.py
+
+# pyenv
+#   For a library or package, you might want to ignore these files since the code is
+#   intended to run in multiple environments; otherwise, check them in:
+# .python-version
+
+# pipenv
+#   According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
+#   However, in case of collaboration, if having platform-specific dependencies or dependencies
+#   having no cross-platform support, pipenv may install dependencies that don't work, or not
+#   install all needed dependencies.
+#Pipfile.lock
+
+# poetry
+#   Similar to Pipfile.lock, it is generally recommended to include poetry.lock in version control.
+#   This is especially recommended for binary packages to ensure reproducibility, and is more
+#   commonly ignored for libraries.
+#   https://python-poetry.org/docs/basic-usage/#commit-your-poetrylock-file-to-version-control
+#poetry.lock
+
+# pdm
+#   Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
+#pdm.lock
+#   pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
+#   in version control.
+#   https://pdm.fming.dev/#use-with-ide
+.pdm.toml
+
+# PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
+__pypackages__/
+
+# Celery stuff
+celerybeat-schedule
+celerybeat.pid
+
+# SageMath parsed files
+*.sage.py
+
+# Environments
+.env
+.venv
+env/
+venv/
+ENV/
+env.bak/
+venv.bak/
+
+# Spyder project settings
+.spyderproject
+.spyproject
+
+# Rope project settings
+.ropeproject
+
+# mkdocs documentation
+/site
+
+# mypy
+.mypy_cache/
+.dmypy.json
+dmypy.json
+
+# Pyre type checker
+.pyre/
+
+# pytype static type analyzer
+.pytype/
+
+# Cython debug symbols
+cython_debug/
+
+# PyCharm
+#  JetBrains specific template is maintained in a separate JetBrains.gitignore that can
+#  be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
+#  and can be added to the global gitignore or merged into this file.  For a more nuclear
+#  option (not recommended) you can uncomment the following to ignore the entire idea folder.
+#.idea/

LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2024 Vinh Nguyen
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

apikey.py

@@ -0,0 +1 @@
+openai_api_key = ""

app.py

@@ -0,0 +1,143 @@
+import os
+import streamlit as st
+
+from langchain.chat_models import ChatOpenAI
+from langchain.text_splitter import RecursiveCharacterTextSplitter
+from langchain.embeddings.openai import OpenAIEmbeddings
+from langchain.vectorstores.chroma import Chroma
+from langchain.chains import ConversationalRetrievalChain
+from langchain.document_loaders import (
+    PyPDFLoader,
+    Docx2txtLoader,
+    TextLoader,
+)
+
+from apikey import openai_api_key
+
+os.environ["OPENAI_API_KEY"] = openai_api_key
+
+
+def load_and_process_file(file_data):
+    """
+    Load and process the uploaded file.
+    Returns a vector store containing the embedded chunks of the file.
+    """
+    file_name = os.path.join("./", file_data.name)
+    with open(file_name, "wb") as f:
+        f.write(file_data.getvalue())
+
+    name, extension = os.path.splitext(file_name)
+
+    # Load the file using the appropriate loader
+    if extension == ".pdf":
+        loader = PyPDFLoader(file_name)
+    elif extension == ".docx":
+        loader = Docx2txtLoader(file_name)
+    elif extension == ".txt":
+        loader = TextLoader(file_name)
+    else:
+        st.write("This document format is not supported!")
+        return None
+
+    documents = loader.load()
+
+    text_splitter = RecursiveCharacterTextSplitter(
+        chunk_size=1000,
+        chunk_overlap=200,
+    )
+    chunks = text_splitter.split_documents(documents)
+
+    embeddings = OpenAIEmbeddings()
+    vector_store = Chroma.from_documents(chunks, embeddings)
+
+    return vector_store
+
+
+def initialize_chat_model(vector_store):
+    """
+    Initialize the chat model with the given vector store.
+    Returns a ConversationalRetrievalChain instance.
+    """
+    llm = ChatOpenAI(model="gpt-3.5-turbo", temperature=0)
+    retriever = vector_store.as_retriever()
+    return ConversationalRetrievalChain.from_llm(llm, retriever)
+
+
+def main():
+    """
+    The main function that runs the Streamlit app.
+    """
+    st.set_page_config(page_title="Chat with Document", page_icon="📚")
+
+    st.title("📚 Chat with Document")
+    st.write("Upload a document and ask questions related to its content.")
+
+    uploaded_file = st.file_uploader(
+        "Upload a file", type=["pdf", "docx", "txt"], key="file_uploader"
+    )
+    add_file = st.button(
+        "Process File",
+        on_click=clear_history,
+        key="process_button",
+    )
+
+    if uploaded_file and add_file:
+        with st.spinner("Processing file..."):
+            vector_store = load_and_process_file(uploaded_file)
+            if vector_store:
+                crc = initialize_chat_model(vector_store)
+                st.session_state.crc = crc
+                st.success("File processed successfully!")
+
+    st.markdown("## Ask a Question")
+    question = st.text_area("Enter your question", height=200, key="question_input")
+    submit_button = st.button("Submit", key="submit_button")
+
+    if submit_button and "crc" in st.session_state:
+        handle_question(question)
+
+    display_chat_history()
+
+
+def handle_question(question):
+    """
+    Handles the user's question by generating a response and updating the chat history.
+    """
+    crc = st.session_state.crc
+    if "history" not in st.session_state:
+        st.session_state["history"] = []
+
+    with st.spinner("Generating response..."):
+        response = crc.run(
+            {
+                "question": question,
+                "chat_history": st.session_state["history"],
+            }
+        )
+
+    st.session_state["history"].append((question, response))
+    st.write(response)
+
+
+def display_chat_history():
+    """
+    Displays the chat history in the Streamlit app.
+    """
+    if "history" in st.session_state:
+        st.markdown("## Chat History")
+        for q, a in st.session_state["history"]:
+            st.markdown(f"**Question:** {q}")
+            st.write(a)
+            st.write("---")
+
+
+def clear_history():
+    """
+    Clear the chat history stored in the session state.
+    """
+    if "history" in st.session_state:
+        del st.session_state["history"]
+
+
+if __name__ == "__main__":
+    main()

requirements.txt

@@ -0,0 +1,6 @@
+streamlit
+langchain
+chromadb
+openai
+tiktoken
+pypdf

sample/101.txt

@@ -0,0 +1,104 @@
+10 years ago, I started my freshman year of college. This is the advice I needed to hear, not the advice you need to hear. In fact, some of it may be actively bad for you. See Should you reverse any advice you hear?
+You are overly obedient. You not only do what people tell you to do, but find it hard to imagine any world other than the one they present to you. Spend more time thinking about what you want, in isolation from the pressures of the world. (Keep this in mind while you read the rest of this very prescriptive document.)
+Fortunately, you’re usually able to recognize and extricate yourself from situations that are bad for you. Unfortunately, it often takes you about twice as long as it should.
+There will be quiet periods of your life. They will feel slow and low in potential energy. The best use of them is to work on cool projects and share them.
+Write more, on the internet, in college and after. Not only will it increase your surface area of luck, it will also help you form a better idea of who you are.
+Don't do things that feel bad. This is not as easy as it sounds, because you are a two-marshmallow kid.
+Ideally, you wouldn't drink at all. Since we both know it is impossible, try to keep it to once a week.
+When you are bored at work, don't snack. Instead, go outside for a walk in the sun.
+New York is an extremely hedonistic place, especially for a young professional. You'll eat, drink and party too much. It will be fun, and you will be correct in feeling that there is more to life than this.
+Despite what you think, money is not the constraining factor on your ability to do things. If I had to guess what it is, it's probably your social environment (your friends and mentors) and your creativity.
+Do a quantitative trading internship. Despite the fact that the trading interns seem obnoxious and scary, they are not smarter or better than you.
+You currently have high intelligence and low agency. Be aware that you are naturally drawn to people like you, but where possible, try to find and spend time with intelligent people who have high agency.
+Join an a capella or dance group in college.
+You are right to be suspicious of Big EA.
+Despite what the Europeans will tell you, finance is a fine discipline, and you should become an expert in it. It is the system of money, and it is interesting and well worth knowing for that reason.
+Everybody in finance has a number. For almost everybody that number goes up over time. What makes you think it'll be different for you?
+You dream of living in a sunny home where you can go downstairs and get a coffee at a cute shop around the corner. You are correct that this will make you happy.
+You like Brooklyn brownstone apartments more than fancy luxury apartments because they are in point access blocks and have windows on two sides.
+Live in the same neighbourhood as your friends.
+Few experiences are as joyful as cycling around a beautiful city on a sunny day.
+At some point, you will face a choice between work and the love of your life. Pick the boy.
+At some point, the love of your life will face a choice between work and you. If he doesn't pick you, dump him.
+Don't fall in love with something that can't love you back. Companies do not spend a week crying when you break up with them. This is also true of many boys.
+People will occasionally make unsolicited, snide and rude comments to you. Ignore them; this is usually a sign that they are deeply insecure. If they are in a position of authority over you, get away from them.
+You are more inclined to exit than to voice. It is better to do one than neither, but know that leaving is always expensive.
+You are not direct enough when criticizing people. 
+You get angry when the world is unjust. At some point, you will be taught that it is never okay to show it. That's the wrong lesson, though a common one for young women. The right one is that you shouldn't spend time around people who don't understand and appreciate why you are angry.
+You also become angry and sad because you let people push past your boundaries. Stop letting them. Often, just saying 'no' is enough.
+You are high in neuroticism, a trait that correlates with worse social relationships and an unhappier life. Sorry; there's not much you can do about it other than be aware of it. Its saving grace is that it means you are attuned to what is wrong in the world and driven to fix it.
+At lot of your work will involve taking some flow in the world and optimizing some property of them: latency, throughput or bandwidth. To do this, you must figure out what limits them and then remove that bottleneck. This sounds simple, but you will not really understand the depth of this discipline until you work with a master of it.
+Start tracking hours spent on deep work. It is an obvious and very visible metric of how much work you have done.
+If you enjoy interning somewhere, but the person you like most announces during your internship that they're leaving the firm, think hard about what message you should take away from that.
+The most important thing to consider when picking a job is who your manager and team will be. The company is only important insofar as it interferes with or supports your ability to work with your team. Conveniently, the most prestigious and well-known companies are the best at getting out of your way.
+A $25 Airtag will save you 10 minutes a day of looking for your wallet.
+Sometimes, you will worry that things feel too pleasant and stable and that you are in a rut. Don't worry; something will jolt you out of it eventually. Enjoy the good parts while they last.
+Status exists in all domains. Status in areas you don't care about is useless and mind-corroding. The best way to accumulate it in areas you care about is by doing cool things.
+Nerd cultures have status dynamics, too. In fact, they are often stronger there because there are few defenses against it.
+Your inbound opportunities are worse than the ones you carefully select and nurture over time. This is true both if you are an engineer looking for a job and if you are a 19-year-old girl looking for someone to date.
+Be suspicious of people who fawn over you with affection for no reason. They usually have a system for finding people like you, and they will grind you up in the cogs of their machine. This is true both if you are an engineer looking for a job and if you are a 19-year-old girl looking for someone to date.
+It is not bad to be in a transactional relationship as long as you get something out of it.
+Help people. Some of them may not remember, but you will feel good about doing it anyway. Some of them will, and it will create a strong bond between you.
+When you are in college, there are so many potential friends around that it is correct to filter out people who are hard to contact. Once you are older, this becomes much less true.
+The best reason to move to New York is because all your friends are moving there too.
+The best way to make friends is by working on a large and intense project together. This could be a conference, a camp or a startup.
+Try to visit a nice, suburban house of an American friend during college. You will not understand the country until you do this.
+Learn to drive, as soon as possible.
+Being on an F-1 visa does not constrain your ability to work on a startup.
+In 2020 and 2021, mass hysteria will sweep the world. (There will be a virus, too, but since you are a healthy 25-year-old and don't know any over 50, it will not notably affect your life.) Realize that nobody at any large company will get any work done during this time. Don't throw effort into work during this time, or you will burn out.
+Stick it out to get your 2020 bonus, then seriously consider leaving your job and moving into crypto. It's a degenerate and trash subculture, but it's one of the only high-agency environments you have access to in 2020 and 2021. If you don't do that, at least switch teams.
+For the love of God, buy Solana at $3.
+You will be deeply unhappy in any job that requires you to sit in a windowless box from 9-5 all day. Fortunately, very few good jobs require this.
+You should aim to produce things at about a 1:10 ratio to how much you consume them. This is true of food, videos, internet comments and parties. Realistically, you might achieve 1:100 or 1:1000.
+Get into the habit of making mid-term or long-term stock bets of about .5-1% of your net worth. This will never make you rich, but it will inform you about how much you know relative to the rest of the world.
+100% VOO, after an emergency fund, is a fine allocation of savings for a young professional with no family obligations. Interactive Brokers will let you borrow against it on margin if you need temporary liquidity on short notice.
+Most advice is given by and directed at people who have less education, money, technical ability, and social capital than you. You should consider it accordingly. Do note that I have more of all of those things than you.
+Don't trust people when they say that they are experts and they know what they are doing. Ask the questions you need to ask to understand at least the high level of what is going on.
+People who lie to you about small and unimportant things will lie to you about big and important things.
+Most managers lie.
+Mathcamp is a strangely good selector for people you like. You should not spend 100% of your time with Mathcampers, but 10-30% is a good ratio.
+Avoid makeup. Wear imported Korean sunscreen every day.
+Take a week off every year and go to Burning Man. It will change your conception of what is possible in the physical world.
+You will understand a person when you understand what it is that they want most in life.
+Get a coach to teach you proper form, then lift weights 2-3 times a week. That is all you need to do to stay healthy.
+Try very hard not to gain weight. Once it goes on, it is hard to take off.
+Grow a garden. It will teach you about patience and consistency. It will also teach you about the value of automation, and a useful amount about plumbing.
+Programming is not the only technical skill worth knowing.
+Spend lots of time posting thoughts in good group chats. A tight-knit Discord server is great for this, but it is hard to kickstart.
+People will tell you that it is good and right to be Scotty. They are wrong; you should be like Kirk.
+Do some wet lab biology work in college. Also, take a campus job that requires you to do sales.
+Take only one hard class a semester. Really. You'll learn more, have a better time and get really good grades.
+Professors are extremely variable in quality.
+Start trying to understand the world through Fermi calculations. Memorize important numbers. This is an extremely useful skill.
+Try to make ambitious and smart friends who do cool things. The best way to do so is to be smart and ambitious yourself, and do cool things.
+It is important to do some on-call/production support, but you are very good at it and will be asked to do it more than others. Say no. It will take away from your ability to develop more valuable skills.
+Every month, write an email to your friends around the world. This is the best way to stay in touch with people who you may not see again for years.
+Bookmark and catalogue good essays on the internet.
+Organize your cables by putting them into labeled ziploc bags. Put the ziploc bags in a box and label it 'cables'. Now you will have a cleaner desk cabinet and infinite cables.
+The best work comes out of great teams.
+You will never live in Europe. That's OK; it is better to visit than to live there.
+Asia is not a good place for software engineers.
+Run essays through Grammarly before you publish them.
+Good work requires much more than just grinding. You need to be creative, well-connected and communicative, too.
+You will learn the key parts of what can be generically taught about software engineering in a year and a half. There is much more to learn, but you will need to teach it to yourself or seek out specialized teachers.
+People show you much of their character in the first few days you know them.
+There is a part of you that will always rebel against the world you are a part of. Keep it alive; it's usually right.
+When you are young, it feels like you will cycle through hobbies and ways of life quickly. Don't stress about it. At some point, you will slow down and develop a routine.
+You are more like a plant than you realize. Drink lots of water and spend time in the sun.
+If you find yourself spending a lot of time in the bathroom on your phone, it is because you work in a large, open-floor office all the time, and it's the only place you can get away from the chaos. Consider changing your lifestyle so that you don't need to do this.
+You work better and feel happier immediately after you drink coffee. You will crash a few hours later. A pill of tyrosine can do wonders in the mid-afternoon.
+Avoid carbs and eat lots of protein.
+You only need three pots and pans in your kitchen: a wok, a cast-iron pan, and a Dutch oven.
+You cannot work and travel at the same time. Don't try.
+Hang out with your friends at least three or four times a week. Best if it's every day.
+You don't need to be in your employer's office to do good work. You will feel great if you spend your days working in a room with your friends, even if they're working on something completely different.
+Don't work with people who you don't technically respect. If your employer keeps insisting that you do, quit.
+The best way for you to be happy with your work is to control who you work with. The way you do this is by deciding who your team hires and fires.
+Consider deleting as often as you consider adding. This holds true for code, furniture and obligations.
+The trick to surviving a big institution is to find your group within it. Then ignore everything else.
+American culture, despite many words to the contrary, is built around self-segregation. You will be happier once you stop fighting this.
+In college, try to make a cool app that all your friends want to use.
+I would trade half my current net worth for a world in which I had a stronger community of friends and had worked more on my own projects instead of someone else's. Consider that when you make your choices, on the margin.
+The next decade of your life will be a rollercoaster, but it will also amazing. You will make friends who will become family, find the love of your life and get really good at your craft. I wouldn't swap places with you. But I've had a great ride and I hope the next decade of my life is as good.
+
+# credit: https://www.approachwithalacrity.com/101-things-for-my-past-self/