PinnedNedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Simple Local Testing of Llama 3 on Its Release, Gemma, and Mistral MistralUpon the release of Llama 3, I conducted tests on three models locally on my 8G RAM M1 Macbook: gemma:2b (I would have preferred to use…·4 min read·Apr 21, 2024----
PinnedNedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Play with LangChain 3 — Simulate Full RAG Locally with word2vec and GemmaWith the Apple researchers’ unveiling of ReALM, following Gemma from Google, Llama from Meta, and a couple of others from Microsoft…·3 min read·Apr 6, 2024----
PinnedNedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Build a Facade API for OpenAI API and Local LLM APIIn 2024, OpenAI leads the Generative AI sector, favored for its pioneering, easy-to-use API and the advanced GPT-4. However, factors like…·3 min read·Mar 29, 2024----
Nedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Play with LangChain 2- locally with GemmaIn “Geek Out Time: Play with Langchain”, I realized that I had reached my OpenAI usage limit and needed to arrange for an upgrade. Running…·2 min read·Mar 9, 2024--1--1
Nedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Play with LangChainLangChain (https://www.langchain.com/) is an open-source framework designed for building applications using large language models (LLMs)…·4 min read·Mar 2, 2024----
Nedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Run web browser app with local SLMsMany open-source small language models have been released, which makes running the SLMs-powered client-side app locally possible. There is…·2 min read·Nov 25, 2023----
Nedved YanginThe Constellar Digital&Technology BlogQKV and Multi-head Attention in LLMIn the realm of Natural Language Processing (NLP), Large Language Models (LLMs) like GPT-3 and BERT have revolutionized how machines…·4 min read·Nov 19, 2023----
Nedved YanginThe Constellar Digital&Technology BlogUnusual team bonding activityMany folks volunteered to assist the project team in identifying false positives after applying fuzzy matching to thousands of SF accounts…·1 min read·Nov 5, 2023----
Nedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Play with AutoGenMicrosoft has open-sourced AutoGen (available at https://github.com/microsoft/autogen), a framework that enables developers to build…·6 min read·Oct 22, 2023----
Nedved YanginThe Constellar Digital&Technology BlogHere at Constellar, we know how to hustle hard and have a blast doing it!·2 min read·Jul 25, 2023----