PinnedNedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Simple Local Testing of Llama 3 on Its Release, Gemma, and Mistral MistralUpon the release of Llama 3, I conducted tests on three models locally on my 8G RAM M1 Macbook: gemma:2b (I would have preferred to use…Apr 21Apr 21
PinnedNedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Play with LangChain 3 — Simulate Full RAG Locally with word2vec and GemmaWith the Apple researchers’ unveiling of ReALM, following Gemma from Google, Llama from Meta, and a couple of others from Microsoft…Apr 6Apr 6
PinnedNedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Build a Facade API for OpenAI API and Local LLM APIIn 2024, OpenAI leads the Generative AI sector, favored for its pioneering, easy-to-use API and the advanced GPT-4. However, factors like…Mar 29Mar 29
Nedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Play with the newly released OpenAI’s SwarmOpenAI has just released Swarm (https://github.com/openai/swarm) week ago as an experimental framework for lightweight multi-agent…2d ago2d ago
Nedved YanginThe Constellar Digital&Technology BlogGeekOut time: Exploring Complex SQL Queries with Natural LanguageThe world of databases is becoming more accessible thanks to tools that convert natural language into SQL. One such tool is Text2SQL.ai…Sep 15Sep 15
Nedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Building an Interactive Career Coach with AutoGen GroupChatOver the past few weeks, I have been experimenting with AutoGen to understand its capabilities and potential applications. This weekend, we…Sep 1Sep 1
Nedved YanginThe Constellar Digital&Technology BlogGeek Out Time: Creating a Graph-Based FSM Group Chat with Autogen (not Autogen Studio)locally with…I have tried using AutoGen Studio to build the customized agent and now want to test a more complicated group chat. After launching the…Aug 4Aug 4
Nedved YanginThe Constellar Digital&Technology BlogGeek Out Time: RouteLLM with Nvidia NIM, A Cost-Effective Solution for Integrating Multiple Models?In the past few Geek Out Time sessions, I have explored Nvidia NIMS and Microsoft Autogen. It’s been fascinating to see how MS Autogen can…Jul 27Jul 27
Nedved YanginThe Constellar Digital&Technology BlogGeek out time: Creating an Agent with Customized Skill in AutoGen BuilderI have tried using the local LLM/SLM through Autogen Builder at…Jul 19Jul 19
Nedved YanginThe Constellar Digital&Technology BlogGeek out time: try LLM and Embeddings on Nvidia NIM with Node.jsNvidia NIM was rolled out a long time ago, but I haven’t seen it in action yet. In the past few weeks, I’ve played with the OpenAI API and…Jul 13Jul 13