ArkanSec October Download

<h3>LLLLLLLLLLMs: Let&#x27;s Learn to Load Lots of Low-Latency, Locally-Located, Large Language Models!</h3><p>This will walk through what it actually takes to stand up local LLMs in a home lab, which today feels like the &quot;Linux-as-a-daily-driver&quot; of the early 2000s: Better than Windows/MacOS in many ways, excruciating in others, and ultimately still worth the effort to learn. Commercial providers come with many headaches that can be avoided when you own the physical hardware and network: Token costs, watermarking mandates, silent post-release model changes, content blocks triggered by you-sneezed-wrong-last-Thursday-so-your-model-has-been-downgraded-for-this-session. Topics to cover: hardware, LLM serving stack, model selection, harnesses, security, and expectations.</p> <h3>About the Presenter</h3><p><strong>Tim Skoch</strong></p><p>Tim Skoch has worked in technical roles (SaaS engineer, applications developer, security engineer, penetration tester) across a variety of organizations, including the University of Arkansas, JB Hunt, and (currently) KoreLogic. At home he runs a marginally-overkill home lab that he uses to learn and experiment with new technologies. This is particularly useful as a pentester, where projects often require testers to get up-to-speed quickly on a variety of technology stacks.</p> <hr><h3>About ArkanSec</h3><p>Everyone is welcome. There is no membership fee or registration. ArkanSec is Northwest Arkansas&#x27;s hacker, InfoSec, &amp; cybersecurity community. We look for creative ways to share information and experience with anyone interested in learning more about technology. Students, professionals, and hobbyists alike are encouraged to join us in building a community dedicated to improving privacy, stability, and security. We strive to meet on the first Thursday of every month. Find your preferred way to connect with us at <a href="https://www.arkansec.com.">https://www.arkansec.com.</a> <br> <br>We are always interested in hearing what you have to say. If you have any suggestions on topics or would like to share a project you&#x27;re working on, email us at [email protected]. Each month, ArkanSec gets together to discuss recent security events &amp; headlines, as well as to share technical experience with common tools.</p>