Parameter Lab

During my PhD, I used to skim through all the AI papers on arXiv every day. Today, PhD students face 10x more papers each day. This has fundamentally changed the way AI research is done. We now rely on platforms like Twitter and LinkedIn to discover and discuss the latest papers. But even with 1000s of connections on social media, I still miss the sense of community. In the 2010s, I could name nearly every PhD student and lab worldwide working on my research topic. It was easy to chat at conferences and form lasting connections. Today, that’s become almost impossible. But I don't believe this has to be the new normal. A new era calls for new solutions. That’s why we’re building #ResearchTrendAI - to make research updates and presentations more manageable, accessible from anywhere, and scalable, with the help of underlying AI technologies.

Parameter Lab is now part of the NVIDIA Inception program! https://lnkd.in/eJcyznp3 The package comes with GCP and AWS computing credits. They'll be used to power LLM training and data processing behind #ResearchTrendAI. Stay tuned for exciting updates in the coming weeks!

👀 Here's a sneak peek of the researcher profile page you will be able to create with our upcoming #ResearchTrendAI product!

📢 Parameter Lab will be at the #ACL2024 conference in Bangkok! Come to see our two posters: - TRAP 🪤 about black-box LLM fingerprinting: Tuesday 13 Aug 12:15-13:15 - Apricot 🍑 about black-box calibrated confidence score estimation: Tuesday 13 Aug 16:00-17:30

🔎 Parameter Lab is looking for a *Research Intern* for roughly the period of October 2024 - February 2025. You’ll do research on trustworthy AI for LLMs or multi-modal foundational models. Your research work is expected to lead to a top-tier conference submission. Prior intern projects: - ProPILE (NeurIPS’23 spotlight): https://lnkd.in/eKTGgACS - TRAP (ACL’24 findings): https://lnkd.in/eYMYdwVU - Apricot (ACL’24): https://lnkd.in/esux9dxh We expect you to have a Master’s degree (or equivalent) in AI/ML or related fields. It is a big plus to have hands-on experience with research in the related topics, such as Trustworthy AI, Privacy and Security for AI, XAI, and LLMs. ➡️ If interested, please visit: https://lnkd.in/eiymNQNx

🔍 In this #ResearchMonday's spotlight: a pivotal ICLR 2024 paper that reshapes our understanding of fine-tuning LLM. It reveals that fine-tuning may only superficially align models, without deeply altering their pre-trained capabilities. 🧠💻 This insight helps explain why fine-tuning can easily jailbreak an LLM, see https://buff.ly/47J1WTw. It's not just about the ease of the attack; it's about the fundamental nature of fine-tuning itself. The authors also express enthusiasm for future research aimed at not just masking but potentially deleting or unlearning certain pre-trained capabilities, enhancing the safety and reliability of AI systems. 🛡️🤖 A crucial read for those navigating the complex terrain of AI ethics and security. #AIethics #AISecurity The paper 📜: https://lnkd.in/euZjw3Zt The author's thread 🧵: https://buff.ly/3U9t0Ii

🔬 This week's #ResearchMonday features a study titled "Scalable Extraction of Training Data from (Production) Language Models", revealing the brittleness of alignment in AI. The research shows that simply prompting a model like ChatGPT to repeatedly output a single word can lead to the unintended disclosure of its training data! 💥 ⛓ This finding challenges the effectiveness of current alignment techniques, highlighting significant security vulnerabilities. 🛡 This revelation is crucial in understanding the complex balance between model utility and data privacy, urging the AI community to reassess and strengthen alignment techniques in AI systems. #AIethics #Privacy #LLM https://lnkd.in/eS4aMrNj

🌟 Hello LinkedIn! We at Parameter Lab are building a brand-new tool to help you track the latest AI trends & research papers, and we need YOUR input! 🧠🔍 Take our 5-minute survey and you could win a $100 voucher! 💸 Your feedback will help us tailor our tool to better meet the needs of AI enthusiasts and professionals like you. 🤖✨ 🔗 ==> https://lnkd.in/epaHKqmi <== #AI #Innovation #Research #Monitoring