skLEP: A Slovak General Language Understanding Benchmark
Marek \v{S}uppa, Andrej Ridzik, Daniel Hl\'adek, Tom\'a\v{s} Jav\r{u}rek, Vikt\'oria Ondrejov\'a, Krist\'ina S\'asikov\'a, Martin Tamajka, Mari\'an \v{S}imko
https://arxiv.org/abs/2506.21508 https://arxiv.org/pdf/2506.21508 https://arxiv.org/html/2506.21508
arXiv:2506.21508v1 Announce Type: new
Abstract: In this work, we introduce skLEP, the first comprehensive benchmark specifically designed for evaluating Slovak natural language understanding (NLU) models. We have compiled skLEP to encompass nine diverse tasks that span token-level, sentence-pair, and document-level challenges, thereby offering a thorough assessment of model capabilities. To create this benchmark, we curated new, original datasets tailored for Slovak and meticulously translated established English NLU resources. Within this paper, we also present the first systematic and extensive evaluation of a wide array of Slovak-specific, multilingual, and English pre-trained language models using the skLEP tasks. Finally, we also release the complete benchmark data, an open-source toolkit facilitating both fine-tuning and evaluation of models, and a public leaderboard at https://github.com/slovak-nlp/sklep in the hopes of fostering reproducibility and drive future research in Slovak NLU.
toXiv_bot_toot
Detectability and Parameter Estimation for Einstein Telescope Configurations with GWJulia
Andrea Begnoni, Stefano Anselmi, Mauro Pieroni, Alessandro Renzi, Angelo Ricciardone
https://arxiv.org/abs/2506.21530
The IRS open sourced much of its incredibly popular Direct File software as the future of the free tax filing program is at risk of being killed by Intuit’s lobbyists and Donald Trump’s megabill.
Meanwhile, several top developers who worked on the software have left the government and joined a project to explore the “future of tax filing” in the private sector
TUM Teleoperation: Open Source Software for Remote Driving and Assistance of Automated Vehicles
Tobias Kerbl, David Brecht, Nils Gehrke, Nijinshan Karunainayagam, Niklas Krauss, Florian Pfab, Richard Taupitz, Ines Trautmannsheimer, Xiyan Su, Maria-Magdalena Wolf, Frank Diermeyer
https://arxiv.org/abs/2506.13933
The IRS open sourced most of its Direct File tax software on GitHub last week, fulfilling a legal requirement under the SHARE IT Act, despite Intuit pressure (Jason Koebler/404 Media)
https://www.404media.co/directfile-open-source-…
📣 Calling all GÉANT Project partners…
Got an idea for digital research, data transfer or secure storage solutions to support open science?
The 2025 GÉANT Above-the-Net Services Incubator is officially open for proposals!
This is your opportunity to:
✅ Develop and test your innovative idea
✅ Deliver impact to the whole community through new, shared, open-source services
✅ Help shape the future of GÉANT's Above-the-Net services portfolio
Learn more: …
Stand Up for Science has a great campaign--"Summer Fight for Science in America!" It's a call to bring science to the people--open labs, etc. Check it out! https://actionnetwork.org/event_campaigns/summer-fight?source=Website
Today, we’re thrilled to announce that Refuel.ai has been acquired by Together.ai. All of us - our team, our technology, and our mission - are joining Together to help build the future of open source and enterprise AI.
https://www.refuel.ai/blog-posts/we-are-joining-to…
Humanoid World Models: Open World Foundation Models for Humanoid Robotics
Muhammad Qasim Ali, Aditya Sridhar, Shahbuland Matiana, Alex Wong, Mohammad Al-Sharman
https://arxiv.org/abs/2506.01182
Today, we’re thrilled to announce that Refuel.ai has been acquired by Together.ai. All of us - our team, our technology, and our mission - are joining Together to help build the future of open source and enterprise AI.
https://www.refuel.ai/blog-posts/we-are-joining-to…
@arXiv_csCL_bot@mastoxiv.page
