Tootfinder

This https://arxiv.org/abs/2402.07823 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_qu…

Recursive expansion of Tanner graph: a method to construct stabilizer codes with high coding rate
Quantum stabilizer codes face the problem of low coding rate. In this article, following the idea of recursively expanding Tanner graph proposed in our previous work, we try to construct new stabilizer codes with high coding rate, and propose XZ-type Tanner-graph-recursive-expansion (XZ-TGRE) code and Tanner-graph-recursive-expansion hypergraph product (TGRE-HP) code. XZ-TGRE code have zero asymptotic coding rate, but its coding rate tends to zero extremely slowly with the growth of code length…

Assessing Economic Viability: A Comparative Analysis of Total Cost of Ownership for Domain-Adapted Large Language Models versus State-of-the-art Counterparts in Chip Design Coding Assistance
Amit Sharma, Teodor-Dumitru Ene, Kishor Kunal, Mingjie Liu, Zafar Hasan, Haoxing Ren
https://arxiv.org/abs/2404.08850

Assessing Economic Viability: A Comparative Analysis of Total Cost of Ownership for Domain-Adapted Large Language Models versus State-of-the-art Counterparts in Chip Design Coding Assistance
This paper presents a comparative analysis of total cost of ownership (TCO) and performance between domain-adapted large language models (LLM) and state-of-the-art (SoTA) LLMs , with a particular emphasis on tasks related to coding assistance for chip design. We examine the TCO and performance metrics of a domain-adaptive LLM, ChipNeMo, against two leading LLMs, Claude 3 Opus and ChatGPT-4 Turbo, to assess their efficacy in chip design coding generation. Through a detailed evaluation of the acc…

🚀 Ready to dive back into live coding? Join us in our next episode as we continue developing our Android app. Real-time coding, real-time learning! Don’t miss out! Tune in: [Your Stream Link] #AndroidDev #LiveCoding"

Cognition AI, which offers a Copilot-like coding assistant that, the startup says, can finish whole projects, raised $21M from Founders Fund, Elad Gil, and more (Ashlee Vance/Bloomberg)
https://www.bloomberg.com/news/articles/20

Cognition AI Is a Peter Thiel-Backed Coding Assistant
A new startup called Cognition AI can turn a user’s prompt into a website or video game.

I have been using computers for 50 years, coding for 45 (10 professionally over that span), and coding Ruby for 10. I would rate myself as an accomplished hack - I get stuff done, not always the most elegant or efficient way, but it works.
I’ve found @…’s video tutorials to be very useful and insigthful:

Exit Early with Ruby's Abort Method
Exiting early from a command-line script might seem pretty basic, but there are several ways to get it wrong. Learn the idiomatic way to indicate fatal usage er

CodeUltraFeedback: An LLM-as-a-Judge Dataset for Aligning Large Language Models to Coding Preferences
Martin Weyssow, Aton Kamanda, Houari Sahraoui
https://arxiv.org/abs/2403.09032

CodeUltraFeedback: An LLM-as-a-Judge Dataset for Aligning Large Language Models to Coding Preferences
Evaluating the alignment of large language models (LLMs) with user-defined coding preferences is a challenging endeavour that requires assessing intricate textual LLMs' outputs. By relying on automated metrics and static analysis tools, existing benchmarks fail to assess nuances in user instructions and LLM outputs, highlighting the need for large-scale datasets and benchmarks for LLM preference alignment. In this paper, we introduce CodeUltraFeedback, a preference dataset of 10,000 complex ins…

Now on #LKML: a discussion if usage of WARN*() should be discouraged in #Linux, because quite a few systems have panic_on_warn set (and then a warn leads to a panic):

Maximum Channel Coding Rate of Finite Block Length MIMO Faster-Than-Nyquist Signaling
Zichao Zhang, Melda Yuksel, Halim Yanikomeroglu, Benjamin K. Ng, Chan-Tong Lam
https://arxiv.org/abs/2403.08989

Maximum Channel Coding Rate of Finite Block Length MIMO Faster-Than-Nyquist Signaling
The pursuit of higher data rates and efficient spectrum utilization in modern communication technologies necessitates novel solutions. In order to provide insights into improving spectral efficiency and reducing latency, this study investigates the maximum channel coding rate (MCCR) of finite block length (FBL) multiple-input multiple-output (MIMO) faster-than-Nyquist (FTN) channels. By optimizing power allocation, we derive the system's MCCR expression. Simulation results are compared with the…

Third day in a row with a migraine with aura … ✨ So annoying. 😒 It also makes working with a computer and especially coding basically impossible, because the aura with the twinkling blind spots always sits right at the center of the visual field and cuts of the beginning of the words I’m trying to read.
And you know what I do then to mitigate it a bit? I increase the font size in the browser. Some people actually do that! 😉

Cognition AI, which offers a Copilot-like coding assistant that, the startup says, can finish whole projects, raised $21M from Founders Fund, Elad Gil, and more (Ashlee Vance/Bloomberg)
https://www.bloomberg.com/news/articles/20

Cognition AI Is a Peter Thiel-Backed Coding Assistant
A new startup called Cognition AI can turn a user’s prompt into a website or video game.

Efficient Convolutional Forward Modeling and Sparse Coding in Multichannel Imaging
Han Wang, Yhonatan Kvich, Eduardo P\'erez, Florian R\"omer, Yonina C. Eldar
https://arxiv.org/abs/2403.09505

Efficient Convolutional Forward Modeling and Sparse Coding in Multichannel Imaging
This study considers the Block-Toeplitz structural properties inherent in traditional multichannel forward model matrices, using Full Matrix Capture (FMC) in ultrasonic testing as a case study. We propose an analytical convolutional forward model that transforms reflectivity maps into FMC data. Our findings demonstrate that the convolutional model excels over its matrix-based counterpart in terms of computational efficiency and storage requirements. This accelerated forward modeling approach ho…

One-Spike SNN: Single-Spike Phase Coding with Base Manipulation for ANN-to-SNN Conversion Loss Minimization
Sangwoo Hwang, Jaeha Kung
https://arxiv.org/abs/2403.08786

One-Spike SNN: Single-Spike Phase Coding with Base Manipulation for ANN-to-SNN Conversion Loss Minimization
As spiking neural networks (SNNs) are event-driven, energy efficiency is higher than conventional artificial neural networks (ANNs). Since SNN delivers data through discrete spikes, it is difficult to use gradient methods for training, limiting its accuracy. To keep the accuracy of SNNs similar to ANN counterparts, pre-trained ANNs are converted to SNNs (ANN-to-SNN conversion). During the conversion, encoding activations of ANNs to a set of spikes in SNNs is crucial for minimizing the conversio…

2021 retro-link! https://matduggan.com/why-we-need-better/ - Coding for non-programmers: we need better web GUI automation tools.

so wild that the home of Project Zero chose to reimplement JPEG in C https://opensource.googleblog.com/2024/04/introducing-jpegli-new-jpeg-coding-library.html

Introducing Jpegli: A New JPEG Coding Library
Jpegli, an advanced JPEG coding library that maintains high backward compatibility is faster, and more efficient, than traditional JPEG.

A Systematic Construction Approach for All $4\times 4$ Involutory MDS Matrices
Yogesh Kumar, P. R. Mishra, Susanta Samanta, Atul Gaur
https://arxiv.org/abs/2404.08250

A Systematic Construction Approach for All $4\times 4$ Involutory MDS Matrices
Maximum distance separable (MDS) matrices play a crucial role not only in coding theory but also in the design of block ciphers and hash functions. Of particular interest are involutory MDS matrices, which facilitate the use of a single circuit for both encryption and decryption in hardware implementations. In this article, we present several characterizations of involutory MDS matrices of even order. Additionally, we introduce a new matrix form for obtaining all involutory MDS matrices of even…

Byzantine Reliable Broadcast with Low Communication and Time Complexity
Thomas Locher
https://arxiv.org/abs/2404.08070 https://arxiv.…

Byzantine Reliable Broadcast with Low Communication and Time Complexity
Byzantine reliable broadcast is a fundamental problem in distributed computing, which has been studied extensively over the past decades. State-of-the-art algorithms are predominantly based on the approach to share encoded fragments of the broadcast message, yielding an asymptotically optimal communication complexity when the message size exceeds the network size, a condition frequently encountered in practice. However, algorithms following the standard coding approach incur an overhead factor …

This https://arxiv.org/abs/2309.13835 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_ees…

IBVC: Interpolation-driven B-frame Video Compression
Learned B-frame video compression aims to adopt bi-directional motion estimation and motion compensation (MEMC) coding for middle frame reconstruction. However, previous learned approaches often directly extend neural P-frame codecs to B-frame relying on bi-directional optical-flow estimation or video frame interpolation. They suffer from inaccurate quantized motions and inefficient motion compensation. To address these issues, we propose a simple yet effective structure called Interpolation-dr…

Better space-time-robustness trade-offs for set reconciliation
Djamal Belazzougui, Gregory Kucherov, Stefan Walzer
https://arxiv.org/abs/2404.09607 https:/…

Better space-time-robustness trade-offs for set reconciliation
We consider the problem of reconstructing the symmetric difference between similar sets from their representations (sketches) of size linear in the number of differences. Exact solutions to this problem are based on error-correcting coding techniques and suffer from a large decoding time. Existing probabilistic solutions based on Invertible Bloom Lookup Tables (IBLTs) are time-efficient but offer insufficient success guarantees for many applications. Here we propose a tunable trade-off between …

WordPress 6.5 looks like it has some nice additions. If you have updated already, what do you like most in the new release?
#WordPress

WordPress 6.5
Take control, build it your way Elevate your site-building experience with WordPress 6.5. Explore more avenues to make it your own with new features and enhancements that transform how you create with WordPress. Meet the Font Library Stay in control of an essential piece of your site’s design—typography—without coding or extra steps. Add and manage […]

i want something like a livestream for coding but without having to like... be on a voice chat for an audience
i don't even mind it that much, it's just that writing #GlasgowInterfaceExplorer applets is a comfort thing to me and i don't wanna make it harder

This https://arxiv.org/abs/2404.04162 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csNI_…

Wireless Resource Optimization in Hybrid Semantic/Bit Communication Networks
Recently, semantic communication (SemCom) has shown great potential in significant resource savings and efficient information exchanges, thus naturally introducing a novel and practical cellular network paradigm where two modes of SemCom and conventional bit communication (BitCom) coexist. Nevertheless, the involved wireless resource management becomes rather complicated and challenging, given the unique background knowledge matching and time-consuming semantic coding requirements in SemCom. To…

How To Draw An Owl
#Refactor

@… I use iPad for everything for a year or two. Just need a laptop for web development and only because there’s no browser with dev tools. Coding is fine with code sandbox. Especially when connected to an external display.

Get fun ideas for coding and robotics in grades K-8, like making games, creating stories, programming robots, and solving problems! https://blog.tcea.org/scope-and-sequence-computational-thinking-part-2/

It seems none of the companies rushing to fill this space have any scruples … bringing once again to mind questions about the quality of the coding.
https://www.bloomberg.com/news/articles/2024-04-12/adobe-s-a…

Adobe’s AI Firefly Used AI-Generated Images From Rivals for Training
Company promotes its tool as safe from content scraped from the internet.

coding, culture, people, communication
Cool thread of people's ideas about what's important to know!
#coding #culture #history #communication #teaching

"Coding for fun, or coding for money, are two absolutely, completely, and irrevocably orthogonal activities. This offset applies not only to coding, by the way; performing any human activity for the mere objective of getting paid, substantially modifies the dynamics of the activity in question, and more importantly, of the person doing it, in ways that neither psychology nor economics fully understand."

Specialization Is For Insects
There is a whole field called "Recreational Mathematics;" a moniker that might as well be replaced with "Mathematics as a Hobby." I personally enjoy dabbling in it a lot; I am mostly interested in number theory feats: Ramanujan's hypergeometric series and continuous fractions converging to Pi in the most weird ways are among my favorites.

5 Lessons I Learned From Making 100 Coding Tutorials https://www.youtube.com/watch?v=1C6FQOzDmjg

Sources: Cambridge-based Raspberry Pi is finalizing plans to float on the London stock market this month in a deal that could value the company at up to £500M (The Sunday Times)
https://www.thetimes.co.uk/article/british-tech-firm-ra…

British tech firm Raspberry Pi lines up £500m float
The Cambridge business sells cheap, credit-card-sized computers and was originally set up to help get children into coding

Universal Slepian-Wolf coding for individual sequences
Neri Merhav
https://arxiv.org/abs/2403.07409 https://arxiv.org/pdf/2403.07409<…

Universal Slepian-Wolf coding for individual sequences
We establish a coding theorem and a matching converse theorem for separate encodings and joint decoding of individual sequences using finite-state machines. The achievable rate region is characterized in terms of the Lempel-Ziv (LZ) complexities, the conditional LZ complexities and the joint LZ complexity of the two source sequences. An important feature that is needed to this end, which may be interesting on its own right, is a certain asymptotic form of a chain rule for LZ complexities, which…

I've got a strange one for all my #coding friends today.
I rebased a local branch of a repo and did the usual #git push --force to overwrite the remote branch.
A git status shows everything is great but five seconds later #VSC

This https://arxiv.org/abs/2311.01888 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_sta…

Learning Sparse Codes with Entropy-Based ELBOs
Standard probabilistic sparse coding assumes a Laplace prior, a linear mapping from latents to observables, and Gaussian observable distributions. We here derive a solely entropy-based learning objective for the parameters of standard sparse coding. The novel variational objective has the following features: (A) unlike MAP approximations, it uses non-trivial posterior approximations for probabilistic inference; (B) unlike for previous non-trivial approximations, the novel objective is fully ana…

Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
Sainbayar Sukhbaatar, Olga Golovneva, Vasu Sharma, Hu Xu, Xi Victoria Lin, Baptiste Rozi\`ere, Jacob Kahn, Daniel Li, Wen-tau Yih, Jason Weston, Xian Li
https://arxiv.org/abs/2403.07816

Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
We investigate efficient methods for training Large Language Models (LLMs) to possess capabilities in multiple specialized domains, such as coding, math reasoning and world knowledge. Our method, named Branch-Train-MiX (BTX), starts from a seed model, which is branched to train experts in embarrassingly parallel fashion with high throughput and reduced communication cost. After individual experts are asynchronously trained, BTX brings together their feedforward parameters as experts in Mixture-…

Speaking about events, I'll be representing #Perl at this new event / meetup next week in Vienna: https://www.meetup.com/codenugget-meetup/events/299856331/

SemHARQ: Semantic-Aware HARQ for Multi-task Semantic Communications
Jiangjing Hu, Fengyu Wang, Wenjun Xu, Hui Gao, Ping Zhang
https://arxiv.org/abs/2404.08490

SemHARQ: Semantic-Aware HARQ for Multi-task Semantic Communications
Intelligent task-oriented semantic communications (SemComs) have witnessed great progress with the development of deep learning (DL). In this paper, we propose a semantic-aware hybrid automatic repeat request (SemHARQ) framework for the robust and efficient transmissions of semantic features. First, to improve the robustness and effectiveness of semantic coding, a multi-task semantic encoder is proposed. Meanwhile, a feature importance ranking (FIR) method is investigated to ensure the importan…

Predicting the Energy Demand of a Hardware Video Decoder with Unknown Design Using Software Profiling
Matthias Kr\"anzler, Christian Herglotz, Andr\'e Kaup
https://arxiv.org/abs/2402.09926

Predicting the Energy Demand of a Hardware Video Decoder with Unknown Design Using Software Profiling
Energy efficiency for video communications and video-on-demand streaming is essential for mobile devices with a limited battery capacity. Therefore, hardware (HW) decoder implementations are commonly used to significantly reduce the energetic load of video playback. The energy consumption of such a HW implementation largely depends on a previously finalized standardization of a video codec that specifies which coding tools and methods are included in the new video codec. However, during the sta…

Simple and Efficient Quantization Techniques for Neural Speech Coding
Andreas Brendel, Nicola Pia, Kishan Gupta, Guillaume Fuchs, Markus Multrus
https://arxiv.org/abs/2405.08417 <…

As CS students experiment with AI coding tools, professors say courses need to focus less on syntax and more on problem solving, design, testing, and debugging (Rina Diane Caballar/IEEE Spectrum)
https://spectrum.ieee.org/ai-coding

AI Copilots Are Changing How Coding Is Taught

Professors are shifting away from syntax and emphasizing higher-level skills

Video Compression Beyond VVC: Quantitative Analysis of Intra Coding Tools in Enhanced Compression Model (ECM)
Mohsen Abdoli, Ramin G. Youvalari, Karam Naser, Kevin Reuz\'e, Fabrice Le L\'eannec
https://arxiv.org/abs/2404.07872

Video Compression Beyond VVC: Quantitative Analysis of Intra Coding Tools in Enhanced Compression Model (ECM)
A quantitative analysis of post-VVC luma and chroma intra tools is presented, focusing on their statistical behaviors, in terms of block selection rate under different conditions. The aim is to provide insights to the standardization community, offering a clearer understanding of interactions between tools and assisting in the design of an optimal combination of these novel tools when the JVET enters the standardization phase. Specifically, this paper examines the selection rate of intra tools …

Korvai experiment in Strudel https://strudel.cc/?pMQgZRfXV6Qf

Imagine a dragon made of seaweed: How images enhance learning in Wikipedia
Anita Silva, Maria Tracy, Katharina Reinecke, Eytan Adar, Miriam Redi
https://arxiv.org/abs/2403.07613 <…

Imagine a dragon made of seaweed: How images enhance learning in Wikipedia
Though images are ubiquitous across Wikipedia, it is not obvious that the image choices optimally support learning. When well selected, images can enhance learning by dual coding, complementing, or supporting articles. When chosen poorly, images can mislead, distract, and confuse. We developed a large dataset containing 470 questions & answers to 94 Wikipedia articles with images on a wide range of topics. Through an online experiment (n=704), we determined whether the images displayed alongsid…

This https://arxiv.org/abs/2403.07338 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csIT_…

D$^2$-JSCC: Digital Deep Joint Source-channel Coding for Semantic Communications
Semantic communications (SemCom) have emerged as a new paradigm for supporting sixth-generation applications, where semantic features of data are transmitted using artificial intelligence algorithms to attain high communication efficiencies. Most existing SemCom techniques utilize deep neural networks (DNNs) to implement analog source-channel mappings, which are incompatible with existing digital communication architectures. To address this issue, this paper proposes a novel framework of digita…

Altered grid-like coding in early blind people https://www.nature.com/articles/s41467-024-47747-x Early blind people have a square grid map instead of a hexagonal grid map for navigation in their entorhinal cortex;

Altered grid-like coding in early blind people - Nature Communications
The contribution of visual experience to the formation of cognitive maps in humans is not well understood. Here, the authors show using fMRI and an imagined navigation paradigm, that sighted people display hexagonal grid-like neural coding, while blind people show neural representations consistent with a square grid.

Count the red flags in this job offer. https://boards.greenhouse.io/outlier/jobs/4362304005
The (unsolicited) email said "Earn extra income in your spare time" which immediately made me think it was a pyramid marketing scheme. Yup: "you will get paid…

This https://arxiv.org/abs/2401.09484 has been replaced.
initial toot: https://mastoxiv.page/@ar…

Fail-Safe Quantum Chemical Calculations with Improved Machine-Learning Models
Easy and effective usage of computational resources is crucial for scientific calculations. Following our recent work of machine-learning (ML) assisted scheduling optimization [Ref: J. Comput. Chem. 2023, 44, 1174], we further propose 1) the improve ML models for the better predictions of computational loads, and as such, more elaborate load-balancing calculations can be expected; 2) the idea of coded computation, i.e. the integration of gradient coding, in order to introduce fault tolerance du…

Joint Source-and-Channel Coding for Small Satellite Applications
Olga Kondrateva, Stefan Dietzel, Bj\"orn Scheuermann
https://arxiv.org/abs/2403.06802

Joint Source-and-Channel Coding for Small Satellite Applications
Small satellites are widely used today as cost effective means to perform Earth observation and other tasks that generate large amounts of high-dimensional data, such as multi-spectral imagery. These satellites typically operate in low earth orbit, which poses significant challenges for data transmission due to short contact times with ground stations, low bandwidth, and high packet loss probabilities. In this paper, we introduce JSCC-Sat, which applies joint source-and-channel coding using neu…

Sharing this because its also a bit how my Thursday went. Hyggekoding (cosy coding? Fun coding?, doesn't translate well!) is when you get your teeth into a fun little programming problem.
Torsdags Trivsel translates literally as Thursday thriving or more like Thursday wellness.
https://norrebro.s…

YAFCC - Yet Another Free Code Companion
This one from NVIDIA, Hugging Face, ServiceNow
GitHub - bigcode-project/starcoder2: Home of StarCoder2!
#LLM #AI #Coding

coding, culture, people, communication
Cool thread of people's ideas about what's important to know!
#coding #culture #history #communication #teaching

5 Lessons I Learned From Making 100 Coding Tutorials https://www.youtube.com/watch?v=1C6FQOzDmjg

What are some techniques you use to get better at coding/programming? At 40, I feel like I take a lot of granted in my experience and retained knowledge. #code #development #software

SemHARQ: Semantic-Aware HARQ for Multi-task Semantic Communications
Jiangjing Hu, Fengyu Wang, Wenjun Xu, Hui Gao, Ping Zhang
https://arxiv.org/abs/2404.08490

SemHARQ: Semantic-Aware HARQ for Multi-task Semantic Communications
Intelligent task-oriented semantic communications (SemComs) have witnessed great progress with the development of deep learning (DL). In this paper, we propose a semantic-aware hybrid automatic repeat request (SemHARQ) framework for the robust and efficient transmissions of semantic features. First, to improve the robustness and effectiveness of semantic coding, a multi-task semantic encoder is proposed. Meanwhile, a feature importance ranking (FIR) method is investigated to ensure the importan…

Despite SQL injection being known for 20 years, it remains in OWASP's Top 10 due to developers' lack of experience in writing secure code. Experience in development doesn't equate to secure coding expertise. https://reddit.com/r/cybersecurity/comments/1baonq4/

Kernighan's Law II: Revenge of the Debugged
(I agree, @… !)
https://ioc.exchange/@shac/112391029055067523

A (Weakly) Polynomial Algorithm for AIVF Coding
Reza Hosseini Dolatabadi, Mordecai J. Golin, Arian Zamani
https://arxiv.org/abs/2405.06805 https://<…

From English to ASIC: Hardware Implementation with Large Language Model
Emil Goh, Maoyang Xiang, I-Chyn Wey, T. Hui Teo
https://arxiv.org/abs/2403.07039 ht…

From English to ASIC: Hardware Implementation with Large Language Model
In the realm of ASIC engineering, the landscape has been significantly reshaped by the rapid development of LLM, paralleled by an increase in the complexity of modern digital circuits. This complexity has escalated the requirements for HDL coding, necessitating a higher degree of precision and sophistication. However, challenges have been faced due to the less-than-optimal performance of modern language models in generating hardware description code, a situation further exacerbated by the scarc…

Deep Joint Source-Channel Coding for Efficient and Reliable Cross-Technology Communication
Shumin Yao, Xiaodong Xu, Hao Chen, Yaping Sun, Qinglin Zhao
https://arxiv.org/abs/2402.10072

Superdense Coding and Stabiliser Codes with Ising-coupled Entanglement
Abel Jansma
https://arxiv.org/abs/2404.06454 https://arxiv.org…

Superdense Coding and Stabiliser Codes with Ising-coupled Entanglement
A new class of quantum states is introduced by demanding that the computational measurement statistics approach the Boltzmann distribution of higher-order strongly coupled Ising models. The states, referred to as $n$-coupled states, are superpositions of even or odd parity $n$-qubit states, generalize Bell states, and form an orthonormal basis for the $n$-qubit Hilbert space. For any $n$, the states are maximally connected and locally maximally entangled. It is proven that the $n$-qubit W and G…

Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
Sainbayar Sukhbaatar, Olga Golovneva, Vasu Sharma, Hu Xu, Xi Victoria Lin, Baptiste Rozi\`ere, Jacob Kahn, Daniel Li, Wen-tau Yih, Jason Weston, Xian Li
https://arxiv.org/abs/2403.07816

Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
We investigate efficient methods for training Large Language Models (LLMs) to possess capabilities in multiple specialized domains, such as coding, math reasoning and world knowledge. Our method, named Branch-Train-MiX (BTX), starts from a seed model, which is branched to train experts in embarrassingly parallel fashion with high throughput and reduced communication cost. After individual experts are asynchronously trained, BTX brings together their feedforward parameters as experts in Mixture-…

Replit launches Code Repair, an AI agent to automatically fix coding errors, and Teams, which allows developers to collaborate in real time on software projects (Reed Albergotti/Semafor)
https://www.semafor.com/article/04/02/2024

Replit launches new product in race for AI coding assistants | Semafor
The startup is unveiling Replit Teams, which will allow developers to collaborate in real-time on software projects.

This https://arxiv.org/abs/2311.16396 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csSE_…

Toward Effective Secure Code Reviews: An Empirical Study of Security-Related Coding Weaknesses
Identifying security issues early is encouraged to reduce the latent negative impacts on software systems. Code review is a widely-used method that allows developers to manually inspect modified code, catching security issues during a software development cycle. However, existing code review studies often focus on known vulnerabilities, neglecting coding weaknesses, which can introduce real-world security issues that are more visible through code review. The practices of code reviews in identif…

Privacy in Cloud Computing through Immersion-based Coding
Haleh Hayati, Nathan van de Wouw, Carlos Murguia
https://arxiv.org/abs/2403.04485 https://…

Privacy in Cloud Computing through Immersion-based Coding
Cloud computing enables users to process and store data remotely on high-performance computers and servers by sharing data over the Internet. However, transferring data to clouds causes unavoidable privacy concerns. Here, we present a synthesis framework to design coding mechanisms that allow sharing and processing data in a privacy-preserving manner without sacrificing data utility and algorithmic performance. We consider the setup where the user aims to run an algorithm in the cloud using pri…

Video Compression Beyond VVC: Quantitative Analysis of Intra Coding Tools in Enhanced Compression Model (ECM)
Mohsen Abdoli, Ramin G. Youvalari, Karam Naser, Kevin Reuz\'e, Fabrice Le L\'eannec
https://arxiv.org/abs/2404.07872

Video Compression Beyond VVC: Quantitative Analysis of Intra Coding Tools in Enhanced Compression Model (ECM)
A quantitative analysis of post-VVC luma and chroma intra tools is presented, focusing on their statistical behaviors, in terms of block selection rate under different conditions. The aim is to provide insights to the standardization community, offering a clearer understanding of interactions between tools and assisting in the design of an optimal combination of these novel tools when the JVET enters the standardization phase. Specifically, this paper examines the selection rate of intra tools …

Korvai experiment in Strudel https://strudel.cc/?pMQgZRfXV6Qf

Molecular Arithmetic Coding (MAC) for Internet of Bio-Nano Things (IoBNT)
Melih \c{S}ahin, Beyza E. Ortlek, Ozgur B. Akan
https://arxiv.org/abs/2403.04672 …

Molecular Arithmetic Coding (MAC) for Internet of Bio-Nano Things (IoBNT)
Molecular Communication (MC) has emerged as a promising paradigm employing molecules to transfer information at the nano-scale. Unlike MC channel coding, MC source coding has remained mostly an unexplored area of research. In a recent paper, prefix source coding was introduced into the field, through an MC-adapted version of the Huffman Coding. In the context of MC source coding, this paper proposes the Molecular Arithmetic Coding (MAC) whose algorithmic implementation and code-structure is non…

Replit launches Code Repair, an AI agent to automatically fix coding errors, and Teams, which allows developers to collaborate in real time on software projects (Reed Albergotti/Semafor)
https://www.semafor.com/article/04/02/2024

Replit launches new product in race for AI coding assistants | Semafor
The startup is unveiling Replit Teams, which will allow developers to collaborate in real-time on software projects.

Customizable Avatars with Dynamic Facial Action Coded Expressions (CADyFACE) for Improved User Engagement
Megan A. Witherow, Crystal Butler, Winston J. Shields, Furkan Ilgin, Norou Diawara, Janice Keener, John W. Harrington, Khan M. Iftekharuddin
https://arxiv.org/abs/2403.07314

Customizable Avatars with Dynamic Facial Action Coded Expressions (CADyFACE) for Improved User Engagement
Customizable 3D avatar-based facial expression stimuli may improve user engagement in behavioral biomarker discovery and therapeutic intervention for autism, Alzheimer's disease, facial palsy, and more. However, there is a lack of customizable avatar-based stimuli with Facial Action Coding System (FACS) action unit (AU) labels. Therefore, this study focuses on (1) FACS-labeled, customizable avatar-based expression stimuli for maintaining subjects' engagement, (2) learning-based measurements tha…

CogDPM: Diffusion Probabilistic Models via Cognitive Predictive Coding
Kaiyuan Chen, Xingzhuo Guo, Yu Zhang, Jianmin Wang, Mingsheng Long
https://arxiv.org/abs/2405.02384

CogDPM: Diffusion Probabilistic Models via Cognitive Predictive Coding
Predictive Coding (PC) is a theoretical framework in cognitive science suggesting that the human brain processes cognition through spatiotemporal prediction of the visual world. Existing studies have developed spatiotemporal prediction neural networks based on the PC theory, emulating its two core mechanisms: Correcting predictions from residuals and hierarchical learning. However, these models do not show the enhancement of prediction skills on real-world forecasting tasks and ignore the Preci…

Superdense Coding and Stabiliser Codes with Ising-coupled Entanglement
Abel Jansma
https://arxiv.org/abs/2404.06454 https://arxiv.org…

Superdense Coding and Stabiliser Codes with Ising-coupled Entanglement
A new class of quantum states is introduced by demanding that the computational measurement statistics approach the Boltzmann distribution of higher-order strongly coupled Ising models. The states, referred to as $n$-coupled states, are superpositions of even or odd parity $n$-qubit states, generalize Bell states, and form an orthonormal basis for the $n$-qubit Hilbert space. For any $n$, the states are maximally connected and locally maximally entangled. It is proven that the $n$-qubit W and G…

🚀 Just dropped: Watch us build an image sharing app LIVE! From tweaking metadata to perfecting the share, we cover it all. Don't miss this coding journey! 📸✨ Catch the full episode here: https://youtu.be/U56WKjcpRG4

This https://arxiv.org/abs/2403.10751 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csIT_…

LIGHTCODE: Light Analytical and Neural Codes for Channels with Feedback
The design of reliable and efficient codes for channels with feedback remains a longstanding challenge in communication theory. While significant improvements have been achieved by leveraging deep learning techniques, neural codes often suffer from high computational costs, a lack of interpretability, and limited practicality in resource-constrained settings. We focus on designing low-complexity coding schemes that are interpretable and more suitable for communication systems. We advance both a…

This https://arxiv.org/abs/2307.15184 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_ees…

Sparsity aware coding for single photon sensitive vision using Selective Sensing
Optical coding is widely used in computational imaging systems and is a good approach for designing vision systems. However, most coding methods are developed assuming additive Gaussian noise, while modern optical imaging systems are mainly affected by Poisson noise. Previous studies have highlighted the significant differences between these noise models and proposed coding optimization algorithms for image recovery under Poisson noise. They concluded that the compressibility arising from data …

Source: Magic, which recently raised $117M and says its AI coding assistant has a larger context window than rivals', may have made an AI reasoning breakthrough (The Information)
https://www.theinformation.com/articles/th

The ‘Magic’ Breakthrough That Got Friedman and Gross to Bet $100 Million on a Coding Startup
Former GitHub CEO Nat Friedman and his investment partner, Daniel Gross, raised eyebrows last week by writing a $100 million check to Magic, the developer of an artificial intelligence coding assistant. There are loads of coding assistants already, and the top dog among them is Microsoft’s ...

This https://arxiv.org/abs/2303.14086 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csIT_…

Finite Field Multiple Access
In the past several decades, various techniques have been developed and used for multiple-access (MA) communications. With the new applications for 6G, it is desirable to find new resources, physical or virtual, to confront the fast development of MA communication systems. For binary source transmission, this paper proposes an element-pair (EP) coding scheme for supporting massive users with short packet traffic, which solves the finite block length of multiuser reliability transmission problem…

Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM
Chunqiu Steven Xia, Yinlin Deng, Lingming Zhang
https://arxiv.org/abs/2403.19114

Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM
LLMs have become the go-to choice for code generation tasks, with an exponential increase in the training, development, and usage of LLMs specifically for code generation. To evaluate the ability of LLMs on code, both academic and industry practitioners rely on popular handcrafted benchmarks. However, prior benchmarks contain only a very limited set of problems, both in quantity and variety. Further, due to popularity and age, many benchmarks are prone to data leakage where example solutions ca…

🌟 Still going strong on our live coding stream! It's not too late to join us as we develop an image sharing app with a twist. Dive into the action and bring your questions! 🚀💻 Tune in now: cwti.link/live #StillLive #CodingFun

The #emfcamp talk workshop schedule is looking excellent
https://www.emfcamp.org/schedule/2024
Happy to have a performance proposal accepted, which will feature some "auto live coding" (as in, …

D$^2$-JSCC: Digital Deep Joint Source-channel Coding for Semantic Communications
Jianhao Huang, Kai Yuan, Chuan Huang, Kaibin Huang
https://arxiv.org/abs/2403.07338

D$^2$-JSCC: Digital Deep Joint Source-channel Coding for Semantic Communications
Semantic communications (SemCom) have emerged as a new paradigm for supporting sixth-generation applications, where semantic features of data are transmitted using artificial intelligence algorithms to attain high communication efficiencies. Most existing SemCom techniques utilize deep neural networks (DNNs) to implement analog source-channel mappings, which are incompatible with existing digital communication architectures. To address this issue, this paper proposes a novel framework of digita…

Source: Cognition, which offers an AI coding assistant, raised $175M led by Founders Fund at a $2B valuation, a month after a Series A at a $350M valuation (Kate Clark/The Information)
https://www.theinformation.com/articles/si

Six-Month-Old AI Coding Startup Valued at $2 Billion by Founders Fund
The promise of a chatbot that can write and fix code has attracted repeat investments in a six-month-old startup—even after it appeared to flub its product launch. Founders Fund has led a $175 million investment in Cognition, a startup that recently launched an artificial intelligence–powered ...

Deep Network for Image Compressed Sensing Coding Using Local Structural Sampling
Wenxue Cui, Xingtao Wang, Xiaopeng Fan, Shaohui Liu, Xinwei Gao, Debin Zhao
https://arxiv.org/abs/2402.19111

Deep Network for Image Compressed Sensing Coding Using Local Structural Sampling
Existing image compressed sensing (CS) coding frameworks usually solve an inverse problem based on measurement coding and optimization-based image reconstruction, which still exist the following two challenges: 1) The widely used random sampling matrix, such as the Gaussian Random Matrix (GRM), usually leads to low measurement coding efficiency. 2) The optimization-based reconstruction methods generally maintain a much higher computational complexity. In this paper, we propose a new CNN based i…

This https://arxiv.org/abs/2311.07041 has been replaced.
link: https://scholar.google.com/scholar?q=a

Deep Joint Source Channel Coding With Attention Modules Over MIMO Channels
In this paper, we propose two deep joint source and channel coding (DJSCC) structures with attention modules for the multi-input multi-output (MIMO) channel, including a serial structure and a parallel structure. With singular value decomposition (SVD)-based precoding scheme, the MIMO channel can be decomposed into various sub-channels, and the feature outputs will experience sub-channels with different channel qualities. In the serial structure, one single network is used at both the transmitt…

🔴 We're LIVE NOW! 🚀 Dive into our live coding session as we craft an image sharing app, mastering image metadata manipulation along the way. Join the fun and learn with us! 📸✨ Tune in here: cwti.link/live #LiveCoding #AndroidDev

InfiCoder-Eval: Systematically Evaluating the Question-Answering Capabilities of Code Large Language Models
Linyi Li, Shijie Geng, Zhenwen Li, Yibo He, Hao Yu, Ziyue Hua, Guanghan Ning, Siwei Wang, Tao Xie, Hongxia Yang
https://arxiv.org/abs/2404.07940

InfiCoder-Eval: Systematically Evaluating the Question-Answering Capabilities of Code Large Language Models
Large Language Models for understanding and generating code (code LLMs) have witnessed tremendous progress in recent years. With the rapid development of code LLMs, many popular evaluation benchmarks, such as HumanEval, DS-1000, and MBPP, have emerged to measure the performance of code LLMs with a particular focus on code generation tasks. However, they are insufficient to cover the full range of expected capabilities of code LLMs, which span beyond code generation to answering diverse coding-r…

Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding
Eric Lei, Hamed Hassani, Shirin Saeedi Bidokhti
https://arxiv.org/abs/2403.07320

Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding
Neural compression has brought tremendous progress in designing lossy compressors with good rate-distortion (RD) performance at low complexity. Thus far, neural compression design involves transforming the source to a latent vector, which is then rounded to integers and entropy coded. While this approach has been shown to be optimal in a one-shot sense on certain sources, we show that it is highly sub-optimal on i.i.d. sequences, and in fact always recovers scalar quantization of the original s…

How GitHub Copilot became responsible for a significant percentage of coding, despite its limitations; Stack Overflow: 54.8% of developers used Copilot in 2023 (Bloomberg)
https://www.bloomberg.com/news/articles/20

Microsoft’s AI Copilot Is Starting to Automate the Coding Industry
The assistant is saving engineers hundreds of hours a month and is helping GitHub retain its edge over rivals including Amazon and Google.

🚀 Get ready for tonight's live coding adventure! 🛠️ We're building an image sharing app from scratch, with a twist on manipulating image metadata before sharing. 🎨💻 Tune in: cwti.link/live #LiveCoding #AndroidDev

Advanced Channel Coding Designs for Index-Modulated Fluid Antenna Systems
Elio Faddoul, Ghassan M. Kraidy, Constantinos Psomas, Ioannis Krikidis
https://arxiv.org/abs/2403.06839 <…

Advanced Channel Coding Designs for Index-Modulated Fluid Antenna Systems
The concept of fluid antennas (FAs) has emerged as a promising solution to enhance the spectral efficiency of wireless networks, achieved by introducing additional degrees of freedom, including reconfigurability and flexibility. In this paper, we investigate the use of index-modulated (IM) transmissions within the framework of FA systems, where an FA position is activated during each transmission interval. This approach is motivated by the common characteristics exhibited by FAs and IM transmis…

This https://arxiv.org/abs/2403.07338 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csIT_…

D$^2$-JSCC: Digital Deep Joint Source-channel Coding for Semantic Communications
Semantic communications (SemCom) have emerged as a new paradigm for supporting sixth-generation applications, where semantic features of data are transmitted using artificial intelligence algorithms to attain high communication efficiencies. Most existing SemCom techniques utilize deep neural networks (DNNs) to implement analog source-channel mappings, which are incompatible with existing digital communication architectures. To address this issue, this paper proposes a novel framework of digita…

IBM open sources its Granite code models for code generative tasks, trained on 116 programming languages, with models ranging in size from 3B to 34B parameters (Mike Murphy/IBM Research)
https://research.ibm.com/blog/granite-code-models-open-source

IBM’s Granite code model family is going open source
IBM is open sourcing family of Granite code models to make coding as easy as possible — for as many developers as possible.

IBM open sources its Granite code models for code generative tasks, trained on 116 programming languages, with models ranging in size from 3B to 34B parameters (Mike Murphy/IBM Research)
https://research.ibm.com/blog/granite-code-models-open-source

IBM’s Granite code model family is going open source
IBM is open sourcing family of Granite code models to make coding as easy as possible — for as many developers as possible.

This https://arxiv.org/abs/2401.16417 has been replaced.
link: https://scholar.google.com/scholar?q=a

Channel Coding with Mean and Variance Cost Constraints
We consider channel coding for discrete memoryless channels (DMCs) with a novel cost constraint that constrains both the mean and the variance of the cost of the codewords. We show that the maximum (asymptotically) achievable rate under the new cost formulation is equal to the capacity-cost function; in particular, the strong converse holds. We further characterize the optimal second-order coding rate of these cost-constrained codes; in particular, the optimal second-order coding rate is finite…

Error-Resilient Weakly Constrained Coding via Row-by-Row Coding
Prachi Mishra, Navin Kashyap
https://arxiv.org/abs/2404.18469 https://

Error-Resilient Weakly Constrained Coding via Row-by-Row Coding
A weakly constrained code is a collection of finite-length strings over a finite alphabet in which certain substrings or patterns occur according to some prescribed frequencies. Buzaglo and Siegel (ITW 2017) gave a construction of weakly constrained codes based on row-by-row coding, that achieved the capacity of the weak constraint. In this paper, we propose a method to make this row-by-row coding scheme resilient to errors.

This https://arxiv.org/abs/2109.00031 has been replaced.
link: https://scholar.google.com/scholar?q=a

Deep DNA Storage: Scalable and Robust DNA Storage via Coding Theory and Deep Learning
DNA-based storage is an emerging technology that enables digital information to be archived in DNA molecules. This method enjoys major advantages over magnetic and optical storage solutions such as exceptional information density, enhanced data durability, and negligible power consumption to maintain data integrity. To access the data, an information retrieval process is employed, where some of the main bottlenecks are the scalability and accuracy, which have a natural tradeoff between the two.…

This https://arxiv.org/abs/2309.06769 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csIT_…

Reliability-Latency-Rate Tradeoff in Low-Latency Communications with Finite-Blocklength Coding
Low-latency communication plays an increasingly important role in delay-sensitive applications by ensuring the real-time exchange of information. However, due to the constraints on the maximum instantaneous power, bounded latency is hard to be guaranteed. In this paper, we investigate the reliability-latency-rate tradeoff in low-latency communications with finite-blocklength coding (FBC). More specifically, we are interested in the fundamental tradeoff between error probability, delay-violation…

This https://arxiv.org/abs/2309.06769 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csIT_…

Reliability-Latency-Rate Tradeoff in Low-Latency Communications with Finite-Blocklength Coding
Low-latency communication plays an increasingly important role in delay-sensitive applications by ensuring the real-time exchange of information. However, due to the constraints on the maximum instantaneous power, bounded latency is hard to be guaranteed. In this paper, we investigate the reliability-latency-rate tradeoff in low-latency communications with finite-blocklength coding (FBC). More specifically, we are interested in the fundamental tradeoff between error probability, delay-violation…

This https://arxiv.org/abs/2309.00470 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csIT_…

Deep Joint Source-Channel Coding for Adaptive Image Transmission over MIMO Channels
This paper introduces a vision transformer (ViT)-based deep joint source and channel coding (DeepJSCC) scheme for wireless image transmission over multiple-input multiple-output (MIMO) channels, denoted as DeepJSCC-MIMO. We consider DeepJSCC-MIMO for adaptive image transmission in both open-loop and closed-loop MIMO systems. The novel DeepJSCC-MIMO architecture surpasses the classical separation-based benchmarks with robustness to channel estimation errors and showcases remarkable flexibility i…