Tootfinder

RT-Sketch: Goal-Conditioned Imitation Learning from Hand-Drawn Sketches
Priya Sundaresan, Quan Vuong, Jiayuan Gu, Peng Xu, Ted Xiao, Sean Kirmani, Tianhe Yu, Michael Stark, Ajinkya Jain, Karol Hausman, Dorsa Sadigh, Jeannette Bohg, Stefan Schaal
https://arxiv.org/abs/2403.02709

RT-Sketch: Goal-Conditioned Imitation Learning from Hand-Drawn Sketches
Natural language and images are commonly used as goal representations in goal-conditioned imitation learning (IL). However, natural language can be ambiguous and images can be over-specified. In this work, we propose hand-drawn sketches as a modality for goal specification in visual imitation learning. Sketches are easy for users to provide on the fly like language, but similar to images they can also help a downstream policy to be spatially-aware and even go beyond images to disambiguate task-…

It wasn’t so long ago that the uneven distribution of wealth had distributed itself somewhat evenly across the Mountain West:
Jackson Hole, Wyoming; Sun Valley, Idaho; Telluride, Colorado.
But as Nick Bowlin sketches out in this Harper’s feature, nothing quite stacks up to Big Sky, Montana.
A private resort socked away above the town counts numerous billionaires among its members,
and even down below the average home price clocks in at $2.5 million.
Boom times f…

This weekend it's "days of open atelier" in Brandenburg country. We've visited the wonderful place of Silke Schmidt. It's quite magical #Uckermark

This https://arxiv.org/abs/2402.15953 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csDB_…

Convolution and Cross-Correlation of Count Sketches Enables Fast Cardinality Estimation of Multi-Join Queries
With the increasing rate of data generated by critical systems, estimating functions on streaming data has become essential. This demand has driven numerous advancements in algorithms designed to efficiently query and analyze one or more data streams while operating under memory constraints. The primary challenge arises from the rapid influx of new items, requiring algorithms that enable efficient incremental processing of streams in order to keep up. A prominent algorithm in this domain is the…

🔊 #NowPlaying on BBCRadio3's #ThroughTheNight
Claude Debussy, BBC Scottish Symphony Orchestra & Ilan Volkov:
🎵 La mer - three symphonic sketches (1902-05)
#ClaudeDebussy #BBCScottishSymphonyOrchestra #IlanVolkov

Sketches and Classifying Logoi
Ivan Di Liberti, Gabriele Lobbia
https://arxiv.org/abs/2403.09264 https://arxiv.org/pdf/2403.09264

Sketches and Classifying Logoi
Inspired by the theory of classifying topoi for geometric theories, we define rounded sketches and logoi and provide the notion of classifying logos for a rounded sketch. Rounded sketches can be used to axiomatise all the known fragments of infinitary first order logic in $\mathbf{L}_{\infty,\infty}$, in a spectrum ranging from weaker than finitary algebraic to stronger than $λ$-geometric for $λ$ a regular cardinal. We show that every rounded sketch has an associated classifying logos, having…

I had fun making these sketches for a #godotengine tutorial I'm writing for the #JetBrains guide. I think they came out pretty good. What do you folks think? #dotnet

Genie, a foundation world model trained from Internet videos that can generate an endless variety of playable (action-controllable) worlds from synthetic images, photographs, and even sketches.
https://sites.google.com/view/genie-2024/home

🧞 Genie: Generative Interactive Environments
A Foundation Model for Playable Worlds

weekend read-in: the debut issue of dummy, dedicated to the art & oral history of pee wee's playhouse. absolutely inspiring to hear how paul reubens ran the show, making space for gary panter & other weirdo artists to essentially rewrite/redraw the folk iconography of children's television for a new generation. consider myself blessed for being the exact right age when it debuted. excited for dummy #2, too, about air pirates funnies.

dummy zine
A new quarterly zine by comics historian and writer John Kelly. Each issue of dummy will focus on a different subject. Kelly has been a regular...

#SilentSunday

Sketch-to-Architecture: Generative AI-aided Architectural Design
Pengzhi Li, Baijuan Li, Zhiheng Li
https://arxiv.org/abs/2403.20186 https://

Sketch-to-Architecture: Generative AI-aided Architectural Design
Recently, the development of large-scale models has paved the way for various interdisciplinary research, including architecture. By using generative AI, we present a novel workflow that utilizes AI models to generate conceptual floorplans and 3D models from simple sketches, enabling rapid ideation and controlled generation of architectural renderings based on textual descriptions. Our work demonstrates the potential of generative AI in the architectural design process, pointing towards a new d…

We have a total success: able to upload sketches from the Arduino IDE to the breadboard ATMEGA328P running `minicore`. Fuses were set correctly, and absolutely no issues whatsoever after fixing the whole programming/burn issue. #arduino #electronics

If you like #F1 you should subscribe to Lollipopman F1 Comics YouTube Channel. A masterpiece after every race. 🙂
https://www.youtube.com/@lollipopmancomics

Lollipopman F1 Comics
3D animated comic sketches dedicated to all the action in the world of Formula 1, on and off track.

#Trump
Via 𝕊𝕦𝕟𝕕𝕒𝕖_𝔻𝕚𝕧𝕚𝕟𝕖 @SundaeDivine
·
21h
These courtroom sketches are off the leash.

"Those finds cast #LaMarmotta as a thriving farming community. Gibaja & colleagues' new analysis of the 5 #canoes shows how that trade could have been made possible with the townspeople's sophisticated ship-building skills.
The canoes were built from hollowed-out trees, which grew be…

7,000-Year-Old Sunken Boats Reveal How Neolithic Seafarers Traversed The Mediterranean
There's a large part of human history hidden beneath the sea.

Sampling Space-Saving Set Sketches
Homin K. Lee, Charles Masson
https://arxiv.org/abs/2402.08604 https://arxiv.org/pdf/2402.08604

Sampling Space-Saving Set Sketches
Large, distributed data streams are now ubiquitous. High-accuracy sketches with low memory overhead have become the de facto method for analyzing this data. For instance, if we wish to group data by some label and report the largest counts using fixed memory, we need to turn to mergeable heavy hitter sketches that can provide highly accurate approximate counts. Similarly, if we wish to keep track of the number of distinct items in a single set spread across several streams using fixed memory, w…

I had fun making these sketches for a #godotengine tutorial I'm writing for the #JetBrains guide. I think they came out pretty good. What do you folks think? #dotnet

Convolution and Cross-Correlation of Count Sketches Enables Fast Cardinality Estimation of Multi-Join Queries
Mike Heddes, Igor Nunes, Tony Givargis, Alex Nicolau
https://arxiv.org/abs/2402.15953

Convolution and Cross-Correlation of Count Sketches Enables Fast Cardinality Estimation of Multi-Join Queries
With the increasing rate of data generated by critical systems, estimating functions on streaming data has become essential. This demand has driven numerous advancements in algorithms designed to efficiently query and analyze one or more data streams while operating under memory constraints. The primary challenge arises from the rapid influx of new items, requiring algorithms that enable efficient incremental processing of streams in order to keep up. A prominent algorithm in this domain is the…

The #SuperbOwl, c'est chouette.
Source: https://gallica.bnf.fr/ark:/12148/bpt6k5413801b#

Les Trois règnes de la nature : lectures d'histoire naturelle / recueil publié sous la direction du Dr J.-C. Chenu
Les Trois règnes de la nature : lectures d'histoire naturelle / recueil publié sous la direction du Dr J.-C. Chenu -- 1864-11-26 -- fascicules

Can we just give Boyan Salat a Nobel Prize already? A decade ago his Ocean Cleanup plans to tackle the 5 largest oceanic garbage patches - and the 1,000 rivers that feed most plastics into oceans - were just sketches. Now there are ops all over the world, extracting or intercepting *massive* amounts of plastics (the statistics and visuals in this video are stunning). It's some of the most effective environmental protection work being done anywhere.

William Whitworth, who wrote revealing profiles in The New Yorker before working as the EIC at The Atlantic from 1980 to 1999, died on March 8 at age 87 (Sam Roberts/New York Times)
https://www.nytimes.com/2024/03/09/…

William Whitworth, Revered Writer and Editor, Is Dead at 87
After writing memorable character sketches and fine-tuning others’ copy at The New Yorker, he spent two decades as editor in chief of The Atlantic Monthly.

lately I just go through old drafts/sketches and try to finish them tho...

Des croquis comme support de raisonnement et de changement de registres
D Grenier (UGA), C Menini (UB), P S\'en\'echaud (UNILIM), F Vandebrouck (UPCit\'e), La Ciiu
https://arxiv.org/abs/2404.11626

Des croquis comme support de raisonnement et de changement de registres
We are convinced of the usefulness of sketches and diagrams during mathematical work but the observation is made in our practices that they are not spontaneously used by students. In order to study the understanding and use of sketches by mathematics students, we designed and then proposed a test at different university levels. The test consists of five exercises.The first concerns different representation registers of a set of numbers, the second on a graphic proof of an implicative algebraic …

🔊 #NowPlaying on BBCRadio3's #ThroughTheNight
Mikhail Mikhaylovich Ippolitov-Ivanov, Edmonton Symphony Orchestra & Uri Mayer:
🎵 Caucasian Sketches - orchestral suite (Op.10)
#MikhailMikhaylovichIppolitovIvanov
https://open.spotify.com/track/0pmPPS3S6VaEa5JTE4YsdW

Block and Detail: Scaffolding Sketch-to-Image Generation
Vishnu Sarukkai, Lu Yuan, Mia Tang, Maneesh Agrawala, Kayvon Fatahalian
https://arxiv.org/abs/2402.18116

Block and Detail: Scaffolding Sketch-to-Image Generation
We introduce a novel sketch-to-image tool that aligns with the iterative refinement process of artists. Our tool lets users sketch blocking strokes to coarsely represent the placement and form of objects and detail strokes to refine their shape and silhouettes. We develop a two-pass algorithm for generating high-fidelity images from such sketches at any point in the iterative process. In the first pass we use a ControlNet to generate an image that strictly follows all the strokes (blocking and …

Fourier Transform-based Estimators for Data Sketches
Seth Pettie, Dingyu Wang
https://arxiv.org/abs/2403.15366 https://arxiv.org/pdf/…

Fourier Transform-based Estimators for Data Sketches
In this paper we consider the problem of estimating the $f$-moment ($\sum_{v\in [n]} (f(\mathbf{x}(v))-f(0))$) of a dynamic vector $\mathbf{x}\in \mathbb{G}^n$ over some abelian group $(\mathbb{G},+)$, where the $\|f\|_\infty$ norm is bounded. We propose a simple sketch and new estimation framework based on the \emph{Fourier transform} of $f$. I.e., we decompose $f$ into a linear combination of homomorphisms $f_1,f_2,\ldots$ from $(\mathbb{G},+)$ to $(\mathbb{C},\times)$, estimate the…

Proof of concept for Clive Thompson's @… delightful "Weird Old Book Finder"
https://weird-old-book-finder.glitch.me/

Okay, the next step in this whole badge thing will be me making a custom Arduino board that is powered off of a LiPo battery along with charging said battery when the board is plugged in via USB. I'll also need to integrate the FT230X chip so sketches can be uploaded, and be able to burn the Atmel chip after it's soldered to the board. However, if I can nail this part, combining this with the LED Matrix should be fairly straightforward.

More silly skeletons…
#art #mastoArt #sketches #skeleton

This https://arxiv.org/abs/2403.12465 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csRO_…

Diagrammatic Instructions to Specify Spatial Objectives and Constraints with Applications to Mobile Base Placement
This paper introduces Spatial Diagrammatic Instructions (SDIs), an approach for human operators to specify objectives and constraints that are related to spatial regions in the working environment. Human operators are enabled to sketch out regions directly on camera images that correspond to the objectives and constraints. These sketches are projected to 3D spatial coordinates, and continuous Spatial Instruction Maps (SIMs) are learned upon them. These maps can then be integrated into optimizat…

(that anemone one was one of my older sketches too... lol)

Proof of concept for Clive Thompson's @… delightful "Weird Old Book Finder"
https://weird-old-book-finder.glitch.me/

This https://arxiv.org/abs/2310.04357 has been replaced.
link: https://scholar.google.com/scholar?q=a

Asymptotically free sketched ridge ensembles: Risks, cross-validation, and tuning
We employ random matrix theory to establish consistency of generalized cross validation (GCV) for estimating prediction risks of sketched ridge regression ensembles, enabling efficient and consistent tuning of regularization and sketching parameters. Our results hold for a broad class of asymptotically free sketches under very mild data assumptions. For squared prediction risk, we provide a decomposition into an unsketched equivalent implicit ridge bias and a sketching-based variance, and prove…

This https://arxiv.org/abs/2305.05031 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_mat…

Fast randomized algorithms for computing the generalized tensor SVD based on the tubal product
This work deals with developing two fast randomized algorithms for computing the generalized tensor singular value decomposition (GTSVD) based on the tubal product (t-product). The random projection method is utilized to compute the important actions of the underlying data tensors and use them to get small sketches of the original data tensors, which are easier to be handled. Due to the small size of the sketch tensors, deterministic approaches are applied to them to compute their GTSVDs. Then,…

This https://arxiv.org/abs/2311.05479 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_ees…

Retinal OCT Synthesis with Denoising Diffusion Probabilistic Models for Layer Segmentation
Modern biomedical image analysis using deep learning often encounters the challenge of limited annotated data. To overcome this issue, deep generative models can be employed to synthesize realistic biomedical images. In this regard, we propose an image synthesis method that utilizes denoising diffusion probabilistic models (DDPMs) to automatically generate retinal optical coherence tomography (OCT) images. By providing rough layer sketches, the trained DDPMs can generate realistic circumpapilla…

SmartControl: Enhancing ControlNet for Handling Rough Visual Conditions
Xiaoyu Liu, Yuxiang Wei, Ming Liu, Xianhui Lin, Peiran Ren, Xuansong Xie, Wangmeng Zuo
https://arxiv.org/abs/2404.06451

SmartControl: Enhancing ControlNet for Handling Rough Visual Conditions
Human visual imagination usually begins with analogies or rough sketches. For example, given an image with a girl playing guitar before a building, one may analogously imagine how it seems like if Iron Man playing guitar before Pyramid in Egypt. Nonetheless, visual condition may not be precisely aligned with the imaginary result indicated by text prompt, and existing layout-controllable text-to-image (T2I) generation models is prone to producing degraded generated results with obvious artifacts…

This https://arxiv.org/abs/2306.06088 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csGR_…

SENS: Part-Aware Sketch-based Implicit Neural Shape Modeling
We present SENS, a novel method for generating and editing 3D models from hand-drawn sketches, including those of abstract nature. Our method allows users to quickly and easily sketch a shape, and then maps the sketch into the latent space of a part-aware neural implicit shape architecture. SENS analyzes the sketch and encodes its parts into ViT patch encoding, subsequently feeding them into a transformer decoder that converts them to shape embeddings suitable for editing 3D neural implicit sha…

Diagrammatic Instructions to Specify Spatial Objectives and Constraints with Applications to Mobile Base Placement
Qilin Sun, Weiming Zhi, Tianyi Zhang, Matthew Johnson-Roberson
https://arxiv.org/abs/2403.12465

Diagrammatic Instructions to Specify Spatial Objectives and Constraints with Applications to Mobile Base Placement
This paper introduces Spatial Diagrammatic Instructions (SDIs), an approach for human operators to specify objectives and constraints that are related to spatial regions in the working environment. Human operators are enabled to sketch out regions directly on camera images that correspond to the objectives and constraints. These sketches are projected to 3D spatial coordinates, and continuous Spatial Instruction Maps (SIMs) are learned upon them. These maps can then be integrated into optimizat…

VISION2UI: A Real-World Dataset with Layout for Code Generation from UI Designs
Yi Gui, Zhen Li, Yao Wan, Yemin Shi, Hongyu Zhang, Yi Su, Shaoling Dong, Xing Zhou, Wenbin Jiang
https://arxiv.org/abs/2404.06369

VISION2UI: A Real-World Dataset with Layout for Code Generation from UI Designs
Automatically generating UI code from webpage design visions can significantly alleviate the burden of developers, enabling beginner developers or designers to directly generate Web pages from design diagrams. Currently, prior research has accomplished the objective of generating UI code from rudimentary design visions or sketches through designing deep neural networks. Inspired by the groundbreaking advancements achieved by Multimodal Large Language Models (MLLMs), the automatic generation of …

I made some silly skeleton sketches during the lulls today…
#art #mastoArt #sketch #skeletons

🔊 #NowPlaying on BBCRadio3's #ThroughTheNight
Claude Debussy, BBC Philharmonic & Yan Pascal Tortelier:
🎵 La Mer - 3 symphonic sketches for orchestra
#ClaudeDebussy #BBCPhilharmonic #YanPascalTortelier

This https://arxiv.org/abs/2310.04357 has been replaced.
link: https://scholar.google.com/scholar?q=a

Asymptotically free sketched ridge ensembles: Risks, cross-validation, and tuning
We employ random matrix theory to establish consistency of generalized cross validation (GCV) for estimating prediction risks of sketched ridge regression ensembles, enabling efficient and consistent tuning of regularization and sketching parameters. Our results hold for a broad class of asymptotically free sketches under very mild data assumptions. For squared prediction risk, we provide a decomposition into an unsketched equivalent implicit ridge bias and a sketching-based variance, and prove…

Better space-time-robustness trade-offs for set reconciliation
Djamal Belazzougui, Gregory Kucherov, Stefan Walzer
https://arxiv.org/abs/2404.09607 https:/…

Better space-time-robustness trade-offs for set reconciliation
We consider the problem of reconstructing the symmetric difference between similar sets from their representations (sketches) of size linear in the number of differences. Exact solutions to this problem are based on error-correcting coding techniques and suffer from a large decoding time. Existing probabilistic solutions based on Invertible Bloom Lookup Tables (IBLTs) are time-efficient but offer insufficient success guarantees for many applications. Here we propose a tunable trade-off between …

🔊 #NowPlaying on BBCRadio3's #Breakfast
Harry Burleigh, Calefax Reed Quintet & Jelte Althuis:
🎵 Southland sketches (Nos 3 & 4) arr. for wind quintet
#HarryBurleigh #CalefaxReedQuintet #JelteAlthuis