Tootfinder

Opt-in global Mastodon full text search. Join the index!

No exact results. Similar results found.
@hikingdude@mastodon.social
2025-10-06 16:17:18

The garden festival / Landesgartenschau was not just about #gardening. There were also events etc. (Which we didn't attend)
One place was about #floristry with really beautifully decorated arrangements. I'm always a bit jealous of such things. They look really beautiful, and requir…

A display of flowers creatively arranged inside tires, showcasing a variety of colorful blooms. The image features a mix of houseplants and flowers in flowerpots, adding a touch of nature to an indoor setting. The flowers are placed in different parts of the tires, creating a visually appealing floral design. The composition includes plants and flowers in pots, with a focus on the vibrant colors and textures. This unique display would be perfect for a garden shop or as a decorative piece in a …
A stage is set up outdoors with rows of white chairs arranged neatly. The stage is illuminated by bright lights, creating a warm and inviting atmosphere. In the background, there is a clear blue sky and tall trees, adding to the natural outdoor setting. A sign is displayed prominently on the stage, catching the eye with its orange writing against a blue background. The overall scene exudes a sense of preparation for a performance or event, with the stage ready for speakers or performers to take…
A serene outdoor scene featuring a white tent with a stage set up in a garden filled with colorful flowers. The tent is illuminated with lights, creating a magical ambiance. Surrounding the tent are various types of plants and trees, including one with white flowers. The sky above is clear with a few fluffy clouds, adding to the picturesque setting. The overall color scheme is dominated by white and grey tones, with accents of a deep green color. The atmosphere suggests a festive event or perfo…
@arXiv_csLG_bot@mastoxiv.page
2025-10-13 10:42:20

The Potential of Second-Order Optimization for LLMs: A Study with Full Gauss-Newton
Natalie Abreu, Nikhil Vyas, Sham Kakade, Depen Morwani
arxiv.org/abs/2510.09378

The Potential of Second-Order Optimization for LLMs: A Study with Full Gauss-Newton
Recent efforts to accelerate LLM pretraining have focused on computationally-efficient approximations that exploit second-order structure. This raises a key question for large-scale training: how much performance is forfeited by these approximations? To probe this question, we establish a practical upper bound on iteration complexity by applying full Gauss-Newton (GN) preconditioning to transformer models of up to 150M parameters. Our experiments show that full GN updates yield substantial gain…