Tootfinder

@… different objectives lead to different affordances. I'd be very curious to see https://yrpri.org/ joining the fediverse

Supporting Annotators with Affordances for Efficiently Labeling Conversational Data
Austin Z. Henley, David Piorkowski
https://arxiv.org/abs/2403.07762 htt…

Supporting Annotators with Affordances for Efficiently Labeling Conversational Data
Without well-labeled ground truth data, machine learning-based systems would not be as ubiquitous as they are today, but these systems rely on substantial amounts of correctly labeled data. Unfortunately, crowdsourced labeling is time consuming and expensive. To address the concerns of effort and tedium, we designed CAL, a novel interface to aid in data labeling. We made several key design decisions for CAL, which include preventing inapt labels from being selected, guiding users in selecting a…

This https://arxiv.org/abs/2309.10426 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csRO_…

Multi-Object Graph Affordance Network: Goal-Oriented Planning through Learned Compound Object Affordances
Learning object affordances is an effective tool in the field of robot learning. While the data-driven models investigate affordances of single or paired objects, there is a gap in the exploration of affordances of compound objects composed of an arbitrary number of objects. We propose the Multi-Object Graph Affordance Network which models complex compound object affordances by learning the outcomes of robot actions that facilitate interactions between an object and a compound. Given the depth …

imho, this image - the MAU curve of lemmy is the big news on the #fediverse. While also #mastodon and other platforms experienced peaks last summer, #lemmy is the only one that is consistently on the rise in 2024. Arguably, this is thanks to particular #affordances, like the fact that older posts of wider appreciation do not get overwhelmed in feeds.
More charts at https://fedidb.org

Behavioral Manifolds: Representing the Landscape of Grasp Affordances in the Relative Pose Space
Michael Zechmair, Yannick Morel
https://arxiv.org/abs/2405.04188

Behavioral Manifolds: Representing the Landscape of Grasp Affordances in the Relative Pose Space
The use of machine learning to investigate grasp affordances has received extensive attention over the past several decades. The existing literature provides a robust basis to build upon, though a number of aspects may be improved. Results commonly work in terms of grasp configuration, with little consideration for the manner in which the grasp may be (re-)produced from a reachability and trajectory planning perspective. In addition, the majority of existing learning approaches focus of produci…

Re this important thread from @…:
https://mastodon.social/@grimalkina/111972810596703896
I just gave a little soapbox to …

The feature that I'm most surprised hasn't really made it to web browsers at scale is "Window Management". We get multiple windows, but where your links *go* when you click in other apps is unpredictable (often 'last focused' -- bad!), and theres no affordances to make it feel like PWAs are part of the same 'flow', etc.

Towards AI Safety: A Taxonomy for AI System Evaluation
Boming Xia, Qinghua Lu, Liming Zhu, Zhenchang Xing
https://arxiv.org/abs/2404.05388 https://<…

Towards AI Safety: A Taxonomy for AI System Evaluation
The advent of advanced AI brings to the forefront the need for comprehensive safety evaluation. However, divergent practices and terminologies across different communities (i.e., AI, software engineering, and governance), combined with the complexity of AI systems and environmental affordances (e.g., access to tools), call for a holistic evaluation approach. This paper proposes a framework for comprehensive AI system evaluation comprising three components: 1) harmonised terminology to facilitat…

Contextual Affordances for Safe Exploration in Robotic Scenarios
William Z. Ye, Eduardo B. Sandoval, Pamela Carreno-Medrano, Francisco Cru
https://arxiv.org/abs/2405.06422

Data Cubes in Hand: A Design Space of Tangible Cubes for Visualizing 3D Spatio-Temporal Data in Mixed Reality
Shuqi He, Haonan Yao, Luyan Jiang, Kaiwen Li, Nan Xiang, Yue Li, Hai-Ning Liang, Lingyun Yu
https://arxiv.org/abs/2403.06891

Data Cubes in Hand: A Design Space of Tangible Cubes for Visualizing 3D Spatio-Temporal Data in Mixed Reality
Tangible interfaces in mixed reality (MR) environments allow for intuitive data interactions. Tangible cubes, with their rich interaction affordances, high maneuverability, and stable structure, are particularly well-suited for exploring multi-dimensional data types. However, the design potential of these cubes is underexplored. This study introduces a design space for tangible cubes in MR, focusing on interaction space, visualization space, sizes, and multiplicity. Using spatio-temporal data, …

man i hate that he's posting over there now. the time in nov-dec '22 where he was posting multiple times a day explaining what a platform's affordances are and how it shapes the kind of people drawn to a platform were incredibly enlightening.
fully understand it though.

‘I observed that there was a “Rashomon-like” quality to the sequence of events: it was hard for people to have fully shared perspectives on the arc of the “controversy.” Unlike on Twitter, affordances inhibited searching for posts except the ones that were tagged (…). Decentralization simply worked against anyone who tried to follow arc of the conflict from beginning to end.’

Behavioral analysis in immersive learning environments: A systematic literature review and research agenda
Yu Liu, Kang Yue, Yue Liu
https://arxiv.org/abs/2405.03442

Behavioral analysis in immersive learning environments: A systematic literature review and research agenda
The rapid growth of immersive technologies in educational areas has increased research interest in analyzing the specific behavioral patterns of learners in immersive learning environments. Considering the fact that research on the technical affordances of immersive technologies and the pedagogical affordances of behavioral analysis remains fragmented, this study first contributes by developing a conceptual framework that amalgamates learning requirements, specification, evaluation, and iterati…

Behavioral analysis in immersive learning environments: A systematic literature review and research agenda
Yu Liu, Kang Yue, Yue Liu
https://arxiv.org/abs/2405.03442

Behavioral analysis in immersive learning environments: A systematic literature review and research agenda
The rapid growth of immersive technologies in educational areas has increased research interest in analyzing the specific behavioral patterns of learners in immersive learning environments. Considering the fact that research on the technical affordances of immersive technologies and the pedagogical affordances of behavioral analysis remains fragmented, this study first contributes by developing a conceptual framework that amalgamates learning requirements, specification, evaluation, and iterati…

This https://arxiv.org/abs/2310.07545 has been replaced.
link: https://scholar.google.com/scholar?q=a

Large-Language-Model-Powered Agent-Based Framework for Misinformation and Disinformation Research: Opportunities and Open Challenges
This article presents the affordances that Generative Artificial Intelligence can have in misinformation and disinformation contexts, major threats to our digitalized society. We present a research framework to generate customized agent-based social networks for disinformation simulations that would enable understanding and evaluating the phenomena whilst discussing open challenges.

Preserving Nature's Ledger: Blockchains in Biodiversity Conservation
Kostas Kryptos Chalkias, Angelos Kostis, Ali Alnuaimi, Peter Knez, John Naulty, Allen Salmasi, Ryan Servatius, Rodrigo Veloso
https://arxiv.org/abs/2404.12086

Preserving Nature's Ledger: Blockchains in Biodiversity Conservation
In the contemporary era, biodiversity conservation emerges as a paramount challenge, necessitating innovative approaches to monitoring, preserving, and enhancing the natural world. This paper explores the integration of blockchain technology in biodiversity conservation, offering a novel perspective on how digital resilience can be built within ecological contexts. Blockchain, with its decentralized and immutable ledger and tokenization affordances, presents a groundbreaking solution for the ac…

This https://arxiv.org/abs/2311.12015 has been replaced.
link: https://scholar.google.com/scholar?q=a

GPT-4V(ision) for Robotics: Multimodal Task Planning from Human Demonstration
We introduce a pipeline that enhances a general-purpose Vision Language Model, GPT-4V(ision), to facilitate one-shot visual teaching for robotic manipulation. This system analyzes videos of humans performing tasks and outputs executable robot programs that incorporate insights into affordances. The process begins with GPT-4V analyzing the videos to obtain textual explanations of environmental and action details. A GPT-4-based task planner then encodes these details into a symbolic task plan. Su…

MOKA: Open-Vocabulary Robotic Manipulation through Mark-Based Visual Prompting
Fangchen Liu, Kuan Fang, Pieter Abbeel, Sergey Levine
https://arxiv.org/abs/2403.03174

MOKA: Open-Vocabulary Robotic Manipulation through Mark-Based Visual Prompting
Open-vocabulary generalization requires robotic systems to perform tasks involving complex and diverse environments and task goals. While the recent advances in vision language models (VLMs) present unprecedented opportunities to solve unseen problems, how to utilize their emergent capabilities to control robots in the physical world remains an open question. In this paper, we present MOKA (Marking Open-vocabulary Keypoint Affordances), an approach that employs VLMs to solve robotic manipulatio…

Preserving Nature's Ledger: Blockchains in Biodiversity Conservation
Kostas Kryptos Chalkias, Angelos Kostis, Ali Alnuaimi, Peter Knez, John Naulty, Allen Salmasi, Ryan Servatius, Rodrigo Veloso
https://arxiv.org/abs/2404.12086

Preserving Nature's Ledger: Blockchains in Biodiversity Conservation
In the contemporary era, biodiversity conservation emerges as a paramount challenge, necessitating innovative approaches to monitoring, preserving, and enhancing the natural world. This paper explores the integration of blockchain technology in biodiversity conservation, offering a novel perspective on how digital resilience can be built within ecological contexts. Blockchain, with its decentralized and immutable ledger and tokenization affordances, presents a groundbreaking solution for the ac…

This https://arxiv.org/abs/2312.11576 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csHC_…

Emotion Based Prediction in the Context of Optimized Trajectory Planning for Immersive Learning
In the virtual elements of immersive learning, the use of Google Expedition and touch-screen-based emotion are examined. The objective is to investigate possible ways to combine these technologies to enhance virtual learning environments and learners emotional engagement. Pedagogical application, affordances, and cognitive load are the corresponding measures that are involved. Students will gain insight into the reason behind their significantly higher post-assessment Prediction Systems scores …

Toward Improving Binary Program Comprehension via Embodied Immersion: A Survey
Dennis Brown, Emily Mulder, Samuel Mulder
https://arxiv.org/abs/2404.17051 h…

Toward Improving Binary Program Comprehension via Embodied Immersion: A Survey
Binary program comprehension is critical for many use cases but is difficult, suffering from compounded uncertainty and lack of full automation. We seek methods to improve the effectiveness of the human-machine joint cognitive system performing binary PC. We survey three research areas to perform an indirect cognitive task analysis: cognitive models of the PC process, related elements of cognitive theory, and applicable affordances of virtual reality. Based on common elements in these areas, we…

ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Models
Siyuan Huang, Iaroslav Ponomarenko, Zhengkai Jiang, Xiaoqi Li, Xiaobin Hu, Peng Gao, Hongsheng Li, Hao Dong
https://arxiv.org/abs/2403.11289

ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Models
The integration of Multimodal Large Language Models (MLLMs) with robotic systems has significantly enhanced the ability of robots to interpret and act upon natural language instructions. Despite these advancements, conventional MLLMs are typically trained on generic image-text pairs, lacking essential robotics knowledge such as affordances and physical knowledge, which hampers their efficacy in manipulation tasks. To bridge this gap, we introduce ManipVQA, a novel framework designed to endow ML…

ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Models
Siyuan Huang, Iaroslav Ponomarenko, Zhengkai Jiang, Xiaoqi Li, Xiaobin Hu, Peng Gao, Hongsheng Li, Hao Dong
https://arxiv.org/abs/2403.11289

ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Models
The integration of Multimodal Large Language Models (MLLMs) with robotic systems has significantly enhanced the ability of robots to interpret and act upon natural language instructions. Despite these advancements, conventional MLLMs are typically trained on generic image-text pairs, lacking essential robotics knowledge such as affordances and physical knowledge, which hampers their efficacy in manipulation tasks. To bridge this gap, we introduce ManipVQA, a novel framework designed to endow ML…

A Browser Extension for in-place Signaling and Assessment of Misinformation
Farnaz Jahanbakhsh, David R. Karger
https://arxiv.org/abs/2403.11485 https://…

A Browser Extension for in-place Signaling and Assessment of Misinformation
The status-quo of misinformation moderation is a central authority, usually social platforms, deciding what content constitutes misinformation and how it should be handled. However, to preserve users' autonomy, researchers have explored democratized misinformation moderation. One proposition is to enable users to assess content accuracy and specify whose assessments they trust. We explore how these affordances can be provided on the web, without cooperation from the platforms where users consum…

A Browser Extension for in-place Signaling and Assessment of Misinformation
Farnaz Jahanbakhsh, David R. Karger
https://arxiv.org/abs/2403.11485 https://…

A Browser Extension for in-place Signaling and Assessment of Misinformation
The status-quo of misinformation moderation is a central authority, usually social platforms, deciding what content constitutes misinformation and how it should be handled. However, to preserve users' autonomy, researchers have explored democratized misinformation moderation. One proposition is to enable users to assess content accuracy and specify whose assessments they trust. We explore how these affordances can be provided on the web, without cooperation from the platforms where users consum…