HDATF
日本語
相談する
メニュー

論文アーカイブ

収録論文と要約を番号の大きい順に掲載します。

収録論文 1,430資料更新日 Research Monitoringベンチマーク
  1. 1082LLMs / NLParXiv:2609.10745

    Think Before You Link: Rarity, Reasoning, and Retrieval in Multilingual Entity Linking

    • To complement view-count-based rarity measures, the authors built an evaluation set of rare entities using structural signals such as Wikidata link counts and description metadata.
    • A reasoning-capable vision-language model iteratively searches English Wikipedia to gather evidence; no additional model training was done for the proposed procedure.
    • On the MERLIN benchmark spanning Hindi, Indonesian, Japanese, Tamil, and Vietnamese, combining retrieval with reasoning performed best, while reasoning alone did not significantly improve rare-entity accuracy.
    • Adding retrieval alone can improve rare-entity performance while hurting overall accuracy, showing that reasoning over retrieved evidence matters in multilingual entity linking.
    • Applicability is limited to entities with an English Wikipedia article, and search failures dominate the residual errors, leaving retrieval quality as the main open problem.
    概要PDF
  2. 1081Machine LearningarXiv:2609.11917

    Data Scarcity and Model Sparsity: Mixtures-of-Experts Overfit More to Repeated Data

    • The researchers varied data repetition rates, domain mixtures, and expert counts and sizes across models with 80 million to 1 billion active parameters.
    • At the 80-million-active-parameter scale, mixture-of-experts models degraded from four data repetitions onward and lost their advantage over dense models at high repetition rates.
    • Expert-routing paths freezing early in training and experts over-specializing on repeated data were observed, offering clues for understanding the overfitting.
    • Dropout and output masking mitigated the damage from repeated data, suggesting that overfitting countermeasures deserve review alongside architecture choices when data is limited.
    • None of the tested mitigations fully reproduced training on unique data, so repeated-data training cannot be treated as a complete substitute for new data.
    概要PDF
  3. 1080Computer VisionarXiv:2609.11929

    SenseNova-U1.5: Towards Native Unified Visual Intelligence

    • With a single architecture that drops the encoder and VAE and learns directly from pixels, one model handles image understanding, reasoning, generation, and editing.
    • Instead of predicting each pixel patch independently, a reconstruction scheme lets neighboring regions exchange information, producing seamless images even at 4K resolution.
    • It uses a specialize-then-unify strategy: separate reinforcement-learning experts are trained per capability and merged into one model via on-policy distillation.
    • It scored 68.2 on the VBVR-Pro-Bench text-image bidirectional benchmark, ahead of commercial models such as Nano-Banana-Pro (56.4) and GPT-Image-2 (50.7).
    • Despite almost no structured formats in the generation training data, the model follows long, complex structural instructions well, indicating that understanding capability transfers to generation.
    • On the reasoning-centric editing benchmark RISEBench, using chain-of-thought substantially improves causal, logical, and temporal editing scores.
    概要PDF
  4. 1079Machine LearningarXiv:2609.10464

    Semigroup-JEPA: Latent Dynamics Consistency for Zero-Shot Physics Generalization

    • SG-JEPA takes a gravity condition and recursively predicts multi-step latent states, jointly training the encoder and predictor.
    • Generalization is tested on eight MuJoCo datasets that train in a narrow gravity range and evaluate over a wider one.
    • The paper reports that 2D prediction error falls to as little as half that of DINO-WM and 3D robot-control success rates rise by up to 2.5 times.
    • Training a new predictor on a frozen encoder shows the key gain lies in dynamics-relevant representations, which are then used as control inputs for a separate diffusion policy.
    • Settings that vary several physical variables beyond gravity together were not validated, and transfer under changed object shape and rotation is uneven.
    概要PDF
  5. 1078Computer VisionarXiv:2609.10540

    Programmable World Model

    • Separating a state-managing engine from a video-generating renderer structurally solves video world models' inability to remember.
    • A coding agent turns natural-language instructions into executable programs, letting users directly program game rules.
    • A 3D oriented-bounding-box intermediate representation keeps programs easy to manipulate while precisely guiding video generation.
    • On the new CombatStateBench it reaches 94% character-count consistency and 98% state fidelity, leading prior models by up to 62 percentage points.
    • It also stays best on all four VBench video-quality metrics, showing structured control does not hurt visual quality.
    概要PDF
  6. 1077RoboticsarXiv:2609.10522

    Show-Harness: Just a VLM Agent Can Play Robots

    • Without robot-specific retraining as in vision-language-action models, it taps a foundation VLM's intelligence for robot control through a meaningful motion-primitive interface alone.
    • Real robot-arm experiments confirm that state-of-the-art closed VLMs can be used directly as robot agents zero-shot, with no training.
    • Small open-source VLMs (2B class) handle robots in the same action space after just a few GPU-hours of light fine-tuning, opening a low-cost deployment path.
    • It generalizes better across tasks, robot morphologies, and environments than prior agent approaches and VLA models.
    • A GUI-based control interface called GUMI lets humans and agents collect robot demonstration data together without expensive teleoperation rigs.
    • Component ablations show planning, failure recovery, and motion logging lift success rates by up to 24–35 percentage points.
    概要PDF
  7. 1076LLMs / NLParXiv:2609.08936

    AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing

    • Taking natural-language instructions and audio context as common inputs, it covers speech generation, content editing, restoration and separation, and speaker-attribute or acoustic editing.
    • It combines semantic conditioning from a multimodal language model with acoustic conditioning from an audio VAE, and jointly trains generation and editing after generation-centric pretraining.
    • Different post-training signals are applied to generation and editing, and AuK-Flash reports a 4.5x speedup under matched conditions with four-step inference.
    • Handling diverse audio tasks through one unified interface makes it a foundation for building speech production and editing tools.
    • Understanding compound instructions and generalizing to new instruction combinations remain open, and the current system partly relies on task classification and instruction completion.
    概要PDF
  8. 1075RoboticsarXiv:2609.07398

    OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining

    • OpenWAM-Infra breaks the design space of world and action models into modules and integrates training, inference, deployment, and evaluation.
    • Controlled experiments disentangle the roles of generative models and compact representations, what information flows from world prediction to action, and the effect of joint training.
    • Models trained on roughly 6,400 hours of egocentric human and robot data were evaluated on eight simulation benchmarks and real robot manipulation.
    • Because design and evaluation conditions are shared, others can reproduce component swaps and compare robot-learning methods on the same footing.
    • The abstract's performance claims were verified only for the evaluated single-arm and bimanual manipulation settings, not for every robot environment.
    概要PDF
  9. 1074Computer VisionarXiv:2609.09155

    SyncWorld: Visual Calibration Enables World Models as Zero-Shot Simulators

    • Videos of the robot moving along each control direction plus action logs serve as a calibration context, so the model learns how commands map to visual change in a given environment.
    • At prediction time it uses the calibration context, recent observations, and the planned action together, requiring no additional training for a new environment.
    • The authors show experiments simulating action outcomes in unseen environments and using these predictions to improve policy performance at evaluation time.
    • This can cut the cost of retraining a simulator whenever the camera or robot placement changes.
    • Trajectory prediction is unstable from extreme viewpoints, and out-of-distribution objects may appear blurred or misplaced.
    概要PDF
  10. 1073Computer VisionarXiv:2609.05416

    WorldSculpt: Generating Compositional Worlds from Grounded Videos

    • By adding a circuit that feeds multi-view video into a single-object 3D generative model (Pixal3D), it handles scenes with hundreds of objects without scene-level training.
    • Each object is produced as an individual mesh and placed in world coordinates, so games, AR, simulation, and robotics can pick objects out separately.
    • It releases UE-MeshyScene, an Unreal Engine benchmark of 6 scenes with 93 to 701 objects and ground-truth meshes per object.
    • On the heavily occluded benchmark, learning-based image-based rendering cuts CD-L2 error by 12% and raises F-Score from 0.944 to 0.951.
    • It also demonstrates, without extra training, converting 3DGS scenes from generative world models such as Marble and HY-World 2.0 into object-level mesh scenes.
    概要PDF
  11. 1072AI / GeneralarXiv:2609.05275

    Don't Drop Dropout: Optimizing Layer Sparsity for Efficient LLM Training and Inference

    • Across more than 2,400 training runs, it finds the optimum is stronger dropout for deeper layers, gradually annealed as training progresses.
    • At the same training budget, validation loss matches or beats the no-dropout dense baseline while saving up to 25% of compute.
    • An 8.2-billion-parameter model with an aggressive schedule peaking at 99% dropout reached loss 1.663, better than the dense baseline's 1.732.
    • Dropout-trained models stay robust when layers are skipped, enabling self-speculative decoding—where the model drafts and verifies quickly—for up to 1.55x speedups.
    • In contrast, dense models trained without dropout blow up to loss 6.446 when layers are skipped, making them effectively unusable.
    概要PDF
  12. 1071LLMs / NLParXiv:2609.03430

    Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning

    • The method preserves the input question while evicting cache entries uniformly at random from each attention head's reasoning history, eliminating importance scoring and ranking.
    • Comparisons across four models and six reasoning tasks showed accuracy comparable to strong existing eviction methods, and most performance differences shrank when all methods were configured to preserve the input question.
    • In vLLM experiments on a single H200 with a cache budget of 2048, a 1k-token input, and a 32k-token generation, output throughput was 32–43% higher than TriAttention.
    • The analysis that needed information is restated during reasoning and stored redundantly across multiple heads suggests that memory demands and cache-management costs in long-reasoning services could be reduced without complex importance calculations.
    • Selection signals helped in an experiment retrieving information that appeared only once and was never mentioned again, so these findings should not be generalized to mean that random eviction is superior for all information-retrieval tasks or all models.
    本文公開コード概要PDF
  13. 1070ResearcharXiv:2609.03344

    Large-Language Models as a Cognitive Virus

    • In a population dynamics model (epidemic-style diffusion) that divides people into three states (non-use U, autonomous use C, and persistent dependence D), crossing a critical range of transmission rates produced bistability (a range in which two stable states coexist), with a sharp shift from coexistence between autonomous and dependent groups toward dependence.
    • With illustrative parameters (ρ=0.10, κ=0.40), hysteresis occurs between the thresholds λSN=0.40 and λTC=0.50. Once adoption runs away, reducing transmission pressure to its previous level does not automatically restore the earlier state (technological lock-in).
    • The persistent-dependence fraction is determined by D*=(µ/σ)C*. Reducing the rate of entering dependence µ or increasing the recovery rate σ can reduce dependence (through training, verification habits, and deliberate cognitive friction).
    • Using illustrative cognitive-capacity values (autonomy 1.0, autonomous use 0.5, and persistent dependence 0.1), average capacity follows the same hysteresis. The key point is that population-wide capacity can drop sharply even when individual adoption is gradual.
    • It defines 'cognitive immunization' as maintaining habits of independent verification and unaided problem solving, along with educational designs that support them, rather than blocking exposure to AI. The conclusion is that prevention is much easier than recovery.
    • Experimental evidence cited by the paper: a 'think first, ChatGPT later' protocol improved subsequent independent creativity, while unrestricted AI use improved performance while using the tool but reduced unaided performance, understanding, and memory.
    概要PDF
  14. 1069LLMs / NLParXiv:2609.04173

    Last Translation Benchmark

    • Humans created and peer-reviewed 3456 challenging translation examples across 109 languages in text, image, audio, and video formats.
    • Each example includes verification rules specifying how it should be translated, and an LLM judge assigns a pass or fail for each rule. An example counts as successful only if every rule passes.
    • On a simple English-to-Czech sentence involving the gendered expression for a male nurse, Google Translate and Gemini 3.1 Pro scored 0%, and only GPT-5.6 Sol passed. This shows that even strong models make critical mistakes.
    • In an experiment transferring examples to other languages, automatic filtering retained 48%, while human review passed 64.1%, demonstrating the feasibility of semi-automatic expansion.
    • The data is released under CC BY 4.0, and this is a living benchmark that continues to accept contributions.
    概要PDF
  15. 1068AI / GeneralarXiv:2609.04148

    Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environments

    • Starting from the idea that agent traces already contain all the environmental information, it reconstructed 37.3k reusable execution environments by rewinding file operations and using a repair agent.
    • It generated multiple tasks from each environment, including tasks spanning multiple codebases (breadth expansion) and multi-round tasks with continuing user feedback (depth expansion).
    • By attaching a verifier to each task and using only data that passed, it improved Qwen3.5-27B by 11.9 points on Terminal-Bench 2.1 and 13.8 points on EvoCode-Bench v2 MT@4.
    • With the same data budget, increasing the number of environments was more effective than increasing the number of questions or solutions (53.2→56.0 vs 53.8/53.9).
    • Training the agent to solve tasks again in reconstructed environments was much better than training it to imitate the original traces directly.
    • Data generated from software engineering (SWE) traces also raised the terminal benchmark average from 47.0→50.0, demonstrating cross-domain generalization.
    概要PDF
  16. 1067Machine LearningarXiv:2609.04010

    Unlocking Lossless Speedups in LLMs via Discrete Diffusion

    • Adding only a lightweight training stage that equips an existing LLM with diffusion weights, allowing multiple tokens to be filled in simultaneously, delivered up to a 3× speedup without major architectural changes.
    • Unlike speculative decoding methods such as EAGLE-3 and DFlash, which require a small draft-only model, it handles drafting and verification in a single model and provides lossless acceleration with an answer distribution exactly matching the original.
    • Whereas earlier diffusion LLMs lost their gains as batch size increased, Uno achieved higher throughput than speculative decoding at every evaluated batch size and maintained a 2× speedup even at the largest batch.
    • The 8B Uno outperformed the 26B DiffusionGemma and commercial Mercury 2 across all benchmarks for agentic tool use, coding, and long-document reasoning.
    • It also accelerated rollout generation, the slowest stage of RL post-training, showing that it can speed up reinforcement-learning training itself as well as inference.
    • It can be built on already released open-weight models, so there is no need for a new large-scale training run.
    概要PDF
  17. 1066AI / GeneralarXiv:2609.04172

    Rethinking On-Policy Distillation of Large Language Models II: One Training Example

    • Even with just 1 question for distillation training, performance kept improving for hundreds of steps, recovering 72% of the full-data effect on math tasks.
    • It proposed 'state coverage' as an explanatory measure. 1 question achieved 71.5% coverage, while 16 semantically different questions achieved 98.9% coverage and matched full-data training performance.
    • The absorption rate (the fraction of the remaining teacher-student gap closed by a single update) declined at a similar rate whether training used 1 question or 17,000. This suggests that the bottleneck is the learning algorithm rather than the amount of data.
    • Training on nearly content-free templates or unrelated-domain conversation data (WildChat) had effects similar to training on real questions. The argument is that a question's only role is to 'trigger thinking.'
    • Over 1000 steps using the same single question, distillation (OPD) produced at least twice the performance gain of reinforcement learning (RLVR). Outcome rewards are exhausted once the answer is correct, whereas token-level supervision continues to provide a signal.
    概要PDF
  18. 1065LLMs / NLParXiv:2609.02702

    Trace as State: Reasoning Traces as Conditional States for Long-Context Transformers

    • Simply placing the reasoning trace from the first reading before a long document and having the model read it again outperformed the existing approach of appending the trace in 26 of 27 model × task × metric combinations.
    • A theoretical analysis explains the advantage of prepending the trace: providing a condition first requires exponentially less memory than providing it later.
    • On GraphWalks Parents, GLM-5.2's accuracy rose from 66.4% on the first attempt to 100%, while DeepSeek V4 Pro improved from 29.2% to 81.8%.
    • Inserting a trace from a different problem actually reduced performance. This indicates that the effect comes from information specific to the problem, rather than the format.
    • Performance continued to improve as the number of traces increased from 1 to 5, making trace count an additional scaling lever for controlling the number of reasoning attempts.
    • Its biggest advantage is that it requires no model-architecture changes and can therefore be added directly to any service that handles long documents.
    概要PDF
  19. 1064RoboticsarXiv:2609.01938

    One Demonstration, Many Objects: Generalizing Manipulation via Local Contact Geometry

    • Instead of teleoperation, it starts from a single human video demonstration, converts it into a robot trajectory, refines it with residual reinforcement learning in simulation, and distills it into a depth-camera policy.
    • It separates a low-level policy that observes only local geometry near the contact point through a wrist-mounted depth camera from a high-level policy that determines the global trajectory from frontal RGB video, allowing operation without object-position estimation at execution time.
    • Ablation experiments showed that contact-alignment and contact-maintenance rewards barely affected simulation scores but decisively improved success rates on real hardware.
    • Across 16 objects × 4 tasks × 2 types of robot hands, it achieved an average real-world success rate of 71% (76% for one hand and 65% for the other), with the smallest sim-to-real performance drop among the baselines.
    • Performance fell to 39% on an object with different local contact geometry (a box with a curved lid), candidly showing that generalization is bounded by similarity in contact structure.
    概要PDF
  20. 1063Machine LearningarXiv:2609.01343

    SMELT: Scaling Laws for Compute-Matched MoE Looped Transformers

    • This is the first multi-scale comparison in looping research to simultaneously match all three budgets, compute per token, total parameters, and KV cache, ruling out the objection that the gains merely come from using more computation.
    • The design loops only the middle half of the layers twice, reduces the hidden dimension, and then increases the number of experts to restore knowledge capacity, exploiting a budget trade-off possible only with MoE.
    • It consistently achieved lower loss across 4 scales up to 54B non-embedding parameters and multiple sparsity levels, with scaling-law fits indicating that reaching the same performance requires 6.8–18.0% less training compute.
    • The largest gains were in the code domain, and the gap widened with longer inputs and more examples in the prompt, showing that looping becomes more valuable for structured inputs.
    • On the second pass, attention sinks disappeared and attention shifted toward evidence tokens for the correct answer. In a bracket-matching task, attention concentrated on the first token fell from 0.60 to 0.02, while attention to evidence tokens rose from 0.24 to 0.85.
    概要PDF
  21. 1062AI / GeneralarXiv:2609.01481

    Harness-of-Harness: Multi-Day Autonomous Software Development with Continual Improvement

    • It secured both agent autonomy and verifiability by leaving the harness implementation untouched and enforcing only the formats of artifacts (plans and test reports), triggering retries on violations.
    • Across GameCraft-Bench, FrontierSWE, and ProgramBench, the Codex+GPT-5.5, OpenCode+DeepSeek-V4-Pro, and Pi+MiniMax-M3 combinations all improved after just 3 loops, with an average relative gain of 52.25% and a maximum of 82.86%.
    • On FrontierSWE, Codex+GPT-5.5 continued improving from 22% to 72.67% over 10 loops, showing that gains accumulated with more iterations.
    • Given only a requirements document in an empty working directory, it autonomously completed 'Fusepoint,' a first-person shooter with a story, combat AI, presentation, and audio, over more than 70 loops. Human intervention was limited to restoring network connectivity.
    • It closed 65 of 81 recorded issues on its own and used version history to recover from 17 regression issues in which previously verified features had broken, showing that regression management is central to long-term development.
    • It used a progressive-disclosure structure that assigned skills for Godot engine integration, asset generation, UI/UX, and testing by role to encourage reuse.
    概要PDF
  22. 1061Computer VisionarXiv:2609.02886

    SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models

    • It converted 1.43 million clips from 10 datasets, totaling at least 25TB, into a unified format containing frame alignment, camera geometry, captions, and quality metadata, enabling experiments with different training mixtures without rerunning preprocessing.
    • It applied backbone-native adaptations that preserve the original representations and objectives of the structurally different Wan2.2 (5B/14B), LTX-2.5 (22B), and MiniMax-H3 (33B) backbones, producing 4 directly comparable model families.
    • A simple 3-stage process of bidirectional training, autoregressive adaptation, and distribution matching distillation (DMD, a technique that compresses a large model into a smaller one by training it to imitate the large model's output distribution) achieved leading performance without special initialization.
    • Despite training only on 5-second sequences, it maintained scene identity and camera responsiveness throughout continuous 60-minute rollouts without fine-tuning on long videos or using attention-sink mechanisms.
    • Even when initialized with externally generated images from GPT Image 2 or Krea in styles absent from the training data, it generalized by imagining unseen regions and expanding them into explorable worlds.
    • It released all data, processing pipelines, training recipes, and weights, establishing a reference point for reproducible video world-model research.
    概要PDF
  23. 1060Agents / InfrastructurearXiv:2609.01437

    HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?

    • HarnessDev defines a harness as execution infrastructure reused across tasks rather than a single response, separates creation from evolution, and evaluates both capability and execution token cost.
    • It used 6 generation models and 2,207 unique tasks across 4 domains and 5 benchmarks. Generated harnesses were strong in writing and machine-learning experiments but lagged behind human-built baselines in coding, search, and research.
    • All 18 coding harnesses implemented execution loops, but state and memory were their weakest areas. Although 11 declared a State class, only 1 provided a storage interface and only 1 provided periodic checkpoints, and no checkpoint event appeared in 26,679 execution traces.
    • Analysis of 73 official versions and 64 version transitions across 9 evolution runs found that visible and hidden scores moved in the same direction 53.1% of the time, and the final selected version was optimal on hidden tasks in only 2/9 cases.
    • In evolution experiments with Gemini fixed as the execution model, only the Opus family improved on hidden tasks, while the other 3 families worsened, showing that harness improvements can overfit a particular model and public feedback.
    概要PDF
  24. 1059Machine LearningarXiv:2609.00196

    WHALE: A Simple Recipe for Joint Harness-Weight Optimization

    • It alternates between online rejection-sampling fine-tuning with the current harness fixed and Meta-Harness code search with the updated model fixed.
    • Evaluations of Qwen3.5-2B and 4B on search-based question answering, mathematical reasoning, and chess puzzles achieved peak accuracies 7.67–24.38 percentage points higher than single-component baselines and 4.15–13.00 percentage points higher than FST, which changes only prompts.
    • The harness was the main bottleneck for search tasks, but mathematical tasks required weight updates first before the same harness search became effective, showing that the bottleneck varies by task.
    • Interleaving multiple small updates improved accuracy and rollout efficiency over a staged approach that trains all the weights and then searches for a harness once, providing grounds for designing agent-training pipelines as a joint optimization problem.
    • Important limitations are that validation covered only Qwen3.5-2B and 4B and three tasks, and that the rollout-cost comparison excluded compute used by the model proposing harnesses.
    概要PDF
  25. 1058Computer VisionarXiv:2609.00111

    Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving

    • Without changing the architecture of the pretrained VLM (Qwen3.5-4B), it added just two external modules, a BEV perception head and a Planning Expert, to integrate 3D perception, question answering, and path planning.
    • It used the BEV head as a '3D probe' to make it possible to test how well the model understands actual 3D scene structure, beyond simply producing fluent text answers.
    • Staged training that mixes driving data with general-purpose vision-language data preserved both driving and general capabilities, mitigating catastrophic forgetting (losing old capabilities while learning new ones).
    • It achieved 43.95 mAP for 3D perception and 60.99 mIoU for mapping on nuScenes, a NAVSIM driving score (PDMS) of 90.7, and a Waymo E2E evaluator score of 7.91.
    • In line with the trend toward vehicle cockpits (multimedia) and driving functions sharing a single computing platform, it aims for a model that handles them together rather than a model dedicated only to driving.
    概要PDF
  26. 1057Computer VisionarXiv:2609.01560

    H3-World: Turning Language Understanding into World Control

    • Rather than attaching a dedicated control module to the 33B video-generation model MiniMax-H3, it directly reused the text pathway the model already understands as a control interface.
    • It achieved precise character and camera control using just 8,000 gameplay samples, 10,000 LoRA training steps, and 0.199% trainable parameters.
    • Temporal attention routing restricts each command to its own time interval, reducing command leakage into other intervals.
    • In camera-direction-change experiments, the global-prompt approach achieved horizontal flow of only +0.0/-17.3, whereas H3-World accurately followed both directions with +52.7/-106.0.
    • The same interface worked unchanged for action combinations never seen during training and for scenes outside games, including first-person views, interiors, and fantasy settings.
    概要PDF
  27. 1056Computer VisionarXiv:2608.30821

    Lucida: Parse, Generate, and Place for Composable Real-to-Sim Scene Modeling

    • It redistributed the requirements of a three-stage pipeline that had demanded 'precise inputs,' redesigning each stage to consume only what real captured data can reliably provide.
    • A VLM policy called GizmoAct translates object placement into 3D editor GUI operations, deciding the next adjustment and when to stop using rendered views alone.
    • It improved scene-level 3D detection mAP by 69% over Boxer, from 0.351 to 0.592.
    • It raised pose-estimation ADD-SB@0.05 on CA-1M from 57.8% to 83.4%, a gain of 25.6 percentage points, and increased the scene-reconstruction F-score from 0.794 (SAM 3D) to 0.924.
    • A single policy trained with reinforcement learning after SFT handled initialization methods with different error characteristics without retraining.
    概要PDF
  28. 1055LLMs / NLParXiv:2608.31119

    PaperGym: Rubric-Centered Evolution for Research-Plan Generation

    • Using paper structure to separate the sources of questions, drawn from objectives and background, from scoring criteria, drawn from methods and experiments, reduced criterion leakage from the previous 11.9–34.1% to 3.7%.
    • Two-stage training that uses the same rubric twice, first as privileged context for OPSD self-teaching and then as a GRPO reward, outperformed SFT, either stage alone, and the reverse order.
    • For Qwen3-1.7B/4B/8B, it raised the average across 5 benchmarks by +5.6, +5.0, and +4.8 points, respectively.
    • In a controlled comparison with the training recipe fixed, a model trained on PaperGym-20k dominated RubricHub Science (28.2%) with a 58.1% win rate in a three-way comparison, isolating the effect of data quality.
    • The trained Qwen3-8B scored 73.48 on ResearchQA, surpassing the much larger Kimi K2.6 at 73.19.
    概要PDF
  29. 1054RoboticsarXiv:2608.30935

    LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation

    • A single VLM backbone handled instruction following, open-vocabulary object search, and visual tracking in one model without task-specific prediction heads.
    • Dual pointing (an affordance point + an object point) raised average success from 54.7% to 63.1%, and removing it reduced performance on every benchmark.
    • A residual vector quantization (RVQ) action tokenizer precisely generated a 10-waypoint trajectory using just 3 tokens.
    • It achieved the highest monocular success rate across all 10 public navigation simulations.
    • It transferred zero-shot to humanoid, quadruped, aerial, and wheeled robots, and expanding environmental diversity was a more reliable driver of performance than increasing model size (the backbone saturated at 4B and above).
    概要PDF
  30. 1053Machine LearningarXiv:2608.31046

    Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement

    • Noise in OPD's teacher signals, penalizing correct answers and rewarding incorrect ones, reached 30.6% for a 4B teacher and 50.6% for a 235B teacher, yet training after removing this noise produced essentially the same results.
    • It showed that OPD's gains concentrate on low-probability tokens and that a single fixed negative advantage can replace the teacher signal.
    • OPSA, with no external supervision at all, raised AIME24 Avg@32 by +35.41 points, a relative gain of 263%, and exceeded OPD by 16.77 points.
    • It at least doubled Pass@32 on all 3 mathematical benchmarks: AIME24/25 and HMMT.
    • At high-entropy branching points where probabilities diverge, it distributes probability evenly among candidate tokens, preserving exploration diversity while sharpening the distribution.
    概要PDF
  31. 1052Machine LearningarXiv:2608.31036

    Normalized Low-Rank Adaptation

    • It identified that LoRA's early learning is governed by the down-projection A and showed that simply normalizing A along the rank dimension improves optimization.
    • It raised the supervised fine-tuning average from 37.93 (LoRA) to 43.37, and even NoRA-init, which applies normalization only at initialization, reached 42.38.
    • In reinforcement learning for mathematical reasoning (RLVR), it achieved an overall average of 44.4%, exceeding LoRA (42.8%), and remained stable in contrast to SVD-based PiSSA, which collapsed to 0.2% under the same settings.
    • Post-adaptation retention of existing knowledge (average change across 3 evaluations including MMLU) was +0.02, showing much less forgetting than LoRA (-0.56) or MiSS (-0.70).
    • Applying the same normalization principle to DoRA also raised its score from 38.30 to 41.40, confirming that the idea is not limited to the LoRA family.
    概要PDF
  32. 1051AI / GeneralarXiv:2608.27953

    The Illusion of $\textit{What If}$: Evaluating the Breakdown of Counterfactual Reasoning in LLMs

    • It released a diagnostic benchmark of 220 open-domain what-if questions spanning STEM, humanities and social sciences, and mixed domains.
    • It developed the PRISM evaluator, which converts free-form answers into causal graphs, DAGs of events, states, and mechanisms, to score the reasoning process rather than the outcome.
    • The best score among 6 current LLMs was only 64.62%, showing that counterfactual reasoning remains far from saturation.
    • The most common failure was a causal gap: models listed plausible outcomes but omitted the intermediate links connecting the premise to those outcomes.
    • It concluded that fluent narratives conceal weak causal processes, emphasizing the need for structure-based evaluation.
    概要PDF
  33. 1050Machine LearningarXiv:2608.27763

    Fast Weight Attention for Continual Learning

    • It reinterpreted state-update rules as online learning and developed a framework that separately analyzes temporal alignment, plasticity, forgetting, and rehearsal.
    • It showed that, in next-token prediction, the pair the state should learn is offset by one step: (previous key, current value).
    • It derived normalized first-order update equations for regression objectives (Falcon-1/2/3) and inner-product objectives (Falcon-1A/2A/3A), and provided recurrent, masked-parallel, and chunk-parallel forms.
    • It remained competitive with existing recurrent models in language-modeling evaluations.
    • In extrapolation to 33–48-digit addition, Falcon-3A.3 achieved 87.2%, outperforming both RetNet and Transformer baselines.
    概要PDF
  34. 1049Computer VisionarXiv:2608.27549

    Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning

    • It encoded objects, physical laws, and appearance as code to create compact world representations that can also be verified numerically.
    • An agent loop of proposal, execution, rendering, verification, and revision, inspired by abductive reasoning, automatically discovered world representations from text or video.
    • Using verified executable worlds as supervision, it taught vision-language models quantitative physical reasoning, such as answering questions about speed or mass in videos.
    • Code-as-World-VL-9B outperformed much larger commercial models such as Gemini-3.1-Flash on QuantiPhy, while the 27B model achieved the best overall score.
    • Its central contribution is translating the scientific discovery process of forming hypotheses and testing them experimentally into an agent loop.
    概要PDF
  35. 1048LLMs / NLParXiv:2608.28476

    ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL

    • Adding planning, long-term memory, and offloading to the tool set raised BrowseComp+ accuracy from 63.49% to 80.96%.
    • Reinforcement learning delivered a 5.34-point gain on the more difficult BrowseComp+ benchmark. The longer and harder the task, the greater the effect.
    • The baseline agent's input length grew linearly with each turn to 30K tokens, whereas ContextPilot stabilized at 8–10K tokens.
    • Reinforcement learning also reduced tool-use mistakes. Memory and offloading tool failures, which were frequent early on, decreased substantially during training.
    • It showed consistent improvements across different base models, including Qwen3-8B/14B and Gemma4-E4B.
    概要PDF
  36. 1047ResearcharXiv:2608.28122

    Agentic Artifact Creation: Systems, Evaluation, Principles, and Opportunities

    • Reviewing 259 studies published through August 2026, it defined agentic creation with state persistence and observation-based course correction as a research field.
    • It compared shared challenges and difficulty across 6 artifact families: text, 2D images, audio, video, 3D and spatial artifacts, and behavior such as software.
    • It identified the trade-off whereby decomposing a task reduces local complexity but increases coordination and reassembly costs.
    • It warned that learned judges sharing the generating model's preferences and blind spots add little independent evidence.
    • It proposed principles of making contracts and responsibilities explicit, turning feedback into local repairs, and revalidating affected parts after changes.
    概要PDF
  37. 1046LLMs / NLParXiv:2608.28444

    Sliding-window beats linear attention

    • 0 additional training runs: SWA, which changes only the attention mask, matched or outperformed conversions to linear attention that require retraining on billions of tokens.
    • The gap was larger in long contexts. At a 256K context length, SWA recovered 20–25% of the original performance, whereas linear attention (LoLCATs) recovered only 2.2–5%.
    • On MMLU, SWA recovered 93.2% of the original performance, outperforming all major linearization methods, including LoLCATs (83.2%) and Liger-GLA (62.2%).
    • SWA (window 64) had the fastest decoding speed and lowest memory use among the tested methods.
    • Citations to related work also confirmed that training-free sliding windows are a strong baseline for video generation models.
    概要PDF
  38. 1045Computer VisionarXiv:2608.28549

    Video Generative Models as Geometry Learner

    • By directly inheriting a video-generation model's existing knowledge of temporal consistency, it generated depth and normals together with images in a single pass.
    • With approximately one hundredth as much training data, it matched existing state-of-the-art discriminative models.
    • Unlike previous methods that predicted depth and normals separately, it unified them in a single model, saving checkpoint storage and computation costs.
    • A single prediction surpassed all generative baselines, and a lightweight ensemble (5×5, 10 seconds) further improved performance.
    • The extracted 3D geometry enabled applications such as image relighting, controllable image generation, and 3D mesh reconstruction.
    概要PDF
  39. 1044Computer VisionarXiv:2608.26872

    Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher

    • It requires no teacher model at all, reaching the target in approximately 44–48 hours with a warm-start configuration, compared with DiffusionOPD's total of 97 hours (85.8h of teacher training + 11.3h of distillation), making it nearly 2 times faster.
    • K stochastic branches + a self-baseline provide dense learning signals at every step, avoiding the high-variance problem of reinforcement learning methods (such as Flow-GRPO) that use only terminal rewards.
    • Best-of-K, which follows only the good branches, was unstable during training. Pull-push over all branches + KL regularization was essential for stable convergence (an unconstrained repulsion term caused performance to collapse to 0.768).
    • It combined multiple objectives (text, composition, and aesthetics) at the reward level so that a single image could satisfy them simultaneously without gradient conflicts (a preference-score drop of 0.48 vs 1.23 with the teacher-based method).
    概要PDF
  40. 1043AI / GeneralarXiv:2608.26081

    SwarmWorld: Stigmergic technological evolution in societies of language-model agents

    • Despite having no roles, recipes, or central control, identical agents spontaneously differentiated into exploration, construction, maintenance, and coordination behaviors, as confirmed by clustering on 15 behavioral features.
    • It measured objective functionality judged by a simulator rather than LLM self-reports, using an evaluation setup that removed all agents before applying 8 unannounced perturbations.
    • Compared with isolated exploration, the shared world yielded +1.2 to +6.0 more verified inventions and consistently better resilience metrics in paired comparisons across 4 seeds.
    • Technology reuse most often began with firsthand observation of artifacts made by others, rather than through chat.
    • Explicit cultural mechanisms such as teaching (TEACH) increased collaboration and organization, but their functional gains varied by evaluation metric and time period, making them no universal solution.
    概要PDF
  41. 1042Machine LearningarXiv:2608.27351

    Understanding Evolution Strategies for LLM Reasoning: Broader Reasoning Coverage than GRPO

    • It showed that, unlike GRPO, ES improves Pass@1 and Pass@K together without entropy collapse (loss of exploration diversity), preserving diversity in reasoning answers.
    • A sequential combination that first trains with GRPO and then finishes with ES combined the strengths of both methods.
    • Performance gains were concentrated in a small subset of large updates (mainly normalization and attention parameters), showing that functional changes are sparse even when parameters move substantially.
    • ES largely preserved existing capabilities in held-out evaluations, providing a counterexample to the idea that large parameter movements themselves cause catastrophic forgetting.
    • Z-score reward normalization is essential, and as model size increased, a population of just N=16 approached the performance of N=64.
    概要PDF
  42. 1041Computer VisionarXiv:2608.27226

    DINOcular: Self-Supervised Visuospatial Representations

    • It introduced depth as the third axis of rotary positional encoding (RoPE), allowing geometric information to enter feature representations naturally.
    • Through self-supervised learning, learning without labels, it learned representations capturing both appearance and spatial structure from RGB-D video.
    • It outperformed existing models of the same size on 3D correspondence matching in NAVI and ScanNet, and even surpassed DINOv3 ViT-B on ScanNet.
    • In 3D pose estimation, there were conditions under which the large model, DINOcular-L, outperformed every baseline.
    • It identified a trade-off in which improved 3D understanding came at a slight cost to semantic performance.
    概要PDF
  43. 1040LLMs / NLParXiv:2608.27370

    Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within $5090

    • FP8 low-precision training on a consumer RTX 5090 cluster reduced the pretraining cost of a 2B model to approximately $6,900.
    • Training on 1.4 trillion tokens over 22,514 GPU hours and 17.6 days surpassed Qwen2-1.5B and approached Qwen2.5-1.5B performance.
    • It proposed the 'Puro cost scaling law,' fitted to the relationship between training cost and performance, and estimated that approximately $4,400 would suffice to reach Qwen2-1.5B-level performance.
    • Five factors produced the cost efficiency: hardware selection, low-precision training, Hyperball optimization, curriculum model averaging, and the data recipe.
    • It released all 10 sets of weights, data manifests, and training and preprocessing code under Apache 2.0.
    概要PDF
  44. 1039RoboticsarXiv:2608.15917

    Pre-training Visual Dexterity in Simulation

    • Using VR teleoperation in simulation, it collected 75 hours of hand-manipulation data, approximately 2000 episodes, in one week without a real robot.
    • After pretraining, fine-tuning on just 1–2 hours of real demonstrations outperformed training from scratch on all 5 real-world tasks.
    • Providing a history of past observations and using short action chunks of 8 steps achieved both responsiveness and consistency.
    • The configuration combining history with short action chunks benefited most from pretraining, improving by an average of 18 points over training from scratch.
    • It released the dataset (spd-75h), VR collection software (spd-vr), and 6 tuned scenes.
    概要PDF
  45. 1038AI / GeneralarXiv:2608.27454

    WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution

    • It separated execution traces, knowledge, and skills into three layers, with a wiki layer that continuously accumulates information and is never reset.
    • It enabled stable evolution through gating that accepts only skill changes that improve validation performance and rolls back changes that make it worse.
    • It consistently outperformed existing skill-evolution methods across 5 benchmarks (math, search, spreadsheets, document QA, and household-environment tasks) and 5 models.
    • Skill evolution had a larger effect on larger models: in the Qwen family, 4B/9B/27B models improved by an average of +12.3/+17.5/+23.9%, respectively.
    • The 9B model + WikiSkill (47.4%) beat the 27B model without skills (39.4%), and skills evolved by another model sometimes outperformed a model's own skills.
    • Performance declined in an ablation that removed the wiki, confirming that knowledge accumulation is central to the effect.
    概要PDF
  46. 1037RoboticsarXiv:2608.27406

    CLAP: Cross-Embodiment Video World Models are Zero-Shot Physical Simulators

    • It developed a cross-embodiment world-model framework that jointly trains a single model on videos of different robot platforms and humans.
    • It unified different action spaces through end-effector coordinates, natural language, and latent action representations.
    • Curriculum learning progressing from unlabeled video with latent actions to end-effector actions enabled zero-shot deployment.
    • In challenging environments such as DROID, it approached or surpassed single-embodiment state-of-the-art methods, with few-shot adaptation widening the gap further.
    • Planning at inference time within the world model and RL fine-tuning improved the real-world task success rates of π0.5 and MolmoAct-2.
    概要PDF
  47. 1036AI / GeneralarXiv:2608.25198

    Tunable Tool-Call Rates in LLM Agents via Representation Steering

    • It extracted a linear direction governing whether to call tools from the model's own signals, without training.
    • Adjusting the direction's strength changes the call rate monotonically from near 0% to 90% or higher (while preserving valid call formatting).
    • Increasing the direction makes the model call tools specifically for questions it cannot answer on its own, while decreasing it reduces unnecessary calls.
    • It transfers to unseen tools, and which tool to choose (selection) and whether to call a tool (decision) are separated into different directions.
    • It raised QA accuracy from 0.29 to 0.56 in a real execution environment, and the same recipe worked for dense, MoE, and multimodal models.
    概要PDF
  48. 1035ResearcharXiv:2608.27349

    High-Temperature Superconductivity of the Fe-Se-H compound

    • It produced Fe-Se-H powder by thermally diffusing hydrogen at 180 degrees and 5 atmospheres into FeSe single crystals with a critical temperature of 8K for 10 hours.
    • Using EPR spectroscopy, it measured magnetic-field-dependent microwave absorption up to 6000Oe at 3.6–25K and 295K.
    • It interpreted U-shaped nonlinear absorption and quasiperiodic signals as evidence of a type-II superconductor's mixed state and Abrikosov vortices.
    • Based on these signals, the authors claim that superconductivity exists even at 295K under normal pressure, suggesting the possibility of room-temperature superconductivity.
    • However, the work relies on interpretation of EPR signals rather than direct transition measurements of electrical resistance or magnetization, so independent reproduction and cross-validation are essential.
    概要PDF
  49. 1034RoboticsarXiv:2608.26545

    Memory Anchors for Continual Robot Learning

    • It found that not all data in a replay buffer are equally important: a small subset in conflict regions determines how well forgetting is prevented.
    • It developed a three-stage procedure for selecting memory anchors by locating regions in the policy's latent space where observations overlap but actions conflict.
    • Removing only the top 10% of anchors increased forgetting 4.5-fold on the LIBERO benchmark.
    • ANCHORER, which fills 10% of the buffer with anchors, reduced forgetting on conflicting tasks by 63%.
    • In continual learning over a sequence of two real-robot tasks, it achieved 1.7 times the overall success rate of a random buffer.
    概要PDF
  50. 1033RoboticsarXiv:2608.23831

    Learning to Act While Waiting: RL Finetuning of Generalist Robot Policies Under Inference Latency

    • It identified the cause of failure: VLA inference latency of 100–300ms changes environment dynamics and breaks RL's Markov assumption.
    • It restored an approximately Markov structure by augmenting the state with committed actions and observations collected during inference.
    • It enabled stable fine-tuning even under latency conditions where standard RL failed completely.
    • It matched or exceeded standard RL's performance under ideal conditions with no latency.
    • It demonstrated real-world improvements under asynchronous inference on 3 tasks using a real dual-arm UR5e robot.
    概要PDF