UTC05:21ZNowSIREN 456.6/100Delta+0.5upsince 03:34ZObservedSources15/15reportingStatusOPERATIONAL

Which AI stories has SIREN scored in this window? · Which AI news tags have SIREN pages? · Which AI tags has SIREN scored stories about?

What has SIREN scored about Pre-training?

Pre-training research stories scored in the newsroom or archive — coverage counts, not a ranking. A tag page lists scored stories whose title or summary matched a published needle — not a probability of harm and not a ranking of the companies named.

6Scored stories in window
34Older in archive

Which scored stories are tagged Pre-training in this window?

  1. Learning Transferable World-Action Models from Task-Paired Human Videos HF-DAILY-PAPERS · · capability 38.9
  2. Scaling Repeated-Data Pretraining: Batch Size, Regularization, and GPU-Time Tradeoffs HF-DAILY-PAPERS · · capability 35.3
  3. ShellElastic: Scalable Elastic Pretraining with Simultaneous Maximal Updates and Hyperparameter Transfer HF-DAILY-PAPERS · · capability 33.9
  4. Code-Switching Detection via Language-Selective Dimensions in Speech Foundation Models APPLE-ML · · capability 28.9
  5. Mix, Don't Tune: Bilingual Pre-Training Outperforms Hyperparameter Search in Data-Constrained Settings APPLE-ML · · capability 24.7
  6. NiCLIP: neuroimaging contrastive language-image pretraining model for predicting text from brain activation images NATURE-ML · · capability 23.5

Which AI stories has SIREN scored in this window?

Which older scored stories are tagged Pre-training?

Kept in the permanent archive after they left the live window. Still scored stories — not a forecast.

  1. Converting dense models into Mixture-of-Experts REDDIT-LOCALLLAMA · · attention 21.2
  2. How compute time has shifted from pretraining to post-training over the last 2 years REDDIT-SINGULARITY · · attention 19.8
  3. Foundations of Large Language Models HF-DAILY-PAPERS · · capability 42.3
  4. Where to Adapt Matters: Layer-Selective Fine-Tuning for Capability Retention ARXIV-NEWEST · · capability 27.2
  5. Adapting English Quality Classifiers for Multilingual LLM Pretraining Data Selection ARXIV-NEWEST · · capability 27.5
  6. Conditional Transfer from Controlled Pretraining Mixtures to Code ARXIV-NEWEST · · capability 27.7
  7. Cross-Domain Pretraining for Steady-State Neural CFD Surrogates ARXIV-NEWEST · · capability 27.0
  8. A Deafening Silence: Catastrophic Forgetting Lives in the Output Embeddings of Tokens the Data Never Speaks ARXIV-NEWEST · · capability 26.9
  9. Towards In-Parameter Memory Augmentation for Large Language Models HF-DAILY-PAPERS · · capability 49.3
  10. Towards In-Parameter Memory Augmentation for Large Language Models ARXIV-NEWEST · · capability 47.2
  11. Domain adaptation of Russian ModernBERT for long legal documents ARXIV-NEWEST · · capability 27.3
  12. From Pixels, Without Pre-training: Joint Generative and Self-Supervised Representation Learning in One Model ARXIV-NEWEST · · capability 27.9

Which older AI stories has SIREN kept in the archive?

What questions do people actually ask?

What has SIREN scored about Pre-training?

40 scored stories match this published needle on SIREN (6 in the live window, 34 older in the archive). Pre-training research stories scored in the newsroom or archive — coverage counts, not a ranking.

Which scored stories are tagged Pre-training in this window?

6 scored stories matched this published needle in the current window. A tag page lists headlines — not a topic doom score.

Which older scored stories are tagged Pre-training?

Kept in the permanent archive after they left the live window. Still scored stories — not a forecast.

Which other tags have scored stories?

Other published tags that clear the substance gate, each linking What has SIREN scored about that tag?

Does SIREN publish a Pre-training doom score?

No. Activity tempo, not probability of harm. A tag page lists matching headlines — not a probability of harm and not a ranking of the companies named.

Which other tags have scored stories?

SIREN is free and carries no display ads. Keep it running: Support SIREN on Ko-fi →

News & alerts live · news – · SIREN score (hourly) Feedback ☕ Support𝕏 Post