title: One-Dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applications

abstract: The prevalent use of commercial and open-source diffusion models (DMs) for text-to-image generation prompts risk mitigation to prevent undesired behaviors. Existing concept erasing methods in academia are all based on full parameter or specification-based fine-tuning, from which we observe the following issues: 1) Generation alternation towards erosion: Parameter drift during target elimination causes alternations and potential deformations across all generations, even eroding other concepts at varying degrees, which is more evident with multi-concept erased; 2) Transfer inability & deployment inefficiency: Previous model-specific erasure impedes the flexible combination of concepts and the training-free transfer towards other models, resulting in linear cost growth as the deployment scenarios increase. To achieve non-invasive, precise, customizable, and transferable elimination, we ground our erasing framework on one-dimensional adapters to erase multiple concepts from most DMs at once across versatile erasing applications. The concept-SemiPermeable structure is injected as a Membrane (SPM) into any DM to learn targeted erasing, and meantime the alteration and erosion phenomenon is effectively mitigated via a novel Latent Anchoring fine-tuning strategy. Once obtained, SPMs can be flexibly combined and plug-and-play for other DMs without specific re-tuning, enabling timely and efficient adaptation to diverse scenarios. During generation, our Facilitated Transport mechanism dynamically regulates the permeability of each SPM to respond to different input prompts, further minimizing the impact on other concepts. Quantitative and qualitative results across ~40 concepts, 7 DMs and 4 erasing applications have demonstrated the superior erasing of SPM. Our code and pre-tuned SPMs are available on the project page https://lyumengyao.github.io/projects/spm.


title: Anti-absorbing ternary operations on metric spaces

abstract: The existence of a median-type ternary operation on a metric space is known to have a number of implications for the geometry of the space. For such operations, if two of the three arguments coincide, they also coincide with the output of the operation. We consider ternary operations with the opposite property: if two of the arguments coincide, the output is equal to the third one. The existence of such an operation is a necessary condition for the space to be an absolute retract.


title: Causal bounds on cosmological angular correlation

abstract: We test the hypothesis that angular correlations of gravitationally-induced temperature anisotropy in the cosmic microwave background (CMB) vanish over a range of large angular separations constrained by causality. Standard conformal geometry is used to show that if primordial quantum fluctuations generate physical correlations of gravitational potential only within compact causal diamonds bounded by inflationary horizons, the angular correlation function $C(\Theta)$ of gravitationally-induced CMB anisotropy should exactly vanish over a significant range of angular separation around $\Theta= 90^\circ$. This geometrical causal symmetry is shown to be consistent with CMB correlations in all-sky maps from the WMAP and Planck satellites, after accounting for the unmeasured dipole component and systematic measurement errors. Most significantly, the even-parity component of correlation $C_{even}(\Theta)$ is shown to be much closer to zero than previously documented, and orders of magnitude less than standard expectations. This occurrence is extremely unlikely in standard cosmological realizations based on a quantum field model: within the computed causal shadow, $\Theta= \pi/2 \pm \arcsin(1/4)$, or $75.52^\circ\lesssim\Theta\lesssim 104.48^\circ$, standard realizations are shown to produce residual correlations as small as those in the Planck maps with probabilities that range from $\simeq 10^{-4.3}$ to $\simeq 10^{-2.8}$. These results could signify that primordial quantum geometrical fluctuations obey a causal symmetry not included in the standard quantum field model.


title: The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Bias

abstract: The way the media presents events can significantly affect public perception, which in turn can alter people's beliefs and views. Media bias describes a one-sided or polarizing perspective on a topic. This article summarizes the research on computational methods to detect media bias by systematically reviewing 3140 research papers published between 2019 and 2022. To structure our review and support a mutual understanding of bias across research domains, we introduce the Media Bias Taxonomy, which provides a coherent overview of the current state of research on media bias from different perspectives. We show that media bias detection is a highly active research field, in which transformer-based classification approaches have led to significant improvements in recent years. These improvements include higher classification accuracy and the ability to detect more fine-granular types of bias. However, we have identified a lack of interdisciplinarity in existing projects, and a need for more awareness of the various types of media bias to support methodologically thorough performance evaluations of media bias detection systems. Concluding from our analysis, we see the integration of recent machine learning advancements with reliable and diverse bias assessment strategies from other research areas as the most promising area for future research contributions in the field.


title: SoundCount: Sound Counting from Raw Audio with Dyadic Decomposition Neural Network

abstract: In this paper, we study an underexplored, yet important and challenging problem: counting the number of distinct sounds in raw audio characterized by a high degree of polyphonicity. We do so by systematically proposing a novel end-to-end trainable neural network (which we call DyDecNet, consisting of a dyadic decomposition front-end and backbone network), and quantifying the difficulty level of counting depending on sound polyphonicity. The dyadic decomposition front-end progressively decomposes the raw waveform dyadically along the frequency axis to obtain time-frequency representation in multi-stage, coarse-to-fine manner. Each intermediate waveform convolved by a parent filter is further processed by a pair of child filters that evenly split the parent filter's carried frequency response, with the higher-half child filter encoding the detail and lower-half child filter encoding the approximation. We further introduce an energy gain normalization to normalize sound loudness variance and spectrum overlap, and apply it to each intermediate parent waveform before feeding it to the two child filters. To better quantify sound counting difficulty level, we further design three polyphony-aware metrics: polyphony ratio, max polyphony and mean polyphony. We test DyDecNet on various datasets to show its superiority, and we further show dyadic decomposition network can be used as a general front-end to tackle other acoustic tasks.


title: Quantum speed limit and non-Markovianity in structured environments

abstract: We investigate the relationship between quantum speed limit time and the non-Markovianity of an atom in structured environments. We show that there exists an inverse relation between them, which means that the non-Markovian feature of the quantum process leads to speedup of the process. Our results might shed light on the relationship between the speedup of quantum evolution and the backflow of information from the environment to the system.


title: Large-scale Long-tailed Disease Diagnosis on Radiology Images

abstract: Developing a generalist radiology diagnosis system can greatly enhance clinical diagnostics. In this paper, we introduce RadDiag, a foundational model supporting 2D and 3D inputs across various modalities and anatomies, using a transformer-based fusion module for comprehensive disease diagnosis. Due to patient privacy concerns and the lack of large-scale radiology diagnosis datasets, we utilize high-quality, clinician-reviewed radiological images available online with diagnosis labels. Our dataset, RP3D-DiagDS, contains 40,936 cases with 195,010 scans covering 5,568 disorders (930 unique ICD-10-CM codes). Experimentally, our RadDiag achieves 95.14% AUC on internal evaluation with the knowledge-enhancement strategy. Additionally, RadDiag can be zero-shot applied or fine-tuned to external diagnosis datasets sourced from various hospitals, demonstrating state-of-the-art results. In conclusion, we show that publicly shared medical data on the Internet is a tremendous and valuable resource that can potentially support building a generalist AI for healthcare.


title: Polynomial Reconstruction Problem for Hypergraphs

abstract: We show that, in general, the characteristic polynomial of a hypergraph is not determined by its ``polynomial deck'', the multiset of characteristic polynomials of its vertex-deleted subgraphs, thus settling the ``polynomial reconstruction problem'' for hypergraphs in the negative. The proof proceeds by showing that a construction due to Kocay of an infinite family of pairs of $3$-uniform hypergraphs which are non-isomorphic but share the same hypergraph deck, in fact, have different characteristic polynomials. The question remain unresolved for ordinary graphs.


title: Validating Light Phenomena Conceptual Assessment Through The Lens of CTT and IRT Frameworks

abstract: Light phenomena conceptual assessment (LPCA) is a conceptual survey of light phenomena that has been recently established by the physics education research (PER) scholars. Studying the LPCA psychometric properties is always imperative to inform its measurement validity to potential LPCA users or beyond general educational researchers. Classical Test Theory (CTT) and Item Response Theory (IRT) are two popular statistical frameworks that can be utilized to explore the LPCA measurement validity. To our knowledge, no PER studies have been attempted to make a head-to-head comparison of those methods while validating the LPCA. This study was the first to delineate the LPCA measurement by statistically comparing the CTT and IRT based analysis. The LPCA dataset was drawn from physics students of eight secondary schools presented by Ndihokubwayo et al (2020). Our results accomplished the harmony between the CTT and IRT arguments to estimate the LPCA item performance and students' ability probed by the LPCA. They supported that the LPCA may be used as inventory for evaluating conceptual understanding of light phenomena from low to high students' ability range even some flagged LPCA items were exist based on CTT and IRT arguments. Special considerations for further refinement related to the discriminating power for some problematic LPCA items are discussed.


abstract: This paper introduces an extension to the Orienteering Problem (OP), called Clustered Orienteering Problem with Subgroups (COPS). In this variant, nodes are arranged into subgroups, and the subgroups are organized into clusters. A reward is associated with each subgroup and is gained only if all of its nodes are visited; however, at most one subgroup can be visited per cluster. The objective is to maximize the total collected reward while attaining a travel budget. We show that our new formulation has the ability to model and solve two previous well-known variants, the Clustered Orienteering Problem (COP) and the Set Orienteering Problem (SOP), in addition to other scenarios introduced here. An Integer Linear Programming (ILP) formulation and a Tabu Search-based heuristic are proposed to solve the problem. Experimental results indicate that the ILP method can yield optimal solutions at the cost of time, whereas the metaheuristic produces comparable solutions within a more reasonable computational cost.


title: Construction under Martin's axiom of a Boolean algebra with the Grothendieck property but without the Nikodym property

abstract: Improving a result of M. Talagrand, under the assumption of a weak form of Martin's axiom, we construct a totally disconnected compact Hausdorff space $K$ such that the Banach space $C(K)$ of continuous real-valued functions on $K$ is a Grothendieck space but there exists a sequence $(\mu_n)$ of Radon measures on $K$ such that $\mu_n(A)\to0$ for every clopen set $A\subseteq K$ and $\int_Kfd\mu_n\not\to0$ for some $f\in C(K)$. Consequently, we get that Martin's axiom implies the existence of a Boolean algebra with the Grothendieck property but without the Nikodym property.


title: From Text to Multimodal: A Comprehensive Survey of Adversarial Example Generation in Question Answering Systems

abstract: Integrating adversarial machine learning with Question Answering (QA) systems has emerged as a critical area for understanding the vulnerabilities and robustness of these systems. This article aims to comprehensively review adversarial example-generation techniques in the QA field, including textual and multimodal contexts. We examine the techniques employed through systematic categorization, providing a comprehensive, structured review. Beginning with an overview of traditional QA models, we traverse the adversarial example generation by exploring rule-based perturbations and advanced generative models. We then extend our research to include multimodal QA systems, analyze them across various methods, and examine generative models, seq2seq architectures, and hybrid methodologies. Our research grows to different defense strategies, adversarial datasets, and evaluation metrics and illustrates the comprehensive literature on adversarial QA. Finally, the paper considers the future landscape of adversarial question generation, highlighting potential research directions that can advance textual and multimodal QA systems in the context of adversarial challenges.


title: Microscopic Optical Potentials from Chiral Forces and Ab Initio Nuclear Densities

abstract: We derived microscopic optical potentials (OPs) for elastic nucleon-nucleus scattering within the framework of chiral effective field theories at the first-order term of the spectator expansion of the Watson multiple-scattering theory and adopting the impulse approximation. Our OPs are derived by folding ab initio nuclear densities with a nucleon-nucleon NN t matrix computed with a consistent chiral interaction. The results of our OPs are in good agreement with the experimental data. Recent achievements of our work are reviewed in this contribution.


title: Association rule mining with earthquake data collected from Turkiye region

abstract: Earthquakes are evaluated among the most destructive disasters for human beings, as also experienced for Turkiye region. Data science has the property of discovering hidden patterns in case a sufficient volume of data is supplied. Time dependency of events, specifically being defined by co-occurrence in a specific time window, may be handled as an associate rule mining task such as a market-basket analysis application. In this regard, we assumed each day's seismic activity as a single basket of events, leading to discovering the association patterns between these events. Consequently, this study presents the most prominent association rules for the earthquakes recorded in Turkiye region in the last 5 years, each year presented separately. Results indicate statistical inference with events recorded from regions of various distances, which could be further verified with geologic evidence from the field. As a result, we believe that the current study may form a statistical basis for the future works with the aid of machine learning algorithm performed for associate rule mining.


title: Zero-Shot Cross-Lingual Reranking with Large Language Models for Low-Resource Languages

abstract: Large language models (LLMs) have shown impressive zero-shot capabilities in various document reranking tasks. Despite their successful implementations, there is still a gap in existing literature on their effectiveness in low-resource languages. To address this gap, we investigate how LLMs function as rerankers in cross-lingual information retrieval (CLIR) systems for African languages. Our implementation covers English and four African languages (Hausa, Somali, Swahili, and Yoruba) and we examine cross-lingual reranking with queries in English and passages in the African languages. Additionally, we analyze and compare the effectiveness of monolingual reranking using both query and document translations. We also evaluate the effectiveness of LLMs when leveraging their own generated translations. To get a grasp of the effectiveness of multiple LLMs, our study focuses on the proprietary models RankGPT-4 and RankGPT-3.5, along with the open-source model, RankZephyr. While reranking remains most effective in English, our results reveal that cross-lingual reranking may be competitive with reranking in African languages depending on the multilingual capability of the LLM.


title: SymmPI: Predictive Inference for Data with Group Symmetries

abstract: Quantifying the uncertainty of predictions is a core problem in modern statistics. Methods for predictive inference have been developed under a variety of assumptions, often -- for instance, in standard conformal prediction -- relying on the invariance of the distribution of the data under special groups of transformations such as permutation groups. Moreover, many existing methods for predictive inference aim to predict unobserved outcomes in sequences of feature-outcome observations. Meanwhile, there is interest in predictive inference under more general observation models (e.g., for partially observed features) and for data satisfying more general distributional symmetries (e.g., rotationally invariant or coordinate-independent observations in physics). Here we propose SymmPI, a methodology for predictive inference when data distributions have general group symmetries in arbitrary observation models. Our methods leverage the novel notion of distributional equivariant transformations, which process the data while preserving their distributional invariances. We show that SymmPI has valid coverage under distributional invariance and characterize its performance under distribution shift, recovering recent results as special cases. We apply SymmPI to predict unobserved values associated to vertices in a network, where the distribution is unchanged under relabelings that keep the network structure unchanged. In several simulations in a two-layer hierarchical model, and in an empirical data analysis example, SymmPI performs favorably compared to existing methods.


title: Can the creation of separate bidding zones within countries create imbalances in PV uptake? Evidence from Sweden

abstract: This paper estimates how electricity price divergence within Sweden has affected incentives to invest in photovoltaic (PV) generation between 2016 and 2022 based on a synthetic control approach. Sweden is chosen as the research subject since it is together with Italy the only EU country with multiple bidding zones and is facing dramatic divergence in electricity prices between low-tariff bidding zones in Northern and high-tariff bidding zones in Southern Sweden since 2020. The results indicate that PV uptake in municipalities located north of the bidding zone border is reduced by 40.9-48% compared to their Southern counterparts. Based on these results, the creation of separate bidding zones within countries poses a threat to the expansion of PV generation and other renewables since it disincentivizes investment in areas with low electricity prices.


title: Properties of Test Statistics for Nonparametric Cointegrating Regression Functions Based on Subsamples

abstract: Nonparametric cointegrating regression models have been extensively used in financial markets, stock prices, heavy traffic, climate data sets, and energy markets. Models with parametric regression functions can be more appealing in practice compared to non-parametric forms, but do result in potential functional misspecification. Thus, there exists a vast literature on developing a model specification test for parametric forms of regression functions. In this paper, we develop two test statistics which are applicable for the endogenous regressors driven by long memory and semi-long memory input shocks in the regression model. The limit distributions of the test statistics under these two scenarios are complicated and cannot be effectively used in practice. To overcome this difficulty, we use the subsampling method and compute the test statistics on smaller blocks of the data to construct their empirical distributions. Throughout, Monte Carlo simulation studies are used to illustrate the properties of test statistics. We also provide an empirical example of relating gross domestic product to total output of carbon dioxide in two European countries.


title: Age of Information in Gossip Networks: A Friendly Introduction and Literature Survey

abstract: Gossiping is a communication mechanism, used for fast information dissemination in a network, where each node of the network randomly shares its information with the neighboring nodes. To characterize the notion of fastness in the context of gossip networks, age of information (AoI) is used as a timeliness metric. In this article, we summarize the recent works related to timely gossiping in a network. We start with the introduction of randomized gossip algorithms as an epidemic algorithm for database maintenance, and how the gossiping literature was later developed in the context of rumor spreading, message passing and distributed mean estimation. Then, we motivate the need for timely gossiping in applications such as source tracking and decentralized learning. We evaluate timeliness scaling of gossiping in various network topologies, such as, fully connected, ring, grid, generalized ring, hierarchical, and sparse asymmetric networks. We discuss age-aware gossiping and the higher order moments of the age process. We also consider different variations of gossiping in networks, such as, file slicing and network coding, reliable and unreliable sources, information mutation, different adversarial actions in gossiping, and energy harvesting sensors. Finally, we conclude this article with a few open problems and future directions in timely gossiping.


title: Andreev bound states in superconductor-barrier-superconductor junctions of Rarita-Schwinger-Weyl semimetals

abstract: We consider a superconductor-barrier-superconductor configuration built with Rarita-Schwinger-Weyl semimetal, which features four bands crossing at a single nodal point. Assuming a homogeneous s-wave pairing in each superconducting region, and the barrier region created by applying a voltage of magnitude $V_0 $ across a piece of normal state semimetal, we apply the BdG formalism to compute the discrete energy spectrum $\varepsilon $ of the subgap Andreev bound states in the short-barrier regime. In contrast with the two-band semimetals studied earlier, we find upto four pairs of localized states (rather than one pair for two-band semimetals) in the thin-barrier limit, and each value of $\varepsilon $ has a complicated dependence on the phase difference $\varphi_{12} $ via cosine and sine functions, which cannot be determined analytically. These are artifacts of multi-band nodes hosting quasiparticles of pseudospin values greater than $1/2$. Using the bound state energies, we compute the Josephson current across the junction configuration.


title: Overcoming the Coherence Time Barrier in Quantum Machine Learning on Temporal Data

abstract: The practical implementation of many quantum algorithms known today is believed to be limited by the coherence time of the executing quantum hardware and quantum sampling noise. Here we present a machine learning algorithm, NISQRC, for qubit-based quantum systems that enables processing of temporal data over durations unconstrained by the finite coherence times of constituent qubits. NISQRC strikes a balance between input encoding steps and mid-circuit measurements with reset to endow the quantum system with an appropriate-length persistent temporal memory to capture the time-domain correlations in the streaming data. This enables NISQRC to overcome not only limitations imposed by finite coherence, but also information scrambling or thermalization in monitored circuits. The latter is believed to prevent known parametric circuit learning algorithms even in systems with perfect coherence from operating beyond a finite time period on streaming data. By extending the Volterra Series analysis of dynamical systems theory to quantum systems, we identify measurement and reset conditions necessary to endow a monitored quantum circuit with a finite memory time. To validate our approach, we consider the well-known channel equalization task to recover a test signal of $N_{ts}$ symbols that is subject to a noisy and distorting channel. Through experiments on a 7-qubit quantum processor and numerical simulations we demonstrate that $N_{ts}$ can be arbitrarily long not limited by the coherence time.


title: Microwave signal processing using an analog quantum reservoir computer

abstract: Quantum reservoir computing (QRC) has been proposed as a paradigm for performing machine learning with quantum processors where the training is efficient in the number of required runs of the quantum processor and takes place in the classical domain, avoiding the issue of barren plateaus in parameterized-circuit quantum neural networks. It is natural to consider using a quantum processor based on superconducting circuits to classify microwave signals that are analog -- continuous in time. However, while theoretical proposals of analog QRC exist, to date QRC has been implemented using circuit-model quantum systems -- imposing a discretization of the incoming signal in time, with each time point input by executing a gate operation. In this paper we show how a quantum superconducting circuit comprising an oscillator coupled to a qubit can be used as an analog quantum reservoir for a variety of classification tasks, achieving high accuracy on all of them. Our quantum system was operated without artificially discretizing the input data, directly taking in microwave signals. Our work does not attempt to address the question of whether QRCs could provide a quantum computational advantage in classifying pre-recorded classical signals. However, beyond illustrating that sophisticated tasks can be performed with a modest-size quantum system and inexpensive training, our work opens up the possibility of achieving a different kind of advantage than a purely computational advantage: superconducting circuits can act as extremely sensitive detectors of microwave photons; our work demonstrates processing of ultra-low-power microwave signals in our superconducting circuit, and by combining sensitive detection with QRC processing within the same system, one could achieve a quantum sensing-computational advantage, i.e., an advantage in the overall analysis of microwave signals comprising just a few photons.


title: Tensor network representation of non-abelian gauge theory coupled to reduced staggered fermions

abstract: We show how to construct a tensor network representation of the path integral for reduced staggered fermions coupled to a non-abelian gauge field in two dimensions. The resulting formulation is both memory and computation efficient because reduced staggered fermions can be represented in terms of a minimal number of tensor indices while the gauge sector can be approximated using Gaussian quadrature with a truncation. Numerical results obtained using the Grassmann TRG algorithm are shown for the case of $SU(2)$ lattice gauge theory and compared to Monte Carlo results.


title: Social-Transmotion: Promptable Human Trajectory Prediction

abstract: Accurate human trajectory prediction is crucial for applications such as autonomous vehicles, robotics, and surveillance systems. Yet, existing models often fail to fully leverage the non-verbal social cues human subconsciously communicate when navigating the space. To address this, we introduce Social-Transmotion, a generic Transformer-based model that exploits diverse and numerous visual cues to predict human behavior. We translate the idea of a prompt from Natural Language Processing (NLP) to the task of human trajectory prediction, where a prompt can be a sequence of x-y coordinates on the ground, bounding boxes in the image plane, or body pose keypoints in either 2D or 3D. This, in turn, augments trajectory data, leading to enhanced human trajectory prediction. Using masking technique, our model exhibits flexibility and adaptability by capturing spatiotemporal interactions between agents based on the available visual cues. We delve into the merits of using 2D versus 3D poses, and a limited set of poses. Additionally, we investigate the spatial and temporal attention map to identify which keypoints and time-steps in the sequence are vital for optimizing human trajectory prediction. Our approach is validated on multiple datasets, including JTA, JRDB, Pedestrians and Cyclists in Road Traffic, and ETH-UCY. The code is publicly available: https://github.com/vita-epfl/social-transmotion.


title: Quantum squeezing in a nonlinear mechanical oscillator

abstract: Mechanical degrees of freedom are natural candidates for continuous-variable quantum information processing and bosonic quantum simulations. These applications, however, require the engineering of squeezing and nonlinearities in the quantum regime. Here we demonstrate ground state squeezing of a gigahertz-frequency mechanical resonator coupled to a superconducting qubit. This is achieved by parametrically driving the qubit, which results in an effective two-phonon drive. In addition, we show that the resonator mode inherits a nonlinearity from the off-resonant coupling with the qubit, which can be tuned by controlling the detuning. We thus realize a mechanical squeezed Kerr oscillator, where we demonstrate the preparation of non-Gaussian quantum states of motion with Wigner function negativities and high quantum Fisher information. This shows that our results also have applications in quantum metrology and sensing.


title: EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI

abstract: In the realm of computer vision and robotics, embodied agents are expected to explore their environment and carry out human instructions. This necessitates the ability to fully understand 3D scenes given their first-person observations and contextualize them into language for interaction. However, traditional research focuses more on scene-level input and output setups from a global view. To address the gap, we introduce EmbodiedScan, a multi-modal, ego-centric 3D perception dataset and benchmark for holistic 3D scene understanding. It encompasses over 5k scans encapsulating 1M ego-centric RGB-D views, 1M language prompts, 160k 3D-oriented boxes spanning over 760 categories, some of which partially align with LVIS, and dense semantic occupancy with 80 common categories. Building upon this database, we introduce a baseline framework named Embodied Perceptron. It is capable of processing an arbitrary number of multi-modal inputs and demonstrates remarkable 3D perception capabilities, both within the two series of benchmarks we set up, i.e., fundamental 3D perception tasks and language-grounded tasks, and in the wild. Codes, datasets, and benchmarks will be available at https://github.com/OpenRobotLab/EmbodiedScan.


title: Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4

abstract: This paper introduces 26 guiding principles designed to streamline the process of querying and prompting large language models. Our goal is to simplify the underlying concepts of formulating questions for various scales of large language models, examining their abilities, and enhancing user comprehension on the behaviors of different scales of large language models when feeding into different prompts. Extensive experiments are conducted on LLaMA-1/2 (7B, 13B and 70B), GPT-3.5/4 to verify the effectiveness of the proposed principles on instructions and prompts design. We hope that this work can provide a better guide for researchers working on the prompting of large language models. Project page is available at https://github.com/VILA-Lab/ATLAS.


title: Balanced Turbulence and the Helicity Barrier in Black Hole Accretion

abstract: Horizon-scale observations from the Event Horizon Telescope (EHT) have enabled precision study of supermassive black hole accretion. Contemporary accretion modeling often treats the inflowing plasma as a single, thermal fluid, but microphysical kinetic effects can lead to significant deviations from this idealized picture. We investigate how the helicity barrier influences EHT-accessible electromagnetic observables by employing a simple model for electron heating based on kinetic physics and the cascade of energy and helicity in unbalanced turbulence. Although the helicity barrier plays only a minor role in regions with high plasma-beta, like in SANE disks, it may substantially impact in regions with more ordered magnetic fields, such as the jet and its surrounding wind in SANE flows as well as throughout the entire domain in MAD flows. In SANE flows, emission shifts from the funnel wall towards the lower-magnetization disk region; in MAD flows the emission morphology remains largely unchanged. Including the helicity barrier leads to characteristically lower electron temperatures, and neglecting it can lead to underestimated accretion rates and inferred jet powers. The corresponding higher plasma densities result in increased depolarization and Faraday depths thereby decreasing the amplitude of the beta_2 coefficient while leaving its angle unchanged. Both the increased jet power and lower |beta_2| may help alleviate outstanding tensions between modeling and EHT observations. We also find that the estimated ring diameter may be underestimated when the helicity barrier is neglected. Our results underscore the significance of the helicity barrier in shaping black hole observables and inferred accretion system parameters.


title: A Statistical Field Perspective on Capital Allocation and Accumulation

abstract: This paper provides a general method to translate a standard economic model with a large number of agents into a field-formalism model. This formalism preserves the system's interactions and microeconomic features at the individual level but reveals the emergence of collective states.We apply this method to a simple microeconomic framework of investors and firms. Both macro and micro aspects of the formalism are studied.At the macro-scale, the field formalism shows that, in each sector, three patterns of capital accumulation may emerge. A distribution of patterns across sectors constitute a collective state. Any change in external parameters or expectations in one sector will affect neighbouring sectors, inducing transitions between collective states and generating permanent fluctuations in patterns and flows of capital. Although changes in expectations can cause abrupt changes in collective states, transitions may be slow to occur. Due to its relative inertia, the real economy is bound to be more affected by these constant variations than the financial markets.At the micro-scale we compute the transition functions of individual agents and study their probabilistic dynamics in a given collective state, as a function of their initial state. We show that capital accumulation of an individual agent depends on various factors. The probability associated with each firm's trajectories is the result of several contradictory effects: the firm tends to shift towards sectors with the greatest long-term return, but must take into account the impact of its shift on its attractiveness for investors throughout its trajectory. Since this trajectory depends largely on the average capital of transition sectors, a firm's attractiveness during its relocation depends on the relative level of capital in those sectors. Moreover, the firm must also consider the effects of competition in the intermediate sectors that tends to oust under-capitalized firm towards sectors with lower average capital. For investors, capital allocation depends on their short and long-term returns and investors will tend to reallocate their capital to maximize both. The higher their level of capital, the stronger the re-allocation will be.


title: Industrial Internet of Things Intelligence Empowering Smart Manufacturing: A Literature Review

abstract: The fiercely competitive business environment and increasingly personalized customization needs are driving the digital transformation and upgrading of the manufacturing industry. IIoT intelligence, which can provide innovative and efficient solutions for various aspects of the manufacturing value chain, illuminates the path of transformation for the manufacturing industry. It's time to provide a systematic vision of IIoT intelligence. However, existing surveys often focus on specific areas of IIoT intelligence, leading researchers and readers to have biases in their understanding of IIoT intelligence, that is, believing that research in one direction is the most important for the development of IIoT intelligence, while ignoring contributions from other directions. Therefore, this paper provides a comprehensive overview of IIoT intelligence. We first conduct an in-depth analysis of the inevitability of manufacturing transformation and study the successful experiences from the practices of Chinese enterprises. Then we give our definition of IIoT intelligence and demonstrate the value of IIoT intelligence for industries in fucntions, operations, deployments, and application. Afterwards, we propose a hierarchical development architecture for IIoT intelligence, which consists of five layers. The practical values of technical upgrades at each layer are illustrated by a close look on lighthouse factories. Following that, we identify seven kinds of technologies that accelerate the transformation of manufacturing, and clarify their contributions. The ethical implications and environmental impacts of adopting IIoT intelligence in manufacturing are analyzed as well. Finally, we explore the open challenges and development trends from four aspects to inspire future researches.


title: Exploration of field-like torque and field-angle tunability in coupled spin-torque nano oscillators for synchronization

abstract: We investigate the influence of field-like torque and the direction of the external magnetic field on a one-dimensional array of serially connected spin-torque nano oscillators, having free layers with perpendicular anisotropy, to achieve complete synchronization between them by analyzing the associated Landau-Lifshitz-Gilbert-Slonczewski equation. The obtained results for synchronization are discussed for the cases of 2, 10 and 100 oscillators separately. The roles of the field-like torque and the direction of the external field on the synchronization of the STNOs are explored through the Kuramoto order parameter. While the field-like torque alone is sufficient to bring out global synchronization in the system made up of a small number of STNOs, the direction of the external field is also needed to be slightly tuned to synchronize the one-dimensional array of a large number of STNOs. The formation of complete synchronization through the construction of clusters within the system is identified for the 100 oscillators. The large amplitude synchronized oscillations are obtained for small to large numbers of oscillators. Moreover, the tunability in frequency for a wide range of currents is shown for the synchronized oscillations up to 100 spin-torque oscillators. In addition to achieving synchronization, the field-like torque increases the frequency of the synchronized oscillations. The transverse Lyapunov exponents are deduced to confirm the stable synchronization in coupled STNOs due to the field-like torque and to validate the results obtained in the numerical simulations. The output power of the array is estimated to be enhanced substantially due to complete synchronization by the combined effect of field-like torque and tunability of the field angle.


title: GreenFlow: A Computation Allocation Framework for Building Environmentally Sound Recommendation System

abstract: Given the enormous number of users and items, industrial cascade recommendation systems (RS) are continuously expanded in size and complexity to deliver relevant items, such as news, services, and commodities, to the appropriate users. In a real-world scenario with hundreds of thousands requests per second, significant computation is required to infer personalized results for each request, resulting in a massive energy consumption and carbon emission that raises concern. This paper proposes GreenFlow, a practical computation allocation framework for RS, that considers both accuracy and carbon emission during inference. For each stage (e.g., recall, pre-ranking, ranking, etc.) of a cascade RS, when a user triggers a request, we define two actions that determine the computation: (1) the trained instances of models with different computational complexity; and (2) the number of items to be inferred in the stage. We refer to the combinations of actions in all stages as action chains. A reward score is estimated for each action chain, followed by dynamic primal-dual optimization considering both the reward and computation budget. Extensive experiments verify the effectiveness of the framework, reducing computation consumption by 41% in an industrial mobile application while maintaining commercial revenue. Moreover, the proposed framework saves approximately 5000kWh of electricity and reduces 3 tons of carbon emissions per day.


title: Learning to Infer Unobserved Behaviors: Estimating User's Preference for a Site over Other Sites

abstract: A site's recommendation system relies on knowledge of its users' preferences to offer relevant recommendations to them. These preferences are for attributes that comprise items and content shown on the site, and are estimated from the data of users' interactions with the site. Another form of users' preferences is material too, namely, users' preferences for the site over other sites, since that shows users' base level propensities to engage with the site. Estimating users' preferences for the site, however, faces major obstacles because (a) the focal site usually has no data of its users' interactions with other sites; these interactions are users' unobserved behaviors for the focal site; and (b) the Machine Learning literature in recommendation does not offer a model of this situation. Even if (b) is resolved, the problem in (a) persists since without access to data of its users' interactions with other sites, there is no ground truth for evaluation. Moreover, it is most useful when (c) users' preferences for the site can be estimated at the individual level, since the site can then personalize recommendations to individual users. We offer a method to estimate individual user's preference for a focal site, under this premise. In particular, we compute the focal site's share of a user's online engagements without any data from other sites. We show an evaluation framework for the model using only the focal site's data, allowing the site to test the model. We rely upon a Hierarchical Bayes Method and perform estimation in two different ways - Markov Chain Monte Carlo and Stochastic Gradient with Langevin Dynamics. Our results find good support for the approach to computing personalized share of engagement and for its evaluation.


title: Purity-dependent Lorenz number, electron hydrodynamics and electron-phonon coupling in WTe$_2$

abstract: We present a study of electrical and thermal transport in Weyl semimetal WTe$_2$ down to 0.3 K. The Wiedemann-Franz law holds below 2 K and a downward deviation starts above. The deviation is more pronounced in cleaner samples, as expected in the hydrodynamic picture of electronic transport, where a fraction of electron-electron collisions conserve momentum. Phonons are the dominant heat carriers and their mean-free-path do not display a Knudsen minimum. This is presumably a consequence of weak anharmonicity, as indicated by the temperature dependence of the specific heat. Frequent momentum exchange between phonons and electrons leads to quantum oscillations of the phononic thermal conductivity. Bloch-Gr\"uneisen picture of electron-phonon scattering breaks down at low temperature when Umklapp ph-ph collisions cease to be a sink for electronic flow of momentum. Comparison with semi-metallic Sb shows that normal ph-ph collisions are amplified by anharmonicity. In both semimetals, at cryogenic temperature, e-ph collisions degrade the phononic flow of energy but not the electronic flow of momentum.


title: European Football Player Valuation: Integrating Financial Models and Network Theory

abstract: This paper presents a new framework for player valuation in European football by fusing principles from financial mathematics and network theory. The valuation model leverages a "passing matrix" to encapsulate player interactions on the field, utilizing centrality measures to quantify individual influence. Unlike traditional approaches, this model is both metric-driven and cohort-free, providing a dynamic and individualized framework for ascertaining a player's fair market value. The methodology is empirically validated through a case study in European football, employing real-world match and financial data. The paper advances the disciplines of sports analytics and financial mathematics by offering a cross-disciplinary mechanism for player valuation, and also links together two well-known econometric methods in marginal revenue product and expected present valuation.

categories: physics.soc-ph q-fin.CP q-fin.PR stat.AP


title: Investigating salient representations and label Variance in Dimensional Speech Emotion Analysis

abstract: Representations derived from models such as BERT (Bidirectional Encoder Representations from Transformers) and HuBERT (Hidden units BERT), have helped to achieve state-of-the-art performance in dimensional speech emotion recognition. Despite their large dimensionality, and even though these representations are not tailored for emotion recognition tasks, they are frequently used to train large speech emotion models with high memory and computational costs. In this work, we show that there exist lower-dimensional subspaces within the these pre-trained representational spaces that offer a reduction in downstream model complexity without sacrificing performance on emotion estimation. In addition, we model label uncertainty in the form of grader opinion variance, and demonstrate that such information can improve the models generalization capacity and robustness. Finally, we compare the robustness of the emotion models against acoustic degradations and observed that the reduced dimensional representations were able to retain the performance similar to the full-dimensional representations without significant regression in dimensional emotion performance.


title: On generalized Li-Yau inequalities

abstract: We generalize the Li-Yau inequality for second derivatives and we also establish Li-Yau type inequality for fourth derivatives. Our derivation relies on the representation formula for the heat equation.


title: Tunneling-like wave transmission in non-Hermitian lattices with mirrored nonreciprocity

abstract: We report a peculiar tunneling phenomenon that occurs in lattices with nonreciprocal inter-site couplings. The nonreciprocity holds for an inner portion of the lattice, constituting a non-Hermitian interface between outer Hermitian sections. The couplings are mirrored about the interface center, with the smaller strength directed outwards. As a standalone system that was widely studied in recent years, each section of the interface supports the non-Hermitian skin effect, in which modes are accumulated at the boundary of the weaker coupling. Here, we investigate what happens to a wave that propagates along the lattice and hits the interface. The skin mode accumulation, which effectively constitutes a barrier, forbids wave penetration into the interface, but surprisingly, under certain conditions the wave is transmitted to the other side, keeping the interface dark, as if the wave invisibly tunneled through it. Remarkably, the tunneling is independent of the interface length. We derive the phenomenon both for quantum and classical systems, and realize it experimentally in an active topoelectric metamaterial. Our study fosters the research of wave tunneling through other types of non-Hermitian interfaces, which may also include nonlinearities, time-dependence and more.


title: LightGCN: Evaluated and Enhanced

abstract: This paper analyses LightGCN in the context of graph recommendation algorithms. Despite the initial design of Graph Convolutional Networks for graph classification, the non-linear operations are not always essential. LightGCN enables linear propagation of embeddings, enhancing performance. We reproduce the original findings, assess LightGCN's robustness on diverse datasets and metrics, and explore Graph Diffusion as an augmentation of signal propagation in LightGCN.


title: Dynamic Knowledge Injection for AIXI Agents

abstract: Prior approximations of AIXI, a Bayesian optimality notion for general reinforcement learning, can only approximate AIXI's Bayesian environment model using an a-priori defined set of models. This is a fundamental source of epistemic uncertainty for the agent in settings where the existence of systematic bias in the predefined model class cannot be resolved by simply collecting more data from the environment. We address this issue in the context of Human-AI teaming by considering a setup where additional knowledge for the agent in the form of new candidate models arrives from a human operator in an online fashion. We introduce a new agent called DynamicHedgeAIXI that maintains an exact Bayesian mixture over dynamically changing sets of models via a time-adaptive prior constructed from a variant of the Hedge algorithm. The DynamicHedgeAIXI agent is the richest direct approximation of AIXI known to date and comes with good performance guarantees. Experimental results on epidemic control on contact networks validates the agent's practical utility.


title: Linear and nonlinear causality in financial markets

abstract: Identifying and quantifying co-dependence between financial instruments is a key challenge for researchers and practitioners in the financial industry. Linear measures such as the Pearson correlation are still widely used today, although their limited explanatory power is well known. In this paper we present a much more general framework for assessing co-dependencies by identifying and interpreting linear and nonlinear causalities in the complex system of financial markets. To do so, we use two different causal inference methods, transfer entropy and convergent cross-mapping, and employ Fourier transform surrogates to separate their linear and nonlinear contributions. We find that stock indices in Germany and the U.S. exhibit a significant degree of nonlinear causality and that correlation, while a very good proxy for linear causality, disregards nonlinear effects and hence underestimates causality itself. The presented framework enables the measurement of nonlinear causality, the correlation-causality fallacy, and motivates how causality can be used for inferring market signals, pair trading, and risk management of portfolios. Our results suggest that linear and nonlinear causality can be used as early warning indicators of abnormal market behavior, allowing for better trading strategies and risk management.


title: Discovery of astrometric accelerations by dark companions in the globular cluster $\omega$ Centauri

abstract: We present results from the search for astrometric accelerations of stars in $\omega$ Centauri using 13 years of regularly-scheduled {\it Hubble Space Telescope} WFC3/UVIS calibration observations in the cluster core. The high-precision astrometry of $\sim$160\,000 sources was searched for significant deviations from linear proper motion. This led to the discovery of four cluster members and one foreground field star with compelling acceleration patterns. We interpret them as the result of the gravitational pull by an invisible companion and determined preliminary Keplerian orbit parameters, including the companion's mass. {For the cluster members} our analysis suggests periods ranging from 8.8 to 19+ years and dark companions in the mass range of $\sim$0.7 to $\sim$1.4$M_\mathrm{sun}$. At least one companion could exceed the upper mass-boundary of white dwarfs and can be classified as a neutron-star candidate.


title: Log canonical threshold of du Val singularities

abstract: In this paper, we show the log canonical threshold values of the surfaces which has du Val type singularities.These surfaces can be interpreted as statistical or machine learning models. The results of $A_n, D_n, E_6, E_7$ and $E_8$ are shown. Bacause the calculation is done on complex fileld, this result would be different from the real fileld, which is in singular learning theory.


title: The curious case of the test set AUROC

abstract: Whilst the size and complexity of ML models have rapidly and significantly increased over the past decade, the methods for assessing their performance have not kept pace. In particular, among the many potential performance metrics, the ML community stubbornly continues to use (a) the area under the receiver operating characteristic curve (AUROC) for a validation and test cohort (distinct from training data) or (b) the sensitivity and specificity for the test data at an optimal threshold determined from the validation ROC. However, we argue that considering scores derived from the test ROC curve alone gives only a narrow insight into how a model performs and its ability to generalise.


title: OpenRL: A Unified Reinforcement Learning Framework

abstract: We present OpenRL, an advanced reinforcement learning (RL) framework designed to accommodate a diverse array of tasks, from single-agent challenges to complex multi-agent systems. OpenRL's robust support for self-play training empowers agents to develop advanced strategies in competitive settings. Notably, OpenRL integrates Natural Language Processing (NLP) with RL, enabling researchers to address a combination of RL training and language-centric tasks effectively. Leveraging PyTorch's robust capabilities, OpenRL exemplifies modularity and a user-centric approach. It offers a universal interface that simplifies the user experience for beginners while maintaining the flexibility experts require for innovation and algorithm development. This equilibrium enhances the framework's practicality, adaptability, and scalability, establishing a new standard in RL research. To delve into OpenRL's features, we invite researchers and enthusiasts to explore our GitHub repository at https://github.com/OpenRL-Lab/openrl and access our comprehensive documentation at https://openrl-docs.readthedocs.io.


title: Hawkes-based cryptocurrency forecasting via Limit Order Book data

abstract: Accurately forecasting the direction of financial returns poses a formidable challenge, given the inherent unpredictability of financial time series. The task becomes even more arduous when applied to cryptocurrency returns, given the chaotic and intricately complex nature of crypto markets. In this study, we present a novel prediction algorithm using limit order book (LOB) data rooted in the Hawkes model, a category of point processes. Coupled with a continuous output error (COE) model, our approach offers a precise forecast of return signs by leveraging predictions of future financial interactions. Capitalizing on the non-uniformly sampled structure of the original time series, our strategy surpasses benchmark models in both prediction accuracy and cumulative profit when implemented in a trading environment. The efficacy of our approach is validated through Monte Carlo simulations across 50 scenarios. The research draws on LOB measurements from a centralized cryptocurrency exchange where the stablecoin Tether is exchanged against the U.S. dollar.


title: SoK: Taming the Triangle -- On the Interplays between Fairness, Interpretability and Privacy in Machine Learning

abstract: Machine learning techniques are increasingly used for high-stakes decision-making, such as college admissions, loan attribution or recidivism prediction. Thus, it is crucial to ensure that the models learnt can be audited or understood by human users, do not create or reproduce discrimination or bias, and do not leak sensitive information regarding their training data. Indeed, interpretability, fairness and privacy are key requirements for the development of responsible machine learning, and all three have been studied extensively during the last decade. However, they were mainly considered in isolation, while in practice they interplay with each other, either positively or negatively. In this Systematization of Knowledge (SoK) paper, we survey the literature on the interactions between these three desiderata. More precisely, for each pairwise interaction, we summarize the identified synergies and tensions. These findings highlight several fundamental theoretical and empirical conflicts, while also demonstrating that jointly considering these different requirements is challenging when one aims at preserving a high level of utility. To solve this issue, we also discuss possible conciliation mechanisms, showing that a careful design can enable to successfully handle these different concerns in practice.


title: A Method for Auto-Differentiation of the Voronoi Tessellation

abstract: Voronoi tessellation, also known as Voronoi diagram, is an important computational geometry technique that has applications in various scientific disciplines. It involves dividing a given space into regions based on the proximity to a set of points. Autodifferentiation is a powerful tool for solving optimization tasks. Autodifferentiation assumes constructing a computational graph that allows to compute gradients using backpropagation algorithm. However, often the Voronoi tessellation remains the only non-differentiable part of a pipeline, prohibiting end-to-end differentiation. We present the method for autodifferentiation of the 2D Voronoi tessellation. The method allows one to construct the Voronoi tessellation and pass gradients, making the construction end-to-end differentiable. We provide the implementation details and present several important applications. To the best of our knowledge this is the first autodifferentiable realization of the Voronoi tessellation providing full set of Voronoi geometrical parameters in a differentiable way.


title: Cross-border Exchange of CBDCs using Layer-2 Blockchain

abstract: This paper proposes a novel multi-layer blockchain architecture for the cross-border trading of CBDCs. The permissioned layer-2, by relying on the public consensus of the underlying network, assures the security and integrity of the transactions and ensures interoperability with domestic CBDCs implementations. Multiple Layer-3s operate various Automated Market Makers (AMMs) and compete with each other for the lowest costs. To provide insights into the practical implications of the system, simulations of trading costs are conducted based on historical FX rates, with Project Mariana as a benchmark. The study shows that, even with liquidity fragmentation, a multi-layer and multi-AMM setup is more cost-efficient than a single AMM.


title: Multimodal machine learning for 3-dimensional characterization of hidden groundwater and geothermal resources

abstract: We present a multimodal machine learning (MML) workflow to assimilate and simultaneously predict the 3d distribution of numeric and categorical features along a groundwater-geothermal continuum. Success of the MML workflow relies on a transductive learning algorithm that projects field modalities onto a single embedding space (hypersurface). Multimodalities can include any combination of measured (point field) and derived (multiphysics based numerical model inversions, data driven machine learning, and multiphysics informed machine learning) features. The proposed MML workflow is applied to assimilate randomly shuffled subsets of Hawaii Play Fairway modalities and predict subsurface geophysical, geologic, and hydrogeologic features at the Islands of Lanai and Hawaii. Despite challenging field data characteristics (disparate, scale dependent, spatially limited, sparse, and uncertain), the MML workflow yields a single 3d transdisciplinary model that generalizes well to independent data presented to the trained model. The predicted features are used to identify hidden groundwater and geothermal resources at Lanai, and geothermal resources at Hawaii. Other interpreted subsurface features at Lanai include basalt, batholith, dike swarm, pluton, sill, mantle, Moho, and 3d geothermal stratigraphic units; whereas interpreted subsurface features at Hawaii include 3d velocity layering, 3d earthquake-fault associations, 3d fault systems; basalt, oceanic crust, magmatic underplating, lithospheric flexure, mantle, and Moho. This study provides new capabilities for characterizing continuous subsurface groundwater and geothermal features for sustainable living in the Hawaiian Islands and other geothermal sites worldwide. Keywords: Machine learning, 3d hidden groundwater resources, hidden geothermal resources fault system, oceanic crust, magmatic underplating, lithospheric flexure, Moho, Hawaii


title: Nonequilibrium formulation of varying-temperature bit erasure

abstract: Landauer's principle states that erasing a bit of information at fixed temperature T costs at least kT ln 2 units of work. Here we investigate erasure at varying temperature, to which Landauer's result does not apply. We formulate bit erasure as a stochastic nonequilibrium process involving a compression of configuration space, with physical and logical states associated in a symmetric way. Erasure starts and ends at temperature T, but temperature can otherwise vary with time in an arbitrary way. Defined in this way, erasure is governed by a set of nonequilibrium fluctuation relations that show that varying-temperature erasure can done with less work than k T ln 2. As a result, erasure and the complementary process of bit randomization can be combined to form a work-producing engine cycle.


title: Forecasting insect abundance using time series embedding and machine learning

abstract: Implementing insect monitoring systems provides an excellent opportunity to create accurate interventions for insect control. However, selecting the appropriate time for an intervention is still an open question due to the inherent difficulty of implementing on-site monitoring in real-time. This decision is even more critical with insect species that can abruptly increase population size. A possible solution to enhance decision-making is to apply forecasting methods to predict insect abundance. However, another layer of complexity is added when other covariates are considered in the forecasting, such as climate time series collected along the monitoring system. Multiple possible combinations of climate time series and their lags can be used to build a forecasting method. Therefore, this research paper proposes a new approach to address this problem by combining statistics, machine learning, and time series embedding. We used two datasets containing a time series of aphids and climate data collected weekly in Coxilha and Passo Fundo municipalities in Southern Brazil for eight years. We conduct a simulation study based on a probabilistic autoregressive model with exogenous time series based on Poisson and negative binomial distributions to check the influence of incorporating climate time series on the performance of our approach. We pre-processed the data using our newly proposed approach and more straightforward approaches commonly used to train machine learning algorithms in time series problems. We evaluate the performance of the selected machine algorithms by looking at the Root Mean Squared Error obtained using one-step-ahead forecasting. Based on Random Forests, Lasso-regularised linear regression, and LightGBM regression algorithms, our novel approach yields competitive forecasts while automatically selecting insect abundances, climate time series and their lags to aid forecasting.


title: INFAMOUS-NeRF: ImproviNg FAce MOdeling Using Semantically-Aligned Hypernetworks with Neural Radiance Fields

abstract: We propose INFAMOUS-NeRF, an implicit morphable face model that introduces hypernetworks to NeRF to improve the representation power in the presence of many training subjects. At the same time, INFAMOUS-NeRF resolves the classic hypernetwork tradeoff of representation power and editability by learning semantically-aligned latent spaces despite the subject-specific models, all without requiring a large pretrained model. INFAMOUS-NeRF further introduces a novel constraint to improve NeRF rendering along the face boundary. Our constraint can leverage photometric surface rendering and multi-view supervision to guide surface color prediction and improve rendering near the surface. Finally, we introduce a novel, loss-guided adaptive sampling method for more effective NeRF training by reducing the sampling redundancy. We show quantitatively and qualitatively that our method achieves higher representation power than prior face modeling methods in both controlled and in-the-wild settings. Code and models will be released upon publication.


title: Gravitational Waves Through Time: Scientific Significance, Detection Techniques, and Recent Breakthroughs

abstract: This article, produced as part of an undergraduate research class, aims to provide an overview of gravitational waves, though it does not offer a comprehensive review. We begin with a brief discussion regarding the history of gravitational waves, beginning even before Albert Einstein's theory of general relativity, highlighting important developments and milestones in the field. We then discuss the scientific significance of gravitational wave detections such as the verification of general relativity and key properties of black holes/neutron stars. We extend our analysis into various detection techniques including interferometer-based detectors (LIGO, Virgo, GEO600), pulsar timing arrays, and proposed space-based detectors (LISA, DECIGO, BBO). Finally, we conclude our review with a brief examination of the captivating event GW190521.


title: Enhancing User Intent Capture in Session-Based Recommendation with Attribute Patterns

abstract: The goal of session-based recommendation in E-commerce is to predict the next item that an anonymous user will purchase based on the browsing and purchase history. However, constructing global or local transition graphs to supplement session data can lead to noisy correlations and user intent vanishing. In this work, we propose the Frequent Attribute Pattern Augmented Transformer (FAPAT) that characterizes user intents by building attribute transition graphs and matching attribute patterns. Specifically, the frequent and compact attribute patterns are served as memory to augment session representations, followed by a gate and a transformer block to fuse the whole session information. Through extensive experiments on two public benchmarks and 100 million industrial data in three domains, we demonstrate that FAPAT consistently outperforms state-of-the-art methods by an average of 4.5% across various evaluation metrics (Hits, NDCG, MRR). Besides evaluating the next-item prediction, we estimate the models' capabilities to capture user intents via predicting items' attributes and period-item recommendations.


title: Security in 5G Networks -- How 5G networks help Mitigate Location Tracking Vulnerability

abstract: As 5G networks become more mainstream, privacy has come to the forefront of end users. More scrutiny has been shown to previous generation cellular technologies such as 3G and 4G on how they handle sensitive metadata transmitted from an end user mobile device to base stations during registration with a cellular network. These generation cellular networks do not enforce any encryption on this information transmitted during this process, giving malicious actors an easy way to intercept the information. Such an interception can allow an adversary to locate end users with shocking accuracy. This paper investigates this problem in great detail and discusses how a newly introduced approach in 5G networks is helping combat this problem. The paper discusses the implications of this vulnerability and the technical details of the new approach, including the encryption schemes used to secure this sensitive information. Finally, the paper will discuss any limitations to this new approach.


title: Evaluating infectious disease forecasts with allocation scoring rules

abstract: Recent years have seen increasing efforts to forecast infectious disease burdens, with a primary goal being to help public health workers make informed policy decisions. However, there has only been limited discussion of how predominant forecast evaluation metrics might indicate the success of policies based in part on those forecasts. We explore one possible tether between forecasts and policy: the allocation of limited medical resources so as to minimize unmet need. We use probabilistic forecasts of disease burden in each of several regions to determine optimal resource allocations, and then we score forecasts according to how much unmet need their associated allocations would have allowed. We illustrate with forecasts of COVID-19 hospitalizations in the US, and we find that the forecast skill ranking given by this allocation scoring rule can vary substantially from the ranking given by the weighted interval score. We see this as evidence that the allocation scoring rule detects forecast value that is missed by traditional accuracy measures and that the general strategy of designing scoring rules that are directly linked to policy performance is a promising direction for epidemic forecast evaluation.


title: Time Travelling Pixels: Bitemporal Features Integration with Foundation Model for Remote Sensing Image Change Detection

abstract: Change detection, a prominent research area in remote sensing, is pivotal in observing and analyzing surface transformations. Despite significant advancements achieved through deep learning-based methods, executing high-precision change detection in spatio-temporally complex remote sensing scenarios still presents a substantial challenge. The recent emergence of foundation models, with their powerful universality and generalization capabilities, offers potential solutions. However, bridging the gap of data and tasks remains a significant obstacle. In this paper, we introduce Time Travelling Pixels (TTP), a novel approach that integrates the latent knowledge of the SAM foundation model into change detection. This method effectively addresses the domain shift in general knowledge transfer and the challenge of expressing homogeneous and heterogeneous characteristics of multi-temporal images. The state-of-the-art results obtained on the LEVIR-CD underscore the efficacy of the TTP. The Code is available at \url{https://kychen.me/TTP}.


title: User Consented Federated Recommender System Against Personalized Attribute Inference Attack

abstract: Recommender systems can be privacy-sensitive. To protect users' private historical interactions, federated learning has been proposed in distributed learning for user representations. Using federated recommender (FedRec) systems, users can train a shared recommendation model on local devices and prevent raw data transmissions and collections. However, the recommendation model learned by a common FedRec may still be vulnerable to private information leakage risks, particularly attribute inference attacks, which means that the attacker can easily infer users' personal attributes from the learned model. Additionally, traditional FedRecs seldom consider the diverse privacy preference of users, leading to difficulties in balancing the recommendation utility and privacy preservation. Consequently, FedRecs may suffer from unnecessary recommendation performance loss due to over-protection and private information leakage simultaneously. In this work, we propose a novel user-consented federated recommendation system (UC-FedRec) to flexibly satisfy the different privacy needs of users by paying a minimum recommendation accuracy price. UC-FedRec allows users to self-define their privacy preferences to meet various demands and makes recommendations with user consent. Experiments conducted on different real-world datasets demonstrate that our framework is more efficient and flexible compared to baselines.


title: Iterative Prompt Relabeling for diffusion model with RLDF

abstract: Diffusion models have shown impressive performance in many domains, including image generation, time series prediction, and reinforcement learning. The algorithm demonstrates superior performance over the traditional GAN and transformer based methods. However, the model's capability to follow natural language instructions (e.g., spatial relationships between objects, generating complex scenes) is still unsatisfactory. This has been an important research area to enhance such capability. Prior works adopt reinforcement learning to adjust the behavior of the diffusion models. However, RL methods not only require careful reward design and complex hyperparameter tuning, but also fails to incorporate rich natural language feedback. In this work, we propose iterative prompt relabeling (IP-RLDF), a novel algorithm that aligns images to text through iterative image sampling and prompt relabeling. IP-RLDF first samples a batch of images conditioned on the text, then relabels the text prompts of unmatched text-image pairs with classifier feedback. We conduct thorough experiments on three different models, including SDv2, GLIGEN, and SDXL, testing their capability to generate images following instructions. With IP-RLDF, we improved up to 15.22% (absolute improvement) on the challenging spatial relation VISOR benchmark, demonstrating superior performance compared to previous RL methods.


title: Valuing Open Defecation Free Surroundings: Experimental Evidence from a Norm-Based Intervention in India

abstract: Open defecation, which is linked with poor health outcomes, lower cognitive ability and productivity, has been widespread in India. This paper assesses the impact of a randomized norm-centric intervention implemented in peri-urban areas of Tamil Nadu in India on raising the value attached to residence in areas with a lower prevalence of open defecation, measured through Willingness to Pay (WTP). The intervention aimed to change social expectations about toilet usage through audio announcements, wall paintings, household visits, and community meetings. The findings indicate a significant increase in the WTP for relocating to areas with lower prevalence of open defecation. The results are consistent when using local average treatment effect estimations wherein the possibility of spillovers in the control areas is accounted for. They are also robust to potential bias due to local socio-political events during the study period and COVID-led attrition. We further observe a significant increase in toilet ownership and usage. While assessing the mechanism, we find that change in empirical expectations through the intervention (what one believes about the prevalence of toilet usage in the community) is one of the primary mediating channels. Normative expectations (what one believes about community approval of toilet usage) are found to have limited effect. The findings underscore the need for norm-centric interventions to propel change in beliefs and achieve long-term and sustainable sanitation behavior.


title: The Security Analysis of Continuous-Variable Quantum Key Distribution under Limited Eavesdropping with Practical Fiber

abstract: Research on optimal eavesdropping models under practical conditions will help to evaluate realistic risk when employing quantum key distribution (QKD) system for secure information transmission. Intuitively, fiber loss will lead to the optical energy leaking to the environment, rather than harvested by the eavesdropper, which also limits the eavesdropping ability while improving the QKD system performance in practical use. However, defining the optimal eavesdropping model in the presence of lossy fiber is difficult because the channel is beyond the control of legitimate partners and the leaked signal is undetectable. Here we investigate how the fiber loss influences the eavesdropping ability based on a teleportation-based collective attack model which requires two distant stations and a shared entanglement source. We find that if the distributed entanglement is limited due to the practical loss, the optimal attack occurs when the two teleportation stations are merged to one and placed close to the transmitter site, which performs similar to the entangling-cloning attack but with a reduced wiretapping ratio. Assuming Eve uses the best available hollow-core fiber, the secret key rate in the practical environment can be 20%~40% higher than that under ideal eavesdropping. While if the entanglement distillation technology is mature enough to provide high quality of distributed entanglement, the two teleportation stations should be distantly separated for better eavesdropping performance, where the eavesdropping can even approach the optimal collective attack. Under the current level of entanglement purification technology, the unavoidable fiber loss can still greatly limit the eavesdropping ability as well as enhance the secret key rate and transmission distance of the realistic system, which promotes the development of QKD systems in practical application scenarios.


title: Massive Klein Tunneling in Topological Photonic Crystals

abstract: Klein's paradox refers to the transmission of a relativistic particle through a high potential barrier. Although it has a simple resolution in terms of particle-to-antiparticle tunneling (Klein tunneling), debates on its physical meaning seem lasting partially due to the lack of direct experimental verification. In this article, we point out that honeycomb-type photonic crystals (PhCs) provide an ideal platform to investigate the nature of Klein tunneling, where the effective Dirac mass can be tuned in a relatively easy way from a positive value (trivial PhC) to a negative value (topological PhC) via a zero-mass case (PhC graphene). Especially, we show that analysis of the transmission between domains with opposite Dirac masses -- a case hardly be treated within the scheme available so far -- sheds new light on the understanding of the Klein tunneling.


title: Dealing with missing angular sections in nanoCT reconstructions of low contrast polymeric samples employing a mechanical in situ loading stage

abstract: While in situ experiments are gaining importance for the (mechanical) assessment of metamaterials or materials with complex microstructures, imaging conditions in such experiments are often challenging. The lab-based computed tomography system Xradia 810 Ultra allows for the in situ (time lapsed) mechanical testing of samples. However, the in situ loading setup from this system limits the image acquisition angle to 140$^\circ$. For low contrast polymeric materials, this limited acquisition angle leads to regions of low information gain, thus preventing an accurate reconstruction of the data using a filtered back projection algorithm. Here we demonstrate how the information gain can be improved by selecting an appropriate position of the sample. A low contrast polymeric tetrahedral microlattice sample and a specifically structured sample, both scanned over 140$^\circ$ and 180$^\circ$, demonstrate that the missing structural details in the 140$^\circ$ reconstruction are limited to an angular wedge of about 20$^\circ$. Depending on the sample geometry and structure, applying simple strategies for the in situ experiments allows accurate reconstruction of the data. For the tetrahedral microlattice, a simple rotation of the sample by 90$^\circ$ provides enough X-ray absorption for an accurate reconstruction of the geometry.


title: Modelling the eruptive young stellar object Re 50 N IRS 1 with ProDiMo

abstract: Context: Episodic accretion plays an important role during the early phases of star-formation. The main processes responsible for the episodic accretion events remain, however, unclear. Aims: Our main objective is to investigate the properties of FUors and EXors by analysing observational data, along with numerical hydrodynamics simulations of protostellar disks, stellar evolution models of outbursting stars and thermo-chemical models of star-disk systems in the outburst state. Our goal is to get a better understanding of the outburst processes and their respective origin. Methods: We used the radiation thermo-chemical code ProDiMo (PROtoplanetary DIsk MOdel) to match the dust emission and gas emission lines originating from the environment surrounding the FUor star Re 50 N IRS 1. Our model focusses on the observational data obtained by Herschel and Spitzer while we use archival photometry to complete the spectral energy distribution. Results: The modelling shows that the object is composed of a complex combination of several heating sources with different spatial distribution. Our model uses a massive envelope with an mass infall rate of 1.35 $\times 10^{-5}$ M$_{sun}$ yr$^{-1}$ to explain the continuum emission in the (sub-)mm regime. At the same time we fit the CO and $^{13}$CO ladders from 60 \textmu m to 650 \textmu m along with the two [\ion{O}{i}] lines centered at 63.18 and 145.53 \textmu m. To explain the strong CO emission at shorter wavelengths and the oxygen lines, we require a very warm disk due to a high disk accretion rate reaching 6 $\times 10^{-4}$ M$_{sun}$ yr$^{-1}$ and an additional UV field of 3\% of the overall emission to heat the disk.


title: Iterated Resultants and Rational Functions in Real Quantifier Elimination

abstract: This paper builds and extends on the authors previous work related to the algorithmic tool, Cylindrical Algebraic Decomposition (CAD), and one of its core applications, Real Quantifier Elimination (QE). These topics are at the heart of symbolic computation and were first implemented in computer algebra systems decades ago, but have recently received renewed interest as part of the ongoing development of SMT solvers for non-linear real arithmetic. First, we consider the use of iterated univariate resultants in traditional CAD, and how this leads to inefficiencies, especially in the case of an input with multiple equational constraints. We reproduce the workshop paper [Davenport \& England, 2023], adding important clarifications to our suggestions first made there to make use of multivariate resultants in the projection phase of CAD. We then consider an alternative approach to this problem first documented in [McCallum \& Brown, 2009] which redefines the actual object under construction, albeit only in the case of two equational constraints. We correct an important typo and provide a missing proof in that paper. We finish by revising the topic of how to deal with SMT or Real QE problems expressed using rational functions (as opposed to the usual polynomial ones) noting that these are often found in industrial applications. We revisit a proposal made in [Uncu, Davenport and England, 2023] for doing this in the case of satisfiability, explaining why such an approach does not trivially extend to more complicated quantification structure and giving a suitable alternative.


title: An Explainable AI Approach to Large Language Model Assisted Causal Model Auditing and Development

abstract: Causal networks are widely used in many fields, including epidemiology, social science, medicine, and engineering, to model the complex relationships between variables. While it can be convenient to algorithmically infer these models directly from observational data, the resulting networks are often plagued with erroneous edges. Auditing and correcting these networks may require domain expertise frequently unavailable to the analyst. We propose the use of large language models such as ChatGPT as an auditor for causal networks. Our method presents ChatGPT with a causal network, one edge at a time, to produce insights about edge directionality, possible confounders, and mediating variables. We ask ChatGPT to reflect on various aspects of each causal link and we then produce visualizations that summarize these viewpoints for the human analyst to direct the edge, gather more data, or test further hypotheses. We envision a system where large language models, automated causal inference, and the human analyst and domain expert work hand in hand as a team to derive holistic and comprehensive causal models for any given case scenario. This paper presents first results obtained with an emerging prototype.


title: Time Scales in Many-Body Fast Neutrino Flavor Conversion

abstract: Time scales associated with many-body fast neutrino flavor conversions in core-collapse supernova are explored in the context of an effective two-flavor model with axial symmetry. We present a preliminary study of time scales obtained from a linear stability analysis and from the distributions of Loschmidt echo crossing times (intimately connected to dynamical phase transitions in non-equilibrium systems) determined by time evolution with the exact many-body Hamiltonian. Starting from a tensor-product initial state describing systems of $N$ neutrinos, with $N/2$ electron-type and $N/2$ heavy-type, with uniform angular distributions, the Loschmidt echo crossing times, $t_{\mathcal{L}_{\times}}$, are found to exhibit two distinct time scales that are exponentially separated. The second peak structure at longer times, effectively absent for $N=4$, develops with increasing $N$. When re-scaled in terms of $\log t_{\mathcal{L}_{\times}}$, the distributions are found to become increasingly well described by the sum of two stable distributions. The distribution of Loschmidt echo crossing times differs somewhat from the results of the (numerical) linear stability analysis, which exhibits a peak at finite frequency and a second peak consistent with zero frequency. The exact analysis suggests that the zero-frequency instability manifests itself as a modest flavor-conversion time scale.


title: Deciding the Feasibility and Minimizing the Height of Tangles

abstract: We study the following combinatorial problem. Given a set of $n$ y-monotone \emph{wires}, a \emph{tangle} determines the order of the wires on a number of horizontal \emph{layers} such that the orders of the wires on any two consecutive layers differ only in swaps of neighboring wires. Given a multiset~$L$ of \emph{swaps} (that is, unordered pairs of wires) and an initial order of the wires, a tangle \emph{realizes}~$L$ if each pair of wires changes its order exactly as many times as specified by~$L$. \textsc{List-Feasibility} is the problem of finding a tangle that realizes a given list~$L$ if such a tangle exists. \textsc{Tangle-Height Minimization} is the problem of finding a tangle that realizes a given list and additionally uses the minimum number of layers. \textsc{List-Feasibility} (and therefore \textsc{Tangle-Height Minimization}) is NP-hard [Yamanaka, Horiyama, Uno, Wasa; CCCG 2018]. We prove that \textsc{List-Feasibility} remains NP-hard if every pair of wires swaps only a constant number of times. On the positive side, we present an algorithm for \textsc{Tangle-Height Minimization} that computes an optimal tangle for $n$ wires and a given list~$L$ of swaps in $O((2|L|/n^2+1)^{n^2/2} \cdot \varphi^n \cdot n)$ time, where $\varphi \approx 1.618$ is the golden ratio and $|L|$ is the total number of swaps in~$L$. From this algorithm, we derive a simpler and faster version to solve \textsc{List-Feasibility}. We also use the algorithm to show that \textsc{List-Feasibility} is in NP and fixed-parameter tractable with respect to the number of wires. For \emph{simple} lists, where every swap occurs at most once, we show how to solve \textsc{Tangle-Height Minimization} in $O(n!\varphi^n)$ time.


title: Stochastic Equilibrium the Lucas Critique and Keynesian Economics

abstract: In this paper, a mathematically rigorous solution overturns existing wisdom regarding New Keynesian Dynamic Stochastic General Equilibrium. I develop a formal concept of stochastic equilibrium. I prove uniqueness and necessity, when agents are patient, with general application. Existence depends on appropriately specified eigenvalue conditions. Otherwise, no solution of any kind exists. I construct the equilibrium with Calvo pricing. I provide novel comparative statics with the non-stochastic model of mathematical significance. I uncover a bifurcation between neighbouring stochastic systems and approximations taken from the Zero Inflation Non-Stochastic Steady State (ZINSS). The correct Phillips curve agrees with the zero limit from the trend inflation framework. It contains a large lagged inflation coefficient and a small response to expected inflation. Price dispersion can be first or second order depending how shocks are scaled. The response to the output gap is always muted and is zero at standard parameters. A neutrality result is presented to explain why and align Calvo with Taylor pricing. Present and lagged demand shocks enter the Phillips curve so there is no Divine Coincidence and the system is identified from structural shocks alone. The lagged inflation slope is increasing in the inflation response, embodying substantive policy trade-offs. The Taylor principle is reversed, inactive settings are necessary, pointing towards inertial policy. The observational equivalence idea of the Lucas critique is disproven. The bifurcation results from the breakdown of the constraints implied by lagged nominal rigidity, associated with cross-equation cancellation possible only at ZINSS. There is a dual relationship between restrictions on the econometrician and constraints on repricing firms. Thus, if the model is correct, goodness of fit will jump.


title: SUNDIAL: 3D Satellite Understanding through Direct, Ambient, and Complex Lighting Decomposition

abstract: 3D modeling from satellite imagery is essential in areas of environmental science, urban planning, agriculture, and disaster response. However, traditional 3D modeling techniques face unique challenges in the remote sensing context, including limited multi-view baselines over extensive regions, varying direct, ambient, and complex illumination conditions, and time-varying scene changes across captures. In this work, we introduce SUNDIAL, a comprehensive approach to 3D reconstruction of satellite imagery using neural radiance fields. We jointly learn satellite scene geometry, illumination components, and sun direction in this single-model approach, and propose a secondary shadow ray casting technique to 1) improve scene geometry using oblique sun angles to render shadows, 2) enable physically-based disentanglement of scene albedo and illumination, and 3) determine the components of illumination from direct, ambient (sky), and complex sources. To achieve this, we incorporate lighting cues and geometric priors from remote sensing literature in a neural rendering approach, modeling physical properties of satellite scenes such as shadows, scattered sky illumination, and complex illumination and shading of vegetation and water. We evaluate the performance of SUNDIAL against existing NeRF-based techniques for satellite scene modeling and demonstrate improved scene and lighting disentanglement, novel view and lighting rendering, and geometry and sun direction estimation on challenging scenes with small baselines, sparse inputs, and variable illumination.


title: A New Global Optimization Method Based on Simplex Branching for Solving a Class of Non-Convex QCQP Problems

abstract: Quadratic constrained quadratic programming problems often occur in various fields such as engineering practice, management science, and network communication. This article mainly studies a non convex quadratic programming problem with convex quadratic constraints. Firstly, based on our existing results, the problem is reconstructed as an equivalent problem with a simple concave quadratic objective function in the result space, with a convex feasible domain. A global optimization algorithm for solving equivalent problems is proposed based on a branch and bound framework that can ensure the global optimality of the solution. This algorithm combines effective relaxation processes with branching processes related to new external approximation techniques. Finally, the theoretical feasibility of the algorithm was analyzed.


title: ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation

abstract: Robot manipulation relies on accurately predicting contact points and end-effector directions to ensure successful operation. However, learning-based robot manipulation, trained on a limited category within a simulator, often struggles to achieve generalizability, especially when confronted with extensive categories. Therefore, we introduce an innovative approach for robot manipulation that leverages the robust reasoning capabilities of Multimodal Large Language Models (MLLMs) to enhance the stability and generalization of manipulation. By fine-tuning the injected adapters, we preserve the inherent common sense and reasoning ability of the MLLMs while equipping them with the ability for manipulation. The fundamental insight lies in the introduced fine-tuning paradigm, encompassing object category understanding, affordance prior reasoning, and object-centric pose prediction to stimulate the reasoning ability of MLLM in manipulation. During inference, our approach utilizes an RGB image and text prompt to predict the end effector's pose in chain of thoughts. After the initial contact is established, an active impedance adaptation policy is introduced to plan the upcoming waypoints in a closed-loop manner. Moreover, in real world, we design a test-time adaptation (TTA) strategy for manipulation to enable the model better adapt to the current real-world scene configuration. Experiments in simulator and real-world show the promising performance of ManipLLM. More details and demonstrations can be found at https://sites.google.com/view/manipllm.


title: Hyper-VolTran: Fast and Generalizable One-Shot Image to 3D Object Structure via HyperNetworks

abstract: Solving image-to-3D from a single view is an ill-posed problem, and current neural reconstruction methods addressing it through diffusion models still rely on scene-specific optimization, constraining their generalization capability. To overcome the limitations of existing approaches regarding generalization and consistency, we introduce a novel neural rendering technique. Our approach employs the signed distance function as the surface representation and incorporates generalizable priors through geometry-encoding volumes and HyperNetworks. Specifically, our method builds neural encoding volumes from generated multi-view inputs. We adjust the weights of the SDF network conditioned on an input image at test-time to allow model adaptation to novel scenes in a feed-forward manner via HyperNetworks. To mitigate artifacts derived from the synthesized views, we propose the use of a volume transformer module to improve the aggregation of image features instead of processing each viewpoint separately. Through our proposed method, dubbed as Hyper-VolTran, we avoid the bottleneck of scene-specific optimization and maintain consistency across the images generated from multiple viewpoints. Our experiments show the advantages of our proposed approach with consistent results and rapid generation.


title: Hilbert properties under base change in small extensions

abstract: We study the preservation of the Hilbert property and of the weak Hilbert property under base change in field extensions. In particular we show that these properties are preserved if the extension is finitely generated or Galois with finitely generated Galois group, and we also obtain some negative results.


title: GenAI Mirage: The Impostor Bias and the Deepfake Detection Challenge in the Era of Artificial Illusions

abstract: This paper examines the impact of cognitive biases on decision-making in forensics and digital forensics, exploring biases such as confirmation bias, anchoring bias, and hindsight bias. It assesses existing methods to mitigate biases and improve decision-making, introducing the novel "Impostor Bias", which arises as a systematic tendency to question the authenticity of multimedia content, such as audio, images, and videos, often assuming they are generated by AI tools. This bias goes beyond evaluators' knowledge levels, as it can lead to erroneous judgments and false accusations, undermining the reliability and credibility of forensic evidence. Impostor Bias stems from an a priori assumption rather than an objective content assessment, and its impact is expected to grow with the increasing realism of AI-generated multimedia products. The paper discusses the potential causes and consequences of Impostor Bias, suggesting strategies for prevention and counteraction. By addressing these topics, this paper aims to provide valuable insights, enhance the objectivity and validity of forensic investigations, and offer recommendations for future research and practical applications to ensure the integrity and reliability of forensic practices.