title: PEM: Prototype-based Efficient MaskFormer for Image Segmentation

abstract: Recent transformer-based architectures have shown impressive results in the field of image segmentation. Thanks to their flexibility, they obtain outstanding performance in multiple segmentation tasks, such as semantic and panoptic, under a single unified framework. To achieve such impressive performance, these architectures employ intensive operations and require substantial computational resources, which are often not available, especially on edge devices. To fill this gap, we propose Prototype-based Efficient MaskFormer (PEM), an efficient transformer-based architecture that can operate in multiple segmentation tasks. PEM proposes a novel prototype-based cross-attention which leverages the redundancy of visual features to restrict the computation and improve the efficiency without harming the performance. In addition, PEM introduces an efficient multi-scale feature pyramid network, capable of extracting features that have high semantic content in an efficient way, thanks to the combination of deformable convolutions and context-based self-modulation. We benchmark the proposed PEM architecture on two tasks, semantic and panoptic segmentation, evaluated on two different datasets, Cityscapes and ADE20K. PEM demonstrates outstanding performance on every task and dataset, outperforming task-specific architectures while being comparable and even better than computationally-expensive baselines.


title: Leveraging AI Predicted and Expert Revised Annotations in Interactive Segmentation: Continual Tuning or Full Training?

abstract: Interactive segmentation, an integration of AI algorithms and human expertise, premises to improve the accuracy and efficiency of curating large-scale, detailed-annotated datasets in healthcare. Human experts revise the annotations predicted by AI, and in turn, AI improves its predictions by learning from these revised annotations. This interactive process continues to enhance the quality of annotations until no major revision is needed from experts. The key challenge is how to leverage AI predicted and expert revised annotations to iteratively improve the AI. Two problems arise: (1) The risk of catastrophic forgetting--the AI tends to forget the previously learned classes if it is only retrained using the expert revised classes. (2) Computational inefficiency when retraining the AI using both AI predicted and expert revised annotations; moreover, given the dominant AI predicted annotations in the dataset, the contribution of newly revised annotations--often account for a very small fraction--to the AI training remains marginal. This paper proposes Continual Tuning to address the problems from two perspectives: network design and data reuse. Firstly, we design a shared network for all classes followed by class-specific networks dedicated to individual classes. To mitigate forgetting, we freeze the shared network for previously learned classes and only update the class-specific network for revised classes. Secondly, we reuse a small fraction of data with previous annotations to avoid over-computing. The selection of such data relies on the importance estimate of each data. The importance score is computed by combining the uncertainty and consistency of AI predictions. Our experiments demonstrate that Continual Tuning achieves a speed 16x greater than repeatedly training AI from scratch without compromising the performance.


title: The nature of compact radio-loud AGN: a systematic look at the LOFAR AGN population

abstract: We investigate the nature of low-luminosity radio-loud active galactic nuclei (RLAGN) selected from the LOFAR Two-metre Sky Survey (LoTSS) first data release (DR1). Using optical, mid-infrared, and radio data, we have conservatively selected 55 radiative AGN candidates from DR1 within the redshift range $0.03<z<0.1$. We show using high-frequency {\it Karl G. Jansky} Very Large Array (VLA) observations that 10 out of 55 objects show radio emission on scales $>$$1-3$ kpc, 42 are compact at the limiting resolution of 0.35 arcsec (taking an upper limit on the projected physical size, this corresponds to less than 1 kpc), and three are undetected. The extended objects display a wide range of radio morphologies: two-jet (5), one-jet (4), and double-lobed (1). We present the radio spectra of all detected radio sources which range from steep to flat/inverted and span the range seen for other compact radio sources such as compact symmetric objects (CSOs), compact steep spectrum (CSS) sources, and gigahertz peaked-spectrum (GPS) sources. Assuming synchrotron self-absorption (SSA) for flat/inverted radio spectrum sources, we predict small physical sizes for compact objects to range between $2-53$ pc. Alternatively, using free-free absorption (FFA) models, we have estimated the free electron column depth for all compact objects, assuming a homogeneous absorber. We find that these objects do not occupy a special position on the power/linear size ($P-D$) diagram but some share a region with radio-quiet quasars (RQQs) and so-called `FR0' sources in terms of radio luminosity and linear size.


title: Testing Information Ordering for Strategic Agents

abstract: A key primitive of a strategic environment is the information available to players. Specifying a priori an information structure is often difficult for empirical researchers. We develop a test of information ordering that allows researchers to examine if the true information structure is at least as informative as a proposed baseline. We construct a computationally tractable test statistic by utilizing the notion of Bayes Correlated Equilibrium (BCE) to translate the ordering of information structures into an ordering of functions. We apply our test to examine whether hubs provide informational advantages to certain airlines in addition to market power.


title: L\'evy noise-induced coherence resonance: numerical study versus experiment

abstract: Using the FitzHugh-Nagumo system in the excitable regime, we investigate the influence of the L{\'e}vy noise properties on the effect of coherence resonance. In particular, we demonstrate that the L{\'e}vy noise can be a constructive or destructive factor providing for enhancement or suppression of noise-induced coherence. We show that the positive or negative role of the L{\'e}vy noise impact is dictated by the noise stability index and skewness parameter. The correlation time and the deviation of interspike intervals used in this analysis are shown to be maximized or minimized for an appropriate choice of the noise parameters. Numerical simulations are combined with experiments on an electronic circuit showing an excellent qualitative correspondence and proving thereby the robustness of the observed phenomena.


title: Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

abstract: Recurrent neural networks (RNNs) have fast inference and scale efficiently on long sequences, but they are difficult to train and hard to scale. We propose Hawk, an RNN with gated linear recurrences, and Griffin, a hybrid model that mixes gated linear recurrences with local attention. Hawk exceeds the reported performance of Mamba on downstream tasks, while Griffin matches the performance of Llama-2 despite being trained on over 6 times fewer tokens. We also show that Griffin can extrapolate on sequences significantly longer than those seen during training. Our models match the hardware efficiency of Transformers during training, and during inference they have lower latency and significantly higher throughput. We scale Griffin up to 14B parameters, and explain how to shard our models for efficient distributed training.


title: Reduction of Anisotropic Volume Expansion and the Optimization of Specific Charge Capacity in Lithiated Silicon Nanowires

abstract: This computational research study analyzes the increase of the specific charge capacity that comes with the reduction of the anisotropic volume expansion during lithium ion insertion within silicon nanowires. This research paper is a continuation from previous work that studied the expansion rate and volume increase. It has been determined that when the lithium ion concentration is decreased by regulating the amount of Li ion flux, the lithium ions to silicon atoms ratio, represented by x, decreases within the amorphous lithiated silicon (a-LixSi) material. This results in a decrease in the volumetric strain of the lithiated silicon nanowire as well as a reduction in Maxwell stress that was calculated and Youngs elastic module that was measured experimentally using nanoindentation. The conclusion as will be seen is that as there is a decrease in lithium ion concentration there is a corresponding decrease in anisotropic volume and a resulting increase in specific charge capacity. In fact the amplification of the electromagnetic field due to the electron flux that created detrimental effects for a fully lithiated silicon nanowire at x = 3.75 which resulted in over a 300 percent volume expansion becomes beneficial with the decrease in lithium ion flux as x approaches 0.75, which leads to a marginal volume increase of 25 percent. This could lead to the use of crystalline silicon, c-Si, as an anode material that has been demonstrated in many previous research works to be ten times greater charge capacity than carbon base anode material for lithium ion batteries.


title: Hamiltonian Engineering of collective XYZ spin models in an optical cavity: From one-axis twisting to two-axis counter twisting models

abstract: Quantum simulation using synthetic quantum systems offers unique opportunities to explore open questions in many-body physics and a path for the generation of useful entangled states. Nevertheless, so far many quantum simulators have been fundamentally limited in the models they can mimic. Here, we are able to realize an all-to-all interaction with arbitrary quadratic Hamiltonian or effectively an infinite range tunable Heisenberg XYZ model. This is accomplished by engineering cavity-mediated four-photon interactions between 700 rubidium atoms in which we harness a pair of momentum states as the effective pseudo spin or qubit degree of freedom. Using this capability we realize for the first time the so-called two-axis counter-twisting model, an iconic XYZ collective spin model that can generate spin-squeezed states that saturate the Heisenberg limit bound. The versatility of our platform to include more than two relevant momentum states, combined with the flexibility of the simulated Hamiltonians by adding cavity tones opens rich opportunities for quantum simulation and quantum sensing in matter-wave interferometers and other quantum sensors such as optical clocks and magnetometers.


title: Effective interactions of the open bosonic string via field theory

abstract: We describe a method to extract an effective Lagrangian description for open bosonic strings, at zero transcendentality. The method relies on a particular formulation of its scattering amplitudes derived from color-kinematics duality. More precisely, starting from a $(DF)^2 + \text{YM}$ quantum field theory, we integrate out all the massive degrees of freedom to generate an expansion in the inverse string tension $\alpha^\prime$. We explicitly compute the Lagrangian terms through $\mathcal{O}(\alpha^{\prime 4})$, and target the sector of operators proportional to $F^4$ to all orders in $\alpha^\prime$.


title: Compositional API Recommendation for Library-Oriented Code Generation

abstract: Large language models (LLMs) have achieved exceptional performance in code generation. However, the performance remains unsatisfactory in generating library-oriented code, especially for the libraries not present in the training data of LLMs. Previous work utilizes API recommendation technology to help LLMs use libraries: it retrieves APIs related to the user requirements, then leverages them as context to prompt LLMs. However, developmental requirements can be coarse-grained, requiring a combination of multiple fine-grained APIs. This granularity inconsistency makes API recommendation a challenging task. To address this, we propose CAPIR (Compositional API Recommendation), which adopts a "divide-and-conquer" strategy to recommend APIs for coarse-grained requirements. Specifically, CAPIR employs an LLM-based Decomposer to break down a coarse-grained task description into several detailed subtasks. Then, CAPIR applies an embedding-based Retriever to identify relevant APIs corresponding to each subtask. Moreover, CAPIR leverages an LLM-based Reranker to filter out redundant APIs and provides the final recommendation. To facilitate the evaluation of API recommendation methods on coarse-grained requirements, we present two challenging benchmarks, RAPID (Recommend APIs based on Documentation) and LOCG (Library-Oriented Code Generation). Experimental results on these benchmarks, demonstrate the effectiveness of CAPIR in comparison to existing baselines. Specifically, on RAPID's Torchdata-AR dataset, compared to the state-of-the-art API recommendation approach, CAPIR improves recall@5 from 18.7% to 43.2% and precision@5 from 15.5% to 37.1%. On LOCG's Torchdata-Code dataset, compared to code generation without API recommendation, CAPIR improves pass@100 from 16.0% to 28.0%.


title: Pushing the Limits of Cross-Embodiment Learning for Manipulation and Navigation

abstract: Recent years in robotics and imitation learning have shown remarkable progress in training large-scale foundation models by leveraging data across a multitude of embodiments. The success of such policies might lead us to wonder: just how diverse can the robots in the training set be while still facilitating positive transfer? In this work, we study this question in the context of heterogeneous embodiments, examining how even seemingly very different domains, such as robotic navigation and manipulation, can provide benefits when included in the training data for the same model. We train a single goal-conditioned policy that is capable of controlling robotic arms, quadcopters, quadrupeds, and mobile bases. We then investigate the extent to which transfer can occur across navigation and manipulation on these embodiments by framing them as a single goal-reaching task. We find that co-training with navigation data can enhance robustness and performance in goal-conditioned manipulation with a wrist-mounted camera. We then deploy our policy trained only from navigation-only and static manipulation-only data on a mobile manipulator, showing that it can control a novel embodiment in a zero-shot manner. These results provide evidence that large-scale robotic policies can benefit from data collected across various embodiments. Further information and robot videos can be found on our project website http://extreme-cross-embodiment.github.io.


title: Magnon spectrum of altermagnets: Time-dependent matrix product states vs. linearized Holstein-Primakoff calculations unravelling spontaneous magnon decay

abstract: The energy-momentum dispersion of magnons, viewed as noninteracting and infinitely long-lived quasiparticles describing collective low-energy excitations of magnetic materials, is often presented as sharp bands obtained from the effective quantum spin Hamiltonian, after being simplified via linearized Holstein-Primakoff (HP) transformations. However, magnons are prone to many-body interactions with other quasiparticles which can lead to their spontaneous decay. The magnon-magnon interactions could affect newly classified altermagnets. On the other hand, sharp bands of noninteracting chiral magnons in RuO2, as the canonical example of altermagnets, have been very recently predicted. Here, we employ nonperturbative numerically (quasi)exact quantum many-body calculations, via time-dependent matrix product states (TDMPS), to obtain magnon spectral function of RuO2. These calculations produce a broadened magnon dispersion, which overlaps with linearized HP theory sharp bands only at edges/center of the Brillouin zone. Substantially deviating otherwise. Artificially making exchange interaction within two sublattices of RuO2 closer in value forces these two spectra to overlap, thereby explaining the origin of the failure of linearized HP theory. Such features translate into the difference between their respective density of states, which we also compute and which could be tested by Raman scattering experiments. Finally, we employ popular Landau-Lifshitz-Gilbert (LLG) equation-based classical atomistic spin dynamics (ASD) simulations to obtain dynamical structure factor and extract magnon spectrum from it at finite temperature. Despite including magnon-magnon interactions via nonlinearity of LLG equation, ASD simulations cannot fully match the TDMPS-computed magnon spectrum due to nonclassical effects harbored by altermagnets.


title: Digital Twin Aided Massive MIMO: CSI Compression and Feedback

abstract: Deep learning (DL) approaches have demonstrated high performance in compressing and reconstructing the channel state information (CSI) and reducing the CSI feedback overhead in massive MIMO systems. One key challenge, however, with the DL approaches is the demand for extensive training data. Collecting this real-world CSI data incurs significant overhead that hinders the DL approaches from scaling to a large number of communication sites. To address this challenge, we propose a novel direction that utilizes site-specific \textit{digital twins} to aid the training of DL models. The proposed digital twin approach generates site-specific synthetic CSI data from the EM 3D model and ray tracing, which can then be used to train the DL model without real-world data collection. To further improve the performance, we adopt online data selection to refine the DL model training with a small real-world CSI dataset. Results show that a DL model trained solely on the digital twin data can achieve high performance when tested in a real-world deployment. Further, leveraging domain adaptation techniques, the proposed approach requires orders of magnitude less real-world data to approach the same performance of the model trained completely on a real-world CSI dataset.


title: Simple, High Saturation Power, Quantum-limited, RF SQUID Array-based Josephson Parametric Amplifiers

abstract: High-fidelity quantum non-demolition qubit measurement is critical to error correction and rapid qubit feedback in large-scale quantum computing. High-fidelity readout requires passing a short and strong pulse through the qubit's readout resonator, which is then processed by a sufficiently high bandwidth, high saturation power, and quantum-limited amplifier. We have developed a design pipeline that combines time-domain simulation of the un-truncated device Hamiltonian, fabrication constraints, and maximization of saturation power. We have realized an amplifier based on a modified NIST tri-layer Nb fabrication suite which utilizes an array of 25 radio frequency Superconducting QUantum Interference Devices (rf SQUIDs) embedded within a low-Q resonator powered by a high-power voltage pump delivered via a diplexer on the signal port. We show that, despite the intensity of the pump, the device is quantum-efficient and capable of high-fidelity measurement limited by state transitions in the transmon. We present experimental data demonstrating up to -91.2 dBm input saturation power with 20 dB gain, up to 28 MHz instantaneous bandwidth, and phase-preserving qubit measurements with 62% quantum efficiency.


title: A Model for Pair Production Limit Cycles in Pulsar Magnetospheres

abstract: It was recently proposed that the electric field oscillation as a result of self-consistent $e^{\pm}$ pair production may be the source of coherent radio emission from pulsars. Direct Particle-in-Cell (PIC) simulations of this process have shown that the screening of the parallel electric field by this pair cascade manifests as a limit cycle, as the parallel electric field is recurrently induced when pairs produced in the cascade escape from the gap region. In this work, we develop a simplified time-dependent kinetic model of $e^{\pm}$ pair cascades in pulsar magnetospheres that can reproduce the limit-cycle behavior of pair production and electric field screening. This model includes the effects of a magnetospheric current, the escape of $e^{\pm}$, as well as the dynamic dependence of pair production rate on the plasma density and energy. Using this simple theoretical model, we show that the power spectrum of electric field oscillations averaged over many limit cycles is compatible with the observed pulsar radio spectrum.


title: Differentially Private Worst-group Risk Minimization

abstract: We initiate a systematic study of worst-group risk minimization under $(\epsilon, \delta)$-differential privacy (DP). The goal is to privately find a model that approximately minimizes the maximal risk across $p$ sub-populations (groups) with different distributions, where each group distribution is accessed via a sample oracle. We first present a new algorithm that achieves excess worst-group population risk of $\tilde{O}(\frac{p\sqrt{d}}{K\epsilon} + \sqrt{\frac{p}{K}})$, where $K$ is the total number of samples drawn from all groups and $d$ is the problem dimension. Our rate is nearly optimal when each distribution is observed via a fixed-size dataset of size $K/p$. Our result is based on a new stability-based analysis for the generalization error. In particular, we show that $\Delta$-uniform argument stability implies $\tilde{O}(\Delta + \frac{1}{\sqrt{n}})$ generalization error w.r.t. the worst-group risk, where $n$ is the number of samples drawn from each sample oracle. Next, we propose an algorithmic framework for worst-group population risk minimization using any DP online convex optimization algorithm as a subroutine. Hence, we give another excess risk bound of $\tilde{O}\left( \sqrt{\frac{d^{1/2}}{\epsilon K}} +\sqrt{\frac{p}{K\epsilon^2}} \right)$. Assuming the typical setting of $\epsilon=\Theta(1)$, this bound is more favorable than our first bound in a certain range of $p$ as a function of $K$ and $d$. Finally, we study differentially private worst-group empirical risk minimization in the offline setting, where each group distribution is observed by a fixed-size dataset. We present a new algorithm with nearly optimal excess risk of $\tilde{O}(\frac{p\sqrt{d}}{K\epsilon})$.


title: Revealing the hidden beauty of finite groups with Cayley graphs

abstract: Group theory involves the study of symmetry, and its inherent beauty gives it the potential to be one of the most accessible and enjoyable areas of mathematics, for students and non-mathematicians alike. Unfortunately, many students never get a glimpse into the more alluring parts of this field because "traditional" algebra classes are often taught in a dry axiomatic fashion, devoid of visuals. This article will showcase aesthetic pictures that can bring this subject to life. It will also leave the reader with some (intentionally) unanswered puzzles that undergraduate students, hobbyists, and mathematical artists can explore and answer, and even create new versions themselves.


title: Global well-posedness for supercritical SQG with perturbations of radially symmetric data

abstract: We study the global well-posedness of the supercritical dissipative surface quasi-geostrophic (SQG) equation, a key model in geophysical fluid dynamics. While local well-posedness is known, achieving global well-posedness for large initial data remains open. Motivated by enhanced decay in radial solutions, we aim to establish global well-posedness for small perturbations of potentially large radial data. Our main result shows that for small perturbations of radial data, the SQG equation admits a unique global solution.


title: Investigation of full-charm and full-bottom pentaquark states

abstract: The continuous advancement of experimental techniques and investigations has led to observations of various exotic states in particle physics. Each addition to this family of states not only raises expectations for future discoveries but also focuses attention on such potential new states. Building upon this motivation and inspired by recent observations of various traditional and exotic particles containing an increased number of heavy quarks, our study provides a spectroscopic search for potential pentaquark states with spin-parity $\frac{3}{2}^-$ and composed entirely of charm or bottom quarks. We predict the masses for full-charm and full-bottom pentaquark states as $m = 7628 \pm 112$ MeV and $m = 21982 \pm 144$ MeV, respectively. We also compute the current couplings of these states to vacuum, which are main inputs in investigations of their various possible decays.


title: 3D Gaussian Model for Animation and Texturing

abstract: 3D Gaussian Splatting has made a marked impact on neural rendering by achieving impressive fidelity and performance. Despite this achievement, however, it is not readily applicable to developing interactive applications. Real-time applications like XR apps and games require functions such as animation, UV-mapping, and model editing simultaneously manipulated through the usage of a 3D model. We propose a modeling that is analogous to typical 3D models, which we call 3D Gaussian Model (3DGM); it provides a manipulatable proxy for novel animation and texture transfer. By binding the 3D Gaussians in texture space and re-projecting them back to world space through implicit shell mapping, we show how our 3D modeling can serve as a valid rendering methodology for interactive applications. It is further noted that recently, 3D mesh reconstruction works have been able to produce high-quality mesh for rendering. Our work, on the other hand, only requires an approximated geometry for rendering an object in high fidelity. Applicationwise, we will show that our proxy-based 3DGM is capable of driving novel animation without animated training data and texture transferring via UV mapping of the 3D Gaussians. We believe the result indicates the potential of our work for enabling interactive applications for 3D Gaussian Splatting.


title: Training Dynamics of Multi-Head Softmax Attention for In-Context Learning: Emergence, Convergence, and Optimality

abstract: We study the dynamics of gradient flow for training a multi-head softmax attention model for in-context learning of multi-task linear regression. We establish the global convergence of gradient flow under suitable choices of initialization. In addition, we prove that an interesting "task allocation" phenomenon emerges during the gradient flow dynamics, where each attention head focuses on solving a single task of the multi-task model. Specifically, we prove that the gradient flow dynamics can be split into three phases -- a warm-up phase where the loss decreases rather slowly and the attention heads gradually build up their inclination towards individual tasks, an emergence phase where each head selects a single task and the loss rapidly decreases, and a convergence phase where the attention parameters converge to a limit. Furthermore, we prove the optimality of gradient flow in the sense that the limiting model learned by gradient flow is on par with the best possible multi-head softmax attention model up to a constant factor. Our analysis also delineates a strict separation in terms of the prediction accuracy of ICL between single-head and multi-head attention models. The key technique for our convergence analysis is to map the gradient flow dynamics in the parameter space to a set of ordinary differential equations in the spectral domain, where the relative magnitudes of the semi-singular values of the attention weights determines task allocation. To our best knowledge, our work provides the first convergence result for the multi-head softmax attention model.

categories: cs.LG cs.AI math.OC math.ST stat.ML stat.TH


title: Probing the Information Encoded in Neural-based Acoustic Models of Automatic Speech Recognition Systems

abstract: Deep learning architectures have made significant progress in terms of performance in many research areas. The automatic speech recognition (ASR) field has thus benefited from these scientific and technological advances, particularly for acoustic modeling, now integrating deep neural network architectures. However, these performance gains have translated into increased complexity regarding the information learned and conveyed through these black-box architectures. Following many researches in neural networks interpretability, we propose in this article a protocol that aims to determine which and where information is located in an ASR acoustic model (AM). To do so, we propose to evaluate AM performance on a determined set of tasks using intermediate representations (here, at different layer levels). Regarding the performance variation and targeted tasks, we can emit hypothesis about which information is enhanced or perturbed at different architecture steps. Experiments are performed on both speaker verification, acoustic environment classification, gender classification, tempo-distortion detection systems and speech sentiment/emotion identification. Analysis showed that neural-based AMs hold heterogeneous information that seems surprisingly uncorrelated with phoneme recognition, such as emotion, sentiment or speaker identity. The low-level hidden layers globally appears useful for the structuring of information while the upper ones would tend to delete useless information for phoneme recognition.


title: The "spread" of Thompson's group $F$

abstract: Recall that a group $G$ is said to be $\frac{3}{2}$-generated if every non-trivial element $g\in G$ has a co-generator in $G$ (i.e., an element which together with $g$ generates $G$). Thompson's group $V$ was proved to be $\frac{3}{2}$-generated by Donoven and Harper in 2019. It was the first example of an infinite finitely presented non-cyclic $\frac{3}{2}$-generated group. In 2022, Bleak, Harper and Skipper proved that Thompson's group $T$ is also $\frac{3}{2}$-generated. Since the abelianization of Thompson's group $F$ is $\mathbb{Z}$, it cannot be $\frac{3}{2}$-generated. However, we recently proved that Thompson's group $F$ is "almost" $\frac{3}{2}$-generated in the sense that every element of $F$ whose image in the abelianization forms part of a generating pair of $\mathbb{Z}^2$ is part of a generating pair of $F$. A natural generalization of $\frac{3}{2}$-generation is the notion of spread. Recall that the spread of a group $G$ is the supremum over all integers $k$ such that every $k$ non-trivial elements of $G$ have a common co-generator in $G$. The uniform spread of a group $G$ is the supremum over all integers $k$ for which there exists a conjugacy class $C\subseteq G$ such that every $k$ non-trivial elements of $G$ have a common co-generator which belongs to $C$. In this paper we study modified versions of these notions for Thompson's group $F$.


title: Solution of the Diophantine equation $x^2 + p^k=y^n$

abstract: The main aim of this article is to find all solutions of the Diophantine equation $x^2 + p^k=y^n$ where $p \equiv 1 \pmod 4$, $\frac{p-1}{3}$ is a perfect square and the class number of $\mathbb{Z}[\sqrt{-p}]$ is $2$. In this article, I used a method involving prime factorization and class numbers which is different from using congruent number argument which is widely used in this type of problem.


title: ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL

abstract: A broad use case of large language models (LLMs) is in goal-directed decision-making tasks (or "agent" tasks), where an LLM needs to not just generate completions for a given prompt, but rather make intelligent decisions over a multi-turn interaction to accomplish a task (e.g., when interacting with the web, using tools, or providing customer support). Reinforcement learning (RL) provides a general paradigm to address such agent tasks, but current RL methods for LLMs largely focus on optimizing single-turn rewards. By construction, most single-turn RL methods cannot endow LLMs with the ability to intelligently seek information over multiple turns, perform credit assignment, or reason about their past actions -- all of which are critical in agent tasks. This raises the question: how can we design effective and efficient multi-turn RL algorithms for LLMs? In this paper, we develop a framework for building multi-turn RL algorithms for fine-tuning LLMs, that preserves the flexibility of existing single-turn RL methods for LLMs (e.g., proximal policy optimization), while accommodating multiple turns, long horizons, and delayed rewards effectively. To do this, our framework adopts a hierarchical RL approach and runs two RL algorithms in parallel: a high-level off-policy value-based RL algorithm to aggregate reward over utterances, and a low-level RL algorithm that utilizes this high-level value function to train a token policy within each utterance or turn. Our hierarchical framework, Actor-Critic Framework with a Hierarchical Structure (ArCHer), can also give rise to other RL methods. Empirically, we find that ArCHer significantly improves efficiency and performance on agent tasks, attaining a sample efficiency of about 100x over existing methods, while also improving with larger model capacity (upto the 7 billion scale that we tested on).


title: Weighted Catalan convolution and $(q,2)$-Fock space

abstract: Motivated by the study of certain combinatorial properties of $(q,2)$-Fock space, we compute explicitly a sequence driven by the Catalan's convolution and parameterized by $1+q$. As an application of this explicit form, we calculate the number of pair partitions involved in the determination of the vacuum--moments of the field operator defined on the $(q,2)$-Fock space.


title: The Structure of Quantum Questions

abstract: In classical physics, a single measurement can in principle reveal the state of a system. However, quantum theory permits numerous non-equivalent measurements on a physical system, each providing only limited information about the state. This set of various measurements on a quantum system indicates a rich internal structure. We illuminate this structure for both individual and composite systems by conceptualizing measurements as questions with a finite number of outcomes. We create a mathematical question structure to explore the underlying properties, employing the concept of information as a key tool representing our knowledge gained from asking these questions. We subsequently propose informational assumptions based on properties observed from measurements on qubits, generalizing these to higher dimensional systems. Our informational assumptions shape the correlations between subsystems, which are symbolized as classical logical gates. Interestingly, systems with prime number dimensions exhibit unique property: the logical gate can be expressed simply as a linear equation under modular arithmetic. We also identify structures in quantum theory that correspond to those in the structure of quantum questions. For instance, the questions determining the system correspond to generalized Pauli matrices, and the logical gate connecting questions in subsystems is directly related to the tensor product combining operators. Based on these correspondences, we present two equivalent scenarios regarding the evolution of systems and the change of information within both quantum questions and quantum mechanics.


title: Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

abstract: Adam has been shown to outperform gradient descent in optimizing large language transformers empirically, and by a larger margin than on other tasks, but it is unclear why this happens. We show that the heavy-tailed class imbalance found in language modeling tasks leads to difficulties in the optimization dynamics. When training with gradient descent, the loss associated with infrequent words decreases slower than the loss associated with frequent ones. As most samples come from relatively infrequent words, the average loss decreases slowly with gradient descent. On the other hand, Adam and sign-based methods do not suffer from this problem and improve predictions on all classes. To establish that this behavior is indeed caused by class imbalance, we show empirically that it persist through different architectures and data types, on language transformers, vision CNNs, and linear models. We further study this phenomenon on a linear classification with cross-entropy loss, showing that heavy-tailed class imbalance leads to ill-conditioning, and that the normalization used by Adam can counteract it.


title: Functional Benchmarks for Robust Evaluation of Reasoning Performance, and the Reasoning Gap

abstract: We propose a framework for robust evaluation of reasoning capabilities of language models, using functional variants of benchmarks. Models that solve a reasoning test should exhibit no difference in performance over the static version of a problem compared to a snapshot of the functional variant. We have rewritten the relevant fragment of the MATH benchmark into its functional variant MATH(), with functionalization of other benchmarks to follow. When evaluating current state-of-the-art models over snapshots of MATH(), we find a reasoning gap -- the percentage difference between the static and functional accuracies. We find reasoning gaps from 58.35% to 80.31% among the state-of-the-art closed and open weights models that perform well on static benchmarks, with the caveat that the gaps are likely to be smaller with more sophisticated prompting strategies. Here we show that models which anecdotally have good reasoning performance over real-world tasks, have quantifiable lower gaps, motivating the open problem of building "gap 0" models. Code for evaluation and new evaluation datasets, three MATH() snapshots, are publicly available at https://github.com/consequentai/fneval/.


title: Hyperuniformity in deterministic anti-aligning active matter

abstract: We highlight the importance of long-range correlations in active matter systems of dilute self-propelling particles even in the absence of global order by demonstrating that long-range density fluctuations are suppressed. We show this analytically for a one-dimensional lattice process employing Poisson representation. Numerically, we corroborate the relevance of these findings for off-lattice Vicsek-type models with anti-aligning interactions.


title: The Giant Graviton Expansion from Bubbling Geometry

abstract: The superconformal index of half-BPS states in ${\cal N}=4$ supersymmetric Yang-Mills with gauge group $U(N)$ admits an expansion in terms of giant gravitons, ${\cal I}_N(q)={\cal I}_\infty(q) \sum\limits_{m=0}^\infty q^{mN}\hat{\mathcal I}_m(q)$, where $m$ is the number of giant gravitons. We derive this expansion directly in supergravity from the class of half-BPS solutions due to Lin, Lunin, and Maldacena in type IIB supergravity. The moduli space of these configurations can be quantized using covariant quantization methods. We review how this quantization leads to the graviton index, ${\cal I}_\infty(q)$, and present a modification that leads to the precise expression for the expansion in terms of giant gravitons. Our proposal provides a derivation of the giant graviton expansion directly in terms of supergravity degrees of freedom. We also comment on how to derive the expansion in terms of the effective Fermi droplet picture.


title: First-principles electron-phonon interactions and electronic transport in large-angle twisted bilayer graphene

abstract: Twisted bilayer graphene (tBLG) has emerged as an exciting platform for novel condensed matter physics. However, electron-phonon ($e$-ph) interactions in tBLG and their effects on electronic transport are not completely understood. Here we show first-principles calculations of $e$-ph interactions and resistivity in commensurate tBLG with large twist angles of 13.2 and 21.8 degrees. These calculations overcome key technical barriers, including large unit cells of up to 76 atoms, Brillouin-zone folding of the $e$-ph interactions, and unstable lattice vibrations due to the AA-stacked domains. We show that $e$-ph interactions due to layer-breathing (LB) phonons enhance intervalley scattering in large-angle tBLG. This interaction effectively couples the two layers, which are otherwise electronically decoupled at such large twist angles. As a result, the phonon-limited resistivity in tBLG deviates from the temperature-linear trend characteristic of monolayer graphene and tBLG near the magic angle. Taken together, our work quantifies $e$-ph interactions and scattering mechanisms in tBLG, revealing subtle interlayer coupling effects at large twist angles.


title: Controllable suppression of the unconventional superconductivity in bulk and thin-film Sr$_{2}$RuO$_{4}$ via high-energy electron irradiation

abstract: In bulk Sr$_{2}$RuO$_{4}$, the strong sensitivity of the superconducting transition temperature $T_{\text{c}}$ to nonmagnetic impurities provides robust evidence for a superconducting order parameter that changes sign around the Fermi surface. In superconducting epitaxial thin-film Sr$_{2}$RuO$_{4}$, the relationship between $T_{\text{c}}$ and the residual resistivity $\rho_0$, which in bulk samples is taken to be a proxy for the low-temperature elastic scattering rate, is far less clear. Using high-energy electron irradiation to controllably introduce point disorder into bulk single-crystal and thin-film Sr$_{2}$RuO$_{4}$, we show that $T_{\text{c}}$ is suppressed in both systems at nearly identical rates. This suggests that part of $\rho_0$ in films comes from defects that do not contribute to superconducting pairbreaking, and establishes a quantitative link between the superconductivity of bulk and thin-film samples.


title: Listening to the Noise: Blind Denoising with Gibbs Diffusion

abstract: In recent years, denoising problems have become intertwined with the development of deep generative models. In particular, diffusion models are trained like denoisers, and the distribution they model coincide with denoising priors in the Bayesian picture. However, denoising through diffusion-based posterior sampling requires the noise level and covariance to be known, preventing blind denoising. We overcome this limitation by introducing Gibbs Diffusion (GDiff), a general methodology addressing posterior sampling of both the signal and the noise parameters. Assuming arbitrary parametric Gaussian noise, we develop a Gibbs algorithm that alternates sampling steps from a conditional diffusion model trained to map the signal prior to the family of noise distributions, and a Monte Carlo sampler to infer the noise parameters. Our theoretical analysis highlights potential pitfalls, guides diagnostic usage, and quantifies errors in the Gibbs stationary distribution caused by the diffusion model. We showcase our method for 1) blind denoising of natural images involving colored noises with unknown amplitude and spectral index, and 2) a cosmology problem, namely the analysis of cosmic microwave background data, where Bayesian inference of "noise" parameters means constraining models of the evolution of the Universe.


title: Statistical Estimation in the Spiked Tensor Model via the Quantum Approximate Optimization Algorithm

abstract: The quantum approximate optimization algorithm (QAOA) is a general-purpose algorithm for combinatorial optimization. In this paper, we analyze the performance of the QAOA on a statistical estimation problem, namely, the spiked tensor model, which exhibits a statistical-computational gap classically. We prove that the weak recovery threshold of $1$-step QAOA matches that of $1$-step tensor power iteration. Additional heuristic calculations suggest that the weak recovery threshold of $p$-step QAOA matches that of $p$-step tensor power iteration when $p$ is a fixed constant. This further implies that multi-step QAOA with tensor unfolding could achieve, but not surpass, the classical computation threshold $\Theta(n^{(q-2)/4})$ for spiked $q$-tensors. Meanwhile, we characterize the asymptotic overlap distribution for $p$-step QAOA, finding an intriguing sine-Gaussian law verified through simulations. For some $p$ and $q$, the QAOA attains an overlap that is larger by a constant factor than the tensor power iteration overlap. Of independent interest, our proof techniques employ the Fourier transform to handle difficult combinatorial sums, a novel approach differing from prior QAOA analyses on spin-glass models without planted structure.

categories: quant-ph cs.DS math.PR math.ST stat.ML stat.TH


title: $\texttt{COSMIC}$: Mutual Information for Task-Agnostic Summarization Evaluation

abstract: Assessing the quality of summarizers poses significant challenges. In response, we propose a novel task-oriented evaluation approach that assesses summarizers based on their capacity to produce summaries that are useful for downstream tasks, while preserving task outcomes. We theoretically establish a direct relationship between the resulting error probability of these tasks and the mutual information between source texts and generated summaries. We introduce $\texttt{COSMIC}$ as a practical implementation of this metric, demonstrating its strong correlation with human judgment-based metrics and its effectiveness in predicting downstream task performance. Comparative analyses against established metrics like $\texttt{BERTScore}$ and $\texttt{ROUGE}$ highlight the competitive performance of $\texttt{COSMIC}$.


title: Higher-group global symmetry and the bosonic M5 brane

abstract: Higher-group symmetries are combinations of higher-form symmetries which appear in various field theories. In this paper, we explain how higher-group symmetries arise in 10d and 11d supergravities when the latter are coupled to brane sources. Motivated by this observation, we study field theories at zero and finite temperature invariant under a class of continuous Abelian higher-group symmetries. We restrict the analysis to the low-energy regime where the dynamical field content exclusively consists of Goldstone fields arising from the spontaneous breaking of higher-group and spacetime symmetries. Invariant quantities are constructed and the phases of matter are classified according to the pattern of spontaneous symmetry breaking. With respect to supergravity, we highlight how such Goldstone effective theories provide a symmetry-based interpretation for the theories living on D/M-branes. As an explicit example we construct a 6-group invariant action for the bosonic M5 brane, consistent with the self-duality of the 3-form field strength on the brane. While the self-duality condition in the bosonic case needs to be imposed externally as a constraint at zero temperature, we find an equilibrium effective action for the bosonic M5 brane at finite temperature that inherently implements self-duality.


title: Anomalous contribution to galactic rotation curves due to stochastic spacetime

abstract: We consider a proposed alternative to quantum gravity, in which the spacetime metric is treated as classical, even while matter fields remain quantum. Consistency of the theory necessarily requires that the metric evolve stochastically. Here, we show that this stochastic behaviour leads to a modification of general relativity at low accelerations. In the low acceleration regime, the variance in the acceleration produced by the gravitational field is high in comparison to that produced by the Newtonian potential, and acts as an entropic force, causing a deviation from Einstein's theory of general relativity. We show that in this "diffusion regime", the entropic force acts from a gravitational point of view, as if it were a contribution to the matter distribution. We compute modifications to the expectation value of the metric via the path integral formalism, and find a stochastic contribution which corresponds to a cosmological constant, anti-correlated with a contribution which has been used to fit galactic rotation curves without dark matter. We caution that a greater understanding of this effect is needed before conclusions can be drawn, most likely through numerical simulations, and provide a template for computing the deviation from general relativity which serves as an experimental signature of the Brownian motion of spacetime.


title: Benchmarking Uncertainty Disentanglement: Specialized Uncertainties for Specialized Tasks

abstract: Uncertainty quantification, once a singular task, has evolved into a spectrum of tasks, including abstained prediction, out-of-distribution detection, and aleatoric uncertainty quantification. The latest goal is disentanglement: the construction of multiple estimators that are each tailored to one and only one task. Hence, there is a plethora of recent advances with different intentions - that often entirely deviate from practical behavior. This paper conducts a comprehensive evaluation of numerous uncertainty estimators across diverse tasks on ImageNet. We find that, despite promising theoretical endeavors, disentanglement is not yet achieved in practice. Additionally, we reveal which uncertainty estimators excel at which specific tasks, providing insights for practitioners and guiding future research toward task-centric and disentangled uncertainty estimation methods. Our code is available at https://github.com/bmucsanyi/bud.


title: Wreath-like products of groups and their von Neumann algebras III: Embeddings

abstract: For a class of wreath-like product groups with property (T), we describe explicitly all the embeddings between their von Neumann algebras. This allows us to provide a continuum of ICC groups with property (T) whose von Neumann algebras are pairwise non (stably) embeddable. We also give a construction of groups in this class only having inner injective homomorphisms. As an application, we obtain examples of group von Neumann algebras which admit only inner endomorphisms.


title: Accelerating materials discovery for polymer solar cells: Data-driven insights enabled by natural language processing

abstract: We present a simulation of various active learning strategies for the discovery of polymer solar cell donor/acceptor pairs using data extracted from the literature spanning $\sim$20 years by a natural language processing pipeline. While data-driven methods have been well established to discover novel materials faster than Edisonian trial-and-error approaches, their benefits have not been quantified for material discovery problems that can take decades. Our approach demonstrates a potential reduction in discovery time by approximately 75 %, equivalent to a 15 year acceleration in material innovation. Our pipeline enables us to extract data from greater than 3300 papers which is $\sim$5 times larger and therefore more diverse than similar data sets reported by others. We also trained machine learning models to predict the power conversion efficiency and used our model to identify promising donor-acceptor combinations that are as yet unreported. We thus demonstrate a pipeline that goes from published literature to extracted material property data which in turn is used to obtain data-driven insights. Our insights include active learning strategies that can be used to train strong predictive models of material properties or be robust to the initial material system used. This work provides a valuable framework for data-driven research in materials science.


title: SeMoLi: What Moves Together Belongs Together

abstract: We tackle semi-supervised object detection based on motion cues. Recent results suggest that heuristic-based clustering methods in conjunction with object trackers can be used to pseudo-label instances of moving objects and use these as supervisory signals to train 3D object detectors in Lidar data without manual supervision. We re-think this approach and suggest that both, object detection, as well as motion-inspired pseudo-labeling, can be tackled in a data-driven manner. We leverage recent advances in scene flow estimation to obtain point trajectories from which we extract long-term, class-agnostic motion patterns. Revisiting correlation clustering in the context of message passing networks, we learn to group those motion patterns to cluster points to object instances. By estimating the full extent of the objects, we obtain per-scan 3D bounding boxes that we use to supervise a Lidar object detection network. Our method not only outperforms prior heuristic-based approaches (57.5 AP, +14 improvement over prior work), more importantly, we show we can pseudo-label and train object detectors across datasets.


title: Curiosity-driven Red-teaming for Large Language Models

abstract: Large language models (LLMs) hold great potential for many natural language applications but risk generating incorrect or toxic content. To probe when an LLM generates unwanted content, the current paradigm is to recruit a \textit{red team} of human testers to design input prompts (i.e., test cases) that elicit undesirable responses from LLMs. However, relying solely on human testers is expensive and time-consuming. Recent works automate red teaming by training a separate red team LLM with reinforcement learning (RL) to generate test cases that maximize the chance of eliciting undesirable responses from the target LLM. However, current RL methods are only able to generate a small number of effective test cases resulting in a low coverage of the span of prompts that elicit undesirable responses from the target LLM. To overcome this limitation, we draw a connection between the problem of increasing the coverage of generated test cases and the well-studied approach of curiosity-driven exploration that optimizes for novelty. Our method of curiosity-driven red teaming (CRT) achieves greater coverage of test cases while mantaining or increasing their effectiveness compared to existing methods. Our method, CRT successfully provokes toxic responses from LLaMA2 model that has been heavily fine-tuned using human preferences to avoid toxic outputs. Code is available at \url{https://github.com/Improbable-AI/curiosity_redteam}


title: Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models

abstract: Ensuring the trustworthiness of large language models (LLMs) is crucial. Most studies concentrate on fully pre-trained LLMs to better understand and improve LLMs' trustworthiness. In this paper, to reveal the untapped potential of pre-training, we pioneer the exploration of LLMs' trustworthiness during this period, focusing on five key dimensions: reliability, privacy, toxicity, fairness, and robustness. To begin with, we apply linear probing to LLMs. The high probing accuracy suggests that \textit{LLMs in early pre-training can already distinguish concepts in each trustworthiness dimension}. Therefore, to further uncover the hidden possibilities of pre-training, we extract steering vectors from a LLM's pre-training checkpoints to enhance the LLM's trustworthiness. Finally, inspired by~\citet{choi2023understanding} that mutual information estimation is bounded by linear probing accuracy, we also probe LLMs with mutual information to investigate the dynamics of trustworthiness during pre-training. We are the first to observe a similar two-phase phenomenon: fitting and compression~\citep{shwartz2017opening}. This research provides an initial exploration of trustworthiness modeling during LLM pre-training, seeking to unveil new insights and spur further developments in the field. We will make our code publicly accessible at \url{https://github.com/ChnQ/TracingLLM}.


title: The effect of cloudy atmospheres on the thermal evolution of warm giant planets from an interior modelling perspective

abstract: We are interested in the influence of cloudy atmospheres on the thermal radius evolution of warm exoplanets from an interior modelling perspective. By applying a physically motivated but simple parameterized cloud model, we obtain the atmospheric $P$-$T$ structure that is connected to the adiabatic interior at the self-consistently calculated radiative-convective boundary. We investigate the impact of cloud gradients, with the possibility of inhibiting superadiabatic clouds. Furthermore, we explore the impact on the radius evolution for a cloud base fixed at a certain pressure versus a subsiding cloud base during the planets' thermal evolution. We find that deep clouds clearly alter the evolution tracks of warm giants, leading to either slower/faster cooling than in the cloudless case (depending on the cloud model used). When comparing the fixed versus dynamic cloud base during evolution, we see an enhanced behaviour resulting in a faster or slower cooling in the case of the dynamic cloud base. We show that atmospheric models including deep clouds can lead to degeneracy in predicting the bulk metallicity of planets, $Z_\mathrm{P}$. For WASP-10b, we find a possible span of $\approx {Z_\mathrm{P}}_{-0.06}^{+0.10}$. For TOI-1268b, it is $\approx {Z_\mathrm{P}}_{-0.05}^{+0.10}$. Further work on cloud properties during the long-term evolution of gas giants is needed to better estimate the influence on the radius evolution.


title: TV-TREES: Multimodal Entailment Trees for Neuro-Symbolic Video Reasoning

abstract: It is challenging to perform question-answering over complex, multimodal content such as television clips. This is in part because current video-language models rely on single-modality reasoning, have lowered performance on long inputs, and lack interpetability. We propose TV-TREES, the first multimodal entailment tree generator. TV-TREES serves as an approach to video understanding that promotes interpretable joint-modality reasoning by producing trees of entailment relationships between simple premises directly entailed by the videos and higher-level conclusions. We then introduce the task of multimodal entailment tree generation to evaluate the reasoning quality of such methods. Our method's experimental results on the challenging TVQA dataset demonstrate intepretable, state-of-the-art zero-shot performance on full video clips, illustrating a best-of-both-worlds contrast to black-box methods.


title: Gravitational wave constraints on planetary-mass primordial black holes using LIGO O3a data

abstract: Gravitational waves from sub-solar mass inspiraling compact objects would provide smoking-gun evidence for primordial black holes (PBHs). We perform the first search for inspiraling planetary-mass PBHs, both in equal-mass or asymmetric mass ratio binaries, using data from the first half of the LIGO-Virgo-KAGRA third observing run. We do not find any significant candidates, but determine the maximum luminosity distance reachable with our search to be of $O(0.1-100)$ kpc, and corresponding model-independent upper limits on the merger rate densities to be $O(10^{3}-10^{-7})$ kpc$^{-3}$yr$^{-1}$ for systems with chirp masses $O(10^{-4}-10^{-2})M_\odot$, respectively. Furthermore, we interpret these rate densities as arising from PBH binaries, and thereby constrain the fraction of dark matter that these objects could compose. For equal-mass PBH binaries, we find $f_\text{PBH}<$ [1, 0.04] for $m_\text{PBH}\in [2\times 10^{-3},10^{-2}]M_\odot$, respectively. For asymmetric mass-ratio binaries, where $m_1=2.5M_\odot$ and $m_2\ll m_1$, we constrain the mass function $f(m_2)<1$ for $m_2\in [1.5\times10^{-5},2\times10^{-4}]M_\odot$, assuming $f_\text{PBH}=0.1$ and $f(m_1)\sim 1$. Our results constitute the first gravitational-wave constraints on planetary-mass PBHs in both equal-mass and highly asymmetric mass-ratio systems, provide a computationally efficient alternative to matched filtering in this mass regime, and complement microlensing experiments to probe the existence of these objects. The data necessary to produce the upper limit plots has also been released on Zenodo.


title: Humanoid Locomotion as Next Token Prediction

abstract: We cast real-world humanoid control as a next token prediction problem, akin to predicting the next word in language. Our model is a causal transformer trained via autoregressive prediction of sensorimotor trajectories. To account for the multi-modal nature of the data, we perform prediction in a modality-aligned way, and for each input token predict the next token from the same modality. This general formulation enables us to leverage data with missing modalities, like video trajectories without actions. We train our model on a collection of simulated trajectories coming from prior neural network policies, model-based controllers, motion capture data, and YouTube videos of humans. We show that our model enables a full-sized humanoid to walk in San Francisco zero-shot. Our model can transfer to the real world even when trained on only 27 hours of walking data, and can generalize to commands not seen during training like walking backward. These findings suggest a promising path toward learning challenging real-world control tasks by generative modeling of sensorimotor trajectories.


title: Towards Generalizable Tumor Synthesis

abstract: Tumor synthesis enables the creation of artificial tumors in medical images, facilitating the training of AI models for tumor detection and segmentation. However, success in tumor synthesis hinges on creating visually realistic tumors that are generalizable across multiple organs and, furthermore, the resulting AI models being capable of detecting real tumors in images sourced from different domains (e.g., hospitals). This paper made a progressive stride toward generalizable tumor synthesis by leveraging a critical observation: early-stage tumors (< 2cm) tend to have similar imaging characteristics in computed tomography (CT), whether they originate in the liver, pancreas, or kidneys. We have ascertained that generative AI models, e.g., Diffusion Models, can create realistic tumors generalized to a range of organs even when trained on a limited number of tumor examples from only one organ. Moreover, we have shown that AI models trained on these synthetic tumors can be generalized to detect and segment real tumors from CT volumes, encompassing a broad spectrum of patient demographics, imaging protocols, and healthcare facilities.


title: Loose LIPS Sink Ships: Asking Questions in Battleship with Language-Informed Program Sampling

abstract: Questions combine our mastery of language with our remarkable facility for reasoning about uncertainty. How do people navigate vast hypothesis spaces to pose informative questions given limited cognitive resources? We study these tradeoffs in a classic grounded question-asking task based on the board game Battleship. Our language-informed program sampling (LIPS) model uses large language models (LLMs) to generate natural language questions, translate them into symbolic programs, and evaluate their expected information gain. We find that with a surprisingly modest resource budget, this simple Monte Carlo optimization strategy yields informative questions that mirror human performance across varied Battleship board scenarios. In contrast, LLM-only baselines struggle to ground questions in the board state; notably, GPT-4V provides no improvement over non-visual baselines. Our results illustrate how Bayesian models of question-asking can leverage the statistics of language to capture human priors, while highlighting some shortcomings of pure LLMs as grounded reasoners.


title: Lifelong Benchmarks: Efficient Model Evaluation in an Era of Rapid Progress

abstract: Standardized benchmarks drive progress in machine learning. However, with repeated testing, the risk of overfitting grows as algorithms over-exploit benchmark idiosyncrasies. In our work, we seek to mitigate this challenge by compiling ever-expanding large-scale benchmarks called Lifelong Benchmarks. As exemplars of our approach, we create Lifelong-CIFAR10 and Lifelong-ImageNet, containing (for now) 1.69M and 1.98M test samples, respectively. While reducing overfitting, lifelong benchmarks introduce a key challenge: the high cost of evaluating a growing number of models across an ever-expanding sample set. To address this challenge, we also introduce an efficient evaluation framework: Sort \& Search (S&S), which reuses previously evaluated models by leveraging dynamic programming algorithms to selectively rank and sub-select test samples, enabling cost-effective lifelong benchmarking. Extensive empirical evaluations across 31,000 models demonstrate that S&S achieves highly-efficient approximate accuracy measurement, reducing compute cost from 180 GPU days to 5 GPU hours (1000x reduction) on a single A100 GPU, with low approximation error. As such, lifelong benchmarks offer a robust, practical solution to the "benchmark exhaustion" problem.


title: Retrieval-Augmented Generation for AI-Generated Content: A Survey

abstract: Advancements in model algorithms, the growth of foundational models, and access to high-quality datasets have propelled the evolution of Artificial Intelligence Generated Content (AIGC). Despite its notable successes, AIGC still faces hurdles such as updating knowledge, handling long-tail data, mitigating data leakage, and managing high training and inference costs. Retrieval-Augmented Generation (RAG) has recently emerged as a paradigm to address such challenges. In particular, RAG introduces the information retrieval process, which enhances the generation process by retrieving relevant objects from available data stores, leading to higher accuracy and better robustness. In this paper, we comprehensively review existing efforts that integrate RAG technique into AIGC scenarios. We first classify RAG foundations according to how the retriever augments the generator, distilling the fundamental abstractions of the augmentation methodologies for various retrievers and generators. This unified perspective encompasses all RAG scenarios, illuminating advancements and pivotal technologies that help with potential future progress. We also summarize additional enhancements methods for RAG, facilitating effective engineering and implementation of RAG systems. Then from another view, we survey on practical applications of RAG across different modalities and tasks, offering valuable references for researchers and practitioners. Furthermore, we introduce the benchmarks for RAG, discuss the limitations of current RAG systems, and suggest potential directions for future research. Github: https://github.com/PKU-DAIR/RAG-Survey.


title: The All-Seeing Project V2: Towards General Relation Comprehension of the Open World

abstract: We present the All-Seeing Project V2: a new model and dataset designed for understanding object relations in images. Specifically, we propose the All-Seeing Model V2 (ASMv2) that integrates the formulation of text generation, object localization, and relation comprehension into a relation conversation (ReC) task. Leveraging this unified task, our model excels not only in perceiving and recognizing all objects within the image but also in grasping the intricate relation graph between them, diminishing the relation hallucination often encountered by Multi-modal Large Language Models (MLLMs). To facilitate training and evaluation of MLLMs in relation understanding, we created the first high-quality ReC dataset ({AS-V2) which is aligned with the format of standard instruction tuning data. In addition, we design a new benchmark, termed Circular-based Relation Probing Evaluation (CRPE) for comprehensively evaluating the relation comprehension capabilities of MLLMs. Notably, our ASMv2 achieves an overall accuracy of 52.04 on this relation-aware benchmark, surpassing the 43.14 of LLaVA-1.5 by a large margin. We hope that our work can inspire more future research and contribute to the evolution towards artificial general intelligence. Our project is released at https://github.com/OpenGVLab/all-seeing.


title: The Counterfeit Conundrum: Can Code Language Models Grasp the Nuances of Their Incorrect Generations?

abstract: While language models are increasingly more proficient at code generation, they still frequently generate incorrect programs. Many of these programs are obviously wrong, but others are more subtle and pass weaker correctness checks such as being able to compile. In this work, we focus on these counterfeit samples: programs sampled from a language model that 1) have a high enough log-probability to be generated at a moderate temperature and 2) pass weak correctness checks. Overall, we discover that most models have a very shallow understanding of counterfeits through three clear failure modes. First, models mistakenly classify them as correct. Second, models are worse at reasoning about the execution behaviour of counterfeits and often predict their execution results as if they were correct. Third, when asking models to fix counterfeits, the likelihood of a model successfully repairing a counterfeit is often even lower than that of sampling a correct program from scratch. Counterfeits also have very unexpected properties: first, counterfeit programs for problems that are easier for a model to solve are not necessarily easier to detect and only slightly easier to execute and repair. Second, counterfeits from a given model are just as confusing to the model itself as they are to other models. Finally, both strong and weak models are able to generate counterfeit samples that equally challenge all models. In light of our findings, we recommend that care and caution be taken when relying on models to understand their own samples, especially when no external feedback is incorporated.


title: Impact of weak lensing on bright standard siren analyses

abstract: Gravitational waves from binary mergers at cosmological distances will experience weak lensing by large scale structure. This causes a (de-)magnification, $\mu$, of the wave amplitude, and a degenerate modification to the inferred luminosity distance $d_L$. To address this the uncertainty on $d_L$ is increased according to the dispersion of the magnification distribution at the source redshift, $\sigma_\mu$. But this term is dependent on cosmological parameters that are being constrained by gravitational wave "standard sirens", such as the Hubble parameter $H_0$, and the matter density fraction $\Omega_m$. $\sigma_\mu$ is also sensitive to the resolution of the simulation used for its calculation. Tension in the measured value of $H_0$ from independent datasets, and the present use of outdated cosmological simulations, suggest $\sigma_\mu$ could be underestimated. We consider two classes of standard siren, supermassive black hole binary and binary neutron star mergers. Underestimating $H_0$ and $\Omega_m$ when calculating $\sigma_\mu$ increases the probability of finding a residual lensing bias on these parameters greater than $1\sigma$ by 1.5-3 times. Underestimating $\sigma_\mu$ by using low resolution/small sky-area simulations can also significantly increase the probability of biased results. For neutron star mergers, the spread of possible biases is 0.25 km/s/Mpc, comparable to the forecasted uncertainty. Left uncorrected this effect limits the use of BNS mergers for precision cosmology. For supermassive black hole binaries, the spread of possible biases on $H_0$ is significant, 5 km/s/Mpc, but $O(200)$ observations are needed to reduce the variance below the bias. To achieve accurate sub-percent level precision on cosmological parameters using standard sirens, first much improved knowledge on the form of the magnification distribution and its dependence on cosmology is needed.


title: Learning a Generalized Physical Face Model From Data

abstract: Physically-based simulation is a powerful approach for 3D facial animation as the resulting deformations are governed by physical constraints, allowing to easily resolve self-collisions, respond to external forces and perform realistic anatomy edits. Today's methods are data-driven, where the actuations for finite elements are inferred from captured skin geometry. Unfortunately, these approaches have not been widely adopted due to the complexity of initializing the material space and learning the deformation model for each character separately, which often requires a skilled artist followed by lengthy network training. In this work, we aim to make physics-based facial animation more accessible by proposing a generalized physical face model that we learn from a large 3D face dataset in a simulation-free manner. Once trained, our model can be quickly fit to any unseen identity and produce a ready-to-animate physical face model automatically. Fitting is as easy as providing a single 3D face scan, or even a single face image. After fitting, we offer intuitive animation controls, as well as the ability to retarget animations across characters. All the while, the resulting animations allow for physical effects like collision avoidance, gravity, paralysis, bone reshaping and more.


title: Topological flat bands, valley polarization, and interband superconductivity in magic-angle twisted bilayer graphene with proximitized spin-orbit couplings

abstract: We study theoretically the magic-angle twisted bilayer graphene with proximity-induced Ising and Rashba spin-orbit couplings on the top layer. We demonstrate topological flat bands and identify three distinct topological phases. Using a weak coupling analysis, we find that (partial) valley polarization prevails for a wide range of doping, suppressing the usual superconductivity with a pairing between time-reversal partners. Remarkably, we uncover that observable unconventional intervalley interband phonon-mediated superconductivity (with the highest $T_c\approx 1.2$K) can coexist with strong valley imbalance due to the approximate Fermi surface nesting between two flat bands not related by time-reversal symmetry, and the dominant pairing is an intersublattice Ising pairing, corresponding to a mixture of $p$- and $d$-waves. In contrast, the intrasublattice Ising phonon-mediated superconductivity with $s$- and $f$-wave mixing emerges in the absence of valley imbalance. Our work reveals a novel route of realizing unconventional superconductivity, and potentially explains the superconductivity phenomenology in existing experiments.


title: Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers

abstract: The quality of the data and annotation upper-bounds the quality of a downstream model. While there exist large text corpora and image-text pairs, high-quality video-text data is much harder to collect. First of all, manual labeling is more time-consuming, as it requires an annotator to watch an entire video. Second, videos have a temporal dimension, consisting of several scenes stacked together, and showing multiple actions. Accordingly, to establish a video dataset with high-quality captions, we propose an automatic approach leveraging multimodal inputs, such as textual video description, subtitles, and individual video frames. Specifically, we curate 3.8M high-resolution videos from the publicly available HD-VILA-100M dataset. We then split them into semantically consistent video clips, and apply multiple cross-modality teacher models to obtain captions for each video. Next, we finetune a retrieval model on a small subset where the best caption of each video is manually selected and then employ the model in the whole dataset to select the best caption as the annotation. In this way, we get 70M videos paired with high-quality text captions. We dub the dataset as Panda-70M. We show the value of the proposed dataset on three downstream tasks: video captioning, video and text retrieval, and text-driven video generation. The models trained on the proposed data score substantially better on the majority of metrics across all the tasks.


title: Single Electron Quantum Dot in Two-Dimensional Transition Metal Dichalcogenides

abstract: Spin-valley properties in two-dimensional (2D) semiconducting transition metal dichalcogenides (TMDC) has attracted significant interest due to the possible applications in quantum computing. Spin-valley properties can be exploited in TMDC quantum dot (QD) with well-resolved energy levels. This requires smaller QDs, especially in material systems with heavy carrier effective mass e.g. TMDCs and silicon. Device architectures employed for TMDC QDs so far have difficulty achieving smaller QDs. Therefore, an alternative approach in the device architecture is needed. Here, we propose a multilayer device architecture to achieve a gate-defined QD in TMDC with a relatively large energy splitting on the QD. We provide a range of device dimensions and dielectric thicknesses and its correlation with the QD energy splitting. The device architecture is modeled realistically. Moreover, we show that all the device parameters used in modeling are experimentally achievable. These studies lay the foundation for future work toward spin-valley qubits in TMDCs. The successful implementation of these device architectures will drive the technological development of 2D materials-based quantum technologies.


title: DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

abstract: Diffusion models have achieved great success in synthesizing high-quality images. However, generating high-resolution images with diffusion models is still challenging due to the enormous computational costs, resulting in a prohibitive latency for interactive applications. In this paper, we propose DistriFusion to tackle this problem by leveraging parallelism across multiple GPUs. Our method splits the model input into multiple patches and assigns each patch to a GPU. However, naively implementing such an algorithm breaks the interaction between patches and loses fidelity, while incorporating such an interaction will incur tremendous communication overhead. To overcome this dilemma, we observe the high similarity between the input from adjacent diffusion steps and propose displaced patch parallelism, which takes advantage of the sequential nature of the diffusion process by reusing the pre-computed feature maps from the previous timestep to provide context for the current step. Therefore, our method supports asynchronous communication, which can be pipelined by computation. Extensive experiments show that our method can be applied to recent Stable Diffusion XL with no quality degradation and achieve up to a 6.1$\times$ speedup on eight NVIDIA A100s compared to one. Our code is publicly available at https://github.com/mit-han-lab/distrifuser.


title: Metabolic scaling in small life forms

abstract: Metabolic scaling is one of the most important patterns in biology. Theory explaining the 3/4-power size-scaling of biological metabolic rate does not predict the non-linear scaling observed for smaller life forms. Here we present a new model for cells $<10^{-8}$ m$^{3}$ that maximizes power from the reaction-displacement dynamics of enzyme-catalyzed reactions. Maximum metabolic rate is achieved through an allocation of cell volume to optimize a ratio of reaction velocity to molecular movement. Small cells $< 10^{-17}$ m$^{3}$ generate power under diffusion by diluting enzyme concentration as cell volume increases. Larger cells require bulk flow of cytoplasm generated by molecular motors. These outcomes predict curves with literature-reported parameters that match the observed scaling of metabolic rates for unicells, and predicts the volume at which Prokaryotes transition to Eukaryotes. We thus reveal multiple size-dependent physical constraints for microbes in a model that extends prior work to provide a parsimonious hypothesis for how metabolism scales across small life.


title: Gradient estimate for Fisher-KPP equation on Finsler metric measure spaces

abstract: In this manuscript, we study the positive solutions of the Finslerian Fisher-KPP equation $$ u_t=\Delta^{\nabla u} u+cu(1-u). $$ The Fisher-KPP equation is widely applied and connected to many mathematical branches. We establish the global gradient estimates on compact Finsler metric measure manifold with the traditional $CD(K,N)$ condition, which is developed by S. Ohta and K.-T. Sturm in Finsler geometry. Furthermore, With the assistance of a new comparison theorem developed by the first author, we also give the gradient estimate on forward complete noncompact locally finite misalignment Finsler metric measure spaces with the mixed weighted curvature bounded below and some non-Riemannian curvatures norm-bounded.


title: Radical Pair Mechanism and the Role of Chirality-Induced Spin Selectivity during Planaria Regeneration: Effect of Weak Magnetic Field on ROS levels

abstract: Planarian is an intriguing model system wherein the effect of electric and magnetic fields can be studied on various biochemical pathways during cell morphogenesis. Recent experimental observations have demonstrated the non-trivial modulation of reactive oxygen species (ROS) levels by a weak magnetic field during planaria regeneration. However, the underlying biophysical mechanism behind this remains elusive. In this paper, we study the radical pair mechanism to explain the effect of weak magnetic fields on ROS modulation during planaria regeneration to explain the experimental results. We also investigate the effect of chirality-induced spin selectivity (CISS) on ROS levels by including it in the framework of the radical pair mechanism. We conclude that the inclusion of CISS explains the experimental results better and allows the radical pair model to have more parametric space to satisfy the experimental constraints. This study explains the crucial process of ROS modulation by the weak magnetic field with and without CISS, thereby paving the way to unraveling the vast domain of ROS modulation for desired outcomes.


title: Evaporation of bacteria-laden surrogate respiratory fluid droplets: On a hydrophilic substrate versus contact-free environment confers differential bacterial infectivity

abstract: The transmission of viruses/ bacteria cause infection predominantly via aerosols. The transmission mechanism of respiratory diseases is complex, including direct or indirect contact, large droplet, and airborne routes apart from close contact transmission. With this pretext, we have investigated two modes of droplet evaporation to understand its significance in airborne disease transmission; a droplet in a contact-free environment, which evaporates and forms droplet nuclei, and a droplet on a hydrophilic substrate (fomite). The study examines mass transport, the deposition pattern of bacteria in the precipitates, and their survival and virulence. The osmotic pressure increases with the salt concentration, inactivating the bacteria embedded in the precipitates with accelerated evaporation. Further, the bacteria's degree of survival and enhanced pathogenicity are compared for both evaporation modes. The striking differences in pathogenicity are attributed to the evaporation rate, oxygen availability, and reactive oxygen species (ROS) generation.


title: Organic electrochemical neurons and synapses with ion mediated spiking

abstract: Future brain-machine interfaces, prosthetics, and intelligent soft robotics will require integrating artificial neuromorphic devices with biological systems. Due to their poor biocompatibility, circuit complexity, low energy efficiency, and operating principles fundamentally different from the ion signal modulation of biology, traditional Silicon-based neuromorphic implementations have limited bio-integration potential. Here, we report the first organic electrochemical neurons (OECNs) with ion-modulated spiking, based on allprinted complementary organic electrochemical transistors. We demonstrate facile biointegration of OECNs with Venus Flytrap (Dionaea muscipula) to induce lobe closure upon input stimuli. The OECNs can also be integrated with all-printed organic electrochemical synapses (OECSs), exhibiting short-term plasticity with paired-pulse facilitation and longterm plasticity with retention >1000 s, facilitating Hebbian learning. These soft and flexible OECNs operate below 0.6 V and respond to multiple stimuli, defining a new vista for localized artificial neuronal systems possible to integrate with bio-signaling systems of plants, invertebrates, and vertebrates.


title: Local sensitivity analysis of heating degree day and cooling degree day temperature derivatives prices

abstract: We study the local sensitivity of heating degree day (HDD) and cooling degree day (CDD) temperature futures and option prices with respect to perturbations in the deseasonalized temperature or in one of its derivatives up to a certain order determined by the continuous-time autoregressive process modelling the deseasonalized temperature in the HDD and CDD indexes. We also consider an empirical case where a CAR process of autoregressive order 3 is fitted to New York temperatures and we perform a study of the local sensitivity of these financial contracts and a posterior analysis of the results.


title: Marginal Fermi liquid behavior at the onset of $\boldsymbol{2k_F}$ density wave order in two-dimensional metals with flat hot spots

abstract: We analyze quantum fluctuation effects at the onset of incommensurate $2k_F$ charge- or spin-density wave order in two-dimensional metals, for a model where the ordering wave vector $\boldsymbol{Q}$ connects a single pair of hot spots on the Fermi surface with a vanishing Fermi surface curvature. The tangential momentum dependence of the bare dispersion near the hot spots is proportional to $|k_t|^\alpha$ with $\alpha > 2$. We first compute the order parameter susceptibility and the fermion self-energy in random phase approximation (RPA). Logarithmic divergences are subsequently treated by a renormalization group analysis. The coupling between the order parameter fluctuations and the fermions vanishes logarithmically in the low-energy limit. As a consequence, the logarithmic divergences found in RPA do not sum up to anomalous power laws. Instead, only logarithmic corrections to Fermi liquid behavior are obtained. In particular, the quasiparticle weight and the Fermi velocity vanish logarithmically at the hot spots.


title: Mathematical models of drug delivery via a contact lens during wear

abstract: In this work we develop and investigate mathematical and computational models that describe drug delivery from a contact lens during wear. Our models are designed to predict the dynamics of drug release from the contact lens and subsequent transport into the adjacent pre-lens tear film and post-lens tear film as well as into the ocular tissue (e.g. cornea), into the eyelid, and out of these regions. These processes are modeled by one dimensional diffusion out of the lens coupled to compartment-type models for drug concentrations in the various accompanying regions. In addition to numerical solutions that are compared with experimental data on drug release in an in vitro eye model, we also identify a large diffusion limit model for which analytical solutions can be written down for all quantities of interest, such as cumulative release of the drug from the contact lens. We use our models to make assessments about possible mechanisms and drug transport pathways through the pre-lens and post-lens tear films and provide interpretation of experimental observations. We discuss successes and limitations of our models as well as their potential to guide further research to help understand the dynamics of ophthalmic drug delivery via drug-eluting contact lenses.


title: Randomized Control in Performance Analysis and Empirical Asset Pricing

abstract: The present article explores the application of randomized control techniques in empirical asset pricing and performance evaluation. It introduces geometric random walks, a class of Markov chain Monte Carlo methods, to construct flexible control groups in the form of random portfolios adhering to investor constraints. The sampling-based methods enable an exploration of the relationship between academically studied factor premia and performance in a practical setting. In an empirical application, the study assesses the potential to capture premias associated with size, value, quality, and momentum within a strongly constrained setup, exemplified by the investor guidelines of the MSCI Diversified Multifactor index. Additionally, the article highlights issues with the more traditional use case of random portfolios for drawing inferences in performance evaluation, showcasing challenges related to the intricacies of high-dimensional geometry.


title: Self-testing of genuine multipartite non-local and non-maximally entangled states

abstract: Self-testing enables the characterization of quantum systems with minimal assumptions on their internal working as such it represents the strongest form of certification for quantum systems. In the existing self-testing literature, self-testing states that are not maximally entangled, but exhibit genuine multipartite nonlocality, have remained an open problem. This is particularly important because, for many-body systems, genuine multipartite nonlocality has been recognized as the strongest form of multipartite quantum correlation. In this work, we present a Cabello-like paradox for scenarios involving an arbitrary number of parties. This paradox is a tool for detecting genuine multipartite nonlocality, allowing for the specific identification and self-testing of states that defy the paradox's limits the most, which turn out to be non-maximally multipartite entangled states. While recent results [\textit{\v{S}upi\'c et al., Nature Physics, 2023}] suggest network self-testing as a means to self-test all quantum states, here we operate within the standard self-testing framework to self-test genuine multipartite non-local and non-maximally entangled states.


title: Introducing User Feedback-based Counterfactual Explanations (UFCE)

abstract: Machine learning models are widely used in real-world applications. However, their complexity makes it often challenging to interpret the rationale behind their decisions. Counterfactual explanations (CEs) have emerged as a viable solution for generating comprehensible explanations in eXplainable Artificial Intelligence (XAI). CE provides actionable information to users on how to achieve the desired outcome with minimal modifications to the input. However, current CE algorithms usually operate within the entire feature space when optimizing changes to turn over an undesired outcome, overlooking the identification of key contributors to the outcome and disregarding the practicality of the suggested changes. In this study, we introduce a novel methodology, that is named as user feedback-based counterfactual explanation (UFCE), which addresses these limitations and aims to bolster confidence in the provided explanations. UFCE allows for the inclusion of user constraints to determine the smallest modifications in the subset of actionable features while considering feature dependence, and evaluates the practicality of suggested changes using benchmark evaluation metrics. We conducted three experiments with five datasets, demonstrating that UFCE outperforms two well-known CE methods in terms of \textit{proximity}, \textit{sparsity}, and \textit{feasibility}. Reported results indicate that user constraints influence the generation of feasible CEs.


title: PreRoutGNN for Timing Prediction with Order Preserving Partition: Global Circuit Pre-training, Local Delay Learning and Attentional Cell Modeling

abstract: Pre-routing timing prediction has been recently studied for evaluating the quality of a candidate cell placement in chip design. It involves directly estimating the timing metrics for both pin-level (slack, slew) and edge-level (net delay, cell delay), without time-consuming routing. However, it often suffers from signal decay and error accumulation due to the long timing paths in large-scale industrial circuits. To address these challenges, we propose a two-stage approach. First, we propose global circuit training to pre-train a graph auto-encoder that learns the global graph embedding from circuit netlist. Second, we use a novel node updating scheme for message passing on GCN, following the topological sorting sequence of the learned graph embedding and circuit graph. This scheme residually models the local time delay between two adjacent pins in the updating sequence, and extracts the lookup table information inside each cell via a new attention mechanism. To handle large-scale circuits efficiently, we introduce an order preserving partition scheme that reduces memory consumption while maintaining the topological dependencies. Experiments on 21 real world circuits achieve a new SOTA R2 of 0.93 for slack prediction, which is significantly surpasses 0.59 by previous SOTA method. Code will be available at: https://github.com/Thinklab-SJTU/EDA-AI.


title: Prioritizing Informative Features and Examples for Deep Learning from Noisy Data

abstract: In this dissertation, we propose a systemic framework that prioritizes informative features and examples to enhance each stage of the development process. Specifically, we prioritize informative features and examples and improve the performance of feature learning, data labeling, and data selection. We first propose an approach to extract only informative features that are inherent to solving a target task by using auxiliary out-of-distribution data. We deactivate the noise features in the target distribution by using that in the out-of-distribution data. Next, we introduce an approach that prioritizes informative examples from unlabeled noisy data in order to reduce the labeling cost of active learning. In order to solve the purity-information dilemma, where an attempt to select informative examples induces the selection of many noisy examples, we propose a meta-model that finds the best balance between purity and informativeness. Lastly, we suggest an approach that prioritizes informative examples from labeled noisy data to preserve the performance of data selection. For labeled image noise data, we propose a data selection method that considers the confidence of neighboring samples to maintain the performance of the state-of-the-art Re-labeling models. For labeled text noise data, we present an instruction selection method that takes diversity into account for ranking the quality of instructions with prompting, thereby enhancing the performance of aligned large language models. Overall, our unified framework induces the deep learning development process robust to noisy data, thereby effectively mitigating noisy features and examples in real-world applications.


title: GIN-SD: Source Detection in Graphs with Incomplete Nodes via Positional Encoding and Attentive Fusion

abstract: Source detection in graphs has demonstrated robust efficacy in the domain of rumor source identification. Although recent solutions have enhanced performance by leveraging deep neural networks, they often require complete user data. In this paper, we address a more challenging task, rumor source detection with incomplete user data, and propose a novel framework, i.e., Source Detection in Graphs with Incomplete Nodes via Positional Encoding and Attentive Fusion (GIN-SD), to tackle this challenge. Specifically, our approach utilizes a positional embedding module to distinguish nodes that are incomplete and employs a self-attention mechanism to focus on nodes with greater information transmission capacity. To mitigate the prediction bias caused by the significant disparity between the numbers of source and non-source nodes, we also introduce a class-balancing mechanism. Extensive experiments validate the effectiveness of GIN-SD and its superiority to state-of-the-art methods.


title: Strong Correlations at Oxide Interfaces: What is Hidden in a Plane View?

abstract: A prime goal for this lecture is to provide a reader with a reasonably self-sufficient answer to the question of what interesting effects can happen if you join two dissimilar materials with correlated carriers to construct a sandwich with the interface across those layers. Through the lens of physical phenomena, we will delve into the design ideas that lead to the creation of new synthetic quantum materials with properties primarily governed by the interface.


title: Deep Sensitivity Analysis for Objective-Oriented Combinatorial Optimization

abstract: Pathogen control is a critical aspect of modern poultry farming, providing important benefits for both public health and productivity. Effective poultry management measures to reduce pathogen levels in poultry flocks promote food safety by lowering risks of food-borne illnesses. They also support animal health and welfare by preventing infectious diseases that can rapidly spread and impact flock growth, egg production, and overall health. This study frames the search for optimal management practices that minimize the presence of multiple pathogens as a combinatorial optimization problem. Specifically, we model the various possible combinations of management settings as a solution space that can be efficiently explored to identify configurations that optimally reduce pathogen levels. This design incorporates a neural network feedback-based method that combines feature explanations with global sensitivity analysis to ensure combinatorial optimization in multiobjective settings. Our preliminary experiments have promising results when applied to two real-world agricultural datasets. While further validation is still needed, these early experimental findings demonstrate the potential of the model to derive targeted feature interactions that adaptively optimize pathogen control under varying real-world constraints.