title: Central Charge in Quantum Optics

abstract: The product of two unitaries can normally be expressed as a single exponential through the famous Baker-Campbell-Hausdorff formula. We present here a counterexample in quantum optics, by showing that an expression in terms of a single exponential is possible only at the expense of the introduction of a new element (a central extension of the algebra), implying that there will be unitaries, generated by a sequence of gates, that cannot be generated by any time-independent quadratic Hamiltonian. A quantum-optical experiment is proposed that brings to light this phenomenon.


title: CharNeRF: 3D Character Generation from Concept Art

abstract: 3D modeling holds significant importance in the realms of AR/VR and gaming, allowing for both artistic creativity and practical applications. However, the process is often time-consuming and demands a high level of skill. In this paper, we present a novel approach to create volumetric representations of 3D characters from consistent turnaround concept art, which serves as the standard input in the 3D modeling industry. While Neural Radiance Field (NeRF) has been a game-changer in image-based 3D reconstruction, to the best of our knowledge, there is no known research that optimizes the pipeline for concept art. To harness the potential of concept art, with its defined body poses and specific view angles, we propose encoding it as priors for our model. We train the network to make use of these priors for various 3D points through a learnable view-direction-attended multi-head self-attention layer. Additionally, we demonstrate that a combination of ray sampling and surface sampling enhances the inference capabilities of our network. Our model is able to generate high-quality 360-degree views of characters. Subsequently, we provide a simple guideline to better leverage our model to extract the 3D mesh. It is important to note that our model's inferencing capabilities are influenced by the training data's characteristics, primarily focusing on characters with a single head, two arms, and two legs. Nevertheless, our methodology remains versatile and adaptable to concept art from diverse subject matters, without imposing any specific assumptions on the data.


title: The Composition and Chemistry of Titan's Atmosphere

abstract: In this article I summarize the current state of knowledge about the composition of Titan's atmosphere, and our current understanding of the suggested chemistry that leads to that observed composition. I begin with our present knowledge of the atmospheric composition, garnered from a variety of measurements including Cassini-Huygens, the Atacama Large Millimeter/submillimeter Array (ALMA), and other ground and space-based telescopes. This review focuses on the typical vertical profiles of gases at low latitudes, rather than global and temporal variations. The main body of the paper presents a chemical description of how complex molecules are believed to arise from simpler species, considering all known 'stable' molecules - those that have been uniquely identified in the neutral atmosphere. The last section of the paper is devoted to the gaps in our present knowledge of Titan's chemical composition and how further work may fill those gaps.


title: Deep Reinforcement Learning (DRL)-based Methods for Serverless Stream Processing Engines: A Vision, Architectural Elements, and Future Directions

abstract: Streaming applications are becoming widespread across an extensive range of business domains as an increasing number of sources continuously produce data that need to be processed and analysed in real time. Modern businesses are aggressively using streaming data to generate valuable knowledge that can be used to automate processes, help decision-making, optimize resource usage, and ultimately generate revenue for the organization. Despite their increased adoption and tangible benefits, support for the automated deployment and management of streaming applications is yet to emerge. Although a plethora of stream management systems have flooded the open source community in recent years, all of the existing frameworks demand a considerably challenging and lengthy effort from human operators to manually and continuously tune their configuration and deployment environment in order to reach and maintain the desired performance goals. To address these challenges, this article proposes a vision for creating Deep Reinforcement Learning (DRL)-based methods for transforming stream processing engines into self-managed serverless solutions. This will lead to an increase in productivity as engineers can focus on the actual development process, an increase in application performance potentially leading to reduced response times and more accurate and meaningful results, and a considerable decrease in operational costs for organizations.


title: Heralded single-photon source based on superpositions of squeezed states

abstract: We propose a heralded single-photon source based on injecting a superposition of oppositely squeezed states onto a beam splitter. Our superposition of squeezed states is composed of only even photon number states (the number of photons is equal to $2,6,10,...$) meaning the probability for an emitted single photon given as a heralded single-photon event is higher than what one can achieve from the usual two-mode squeezed state. This enables one to realize an enhanced heralded single-photon source. We discuss how to create this superposition of squeezed states utilizing a single-mode squeezed state and the cross-Kerr nonlinearity. Our proposed method significantly improves the probability of emitting the heralded single photon compared to spontaneous parametric down-conversion.


title: Creating Suspenseful Stories: Iterative Planning with Large Language Models

abstract: Automated story generation has been one of the long-standing challenges in NLP. Among all dimensions of stories, suspense is very common in human-written stories but relatively under-explored in AI-generated stories. While recent advances in large language models (LLMs) have greatly promoted language generation in general, state-of-the-art LLMs are still unreliable when it comes to suspenseful story generation. We propose a novel iterative-prompting-based planning method that is grounded in two theoretical foundations of story suspense from cognitive psychology and narratology. This theory-grounded method works in a fully zero-shot manner and does not rely on any supervised story corpora. To the best of our knowledge, this paper is the first attempt at suspenseful story generation with LLMs. Extensive human evaluations of the generated suspenseful stories demonstrate the effectiveness of our method.


title: LCEN: A Novel Feature Selection Algorithm for Nonlinear, Interpretable Machine Learning Models

abstract: Interpretable architectures can have advantages over black-box architectures, and interpretability is essential for the application of machine learning in critical settings, such as aviation or medicine. However, the simplest, most commonly used interpretable architectures, such as LASSO or elastic net (EN), are limited to linear predictions and have poor feature selection capabilities. In this work, we introduce the LASSO-Clip-EN (LCEN) algorithm for the creation of nonlinear, interpretable machine learning models. LCEN is tested on a wide variety of artificial and empirical datasets, frequently creating more accurate, sparser models than other architectures, including those for building sparse, nonlinear models. LCEN is robust against many issues typically present in datasets and modeling, including noise, multicollinearity, data scarcity, and hyperparameter variance. LCEN is also able to rediscover multiple physical laws from empirical data and, for processes with no known physical laws, LCEN achieves better results than many other dense and sparse methods -- including using 10.8-fold fewer features than dense methods and 8.1-fold fewer features than EN on one dataset, and is comparable to or better than ANNs on multiple datasets.


title: A survey of energies from pure metals to multi-principal element alloys

abstract: In materials science, a wide range of properties of materials are governed by various types of energies, including thermal, physicochemical, structural, and mechanical energies. In 2005, Dr. Frans Spaepen used crystalline face-centered-cubic (fcc) copper as an example to discuss a variety of phenomena that are associated with energies. Inspired by his pioneering work, we broaden our analysis to include a selection of representative pure metals with fcc, hexagonal close-packed (hcp), and body-centered cubic (bcc) structures. Additionally, we extend our comparison to energies between pure metals and equiatomic binary, ternary, and multi-principal element alloys (sometimes also known as high-entropy alloys). Through an extensive collection of data and calculations, we compile energy tables that provide a comprehensive view of how structure and alloying influence the energy profiles of these metals and alloys. We highlight the significant impact of constituent elements on the energies of alloys compared to pure metals and reveal a notable disparity in mechanical energies among materials in fcc-, hcp- and bcc-structured metals and alloys. Furthermore, we discuss the underlying mechanisms behind these patterns and discuss the implications for structural transformations, providing insights into the broader context of these energy variations.


title: Data-driven discovery of interpretable Lagrangian of stochastically excited dynamical systems

abstract: Exploring the intersection of deterministic and stochastic dynamics, this paper delves into Lagrangian discovery for conservative and non-conservative systems under stochastic excitation. Traditional Lagrangian frameworks, adept at capturing deterministic behavior, are extended to incorporate stochastic excitation. The study critically evaluates recent computational methodologies for learning Lagrangians from observed data, highlighting the limitations in interpretability and the exclusion of stochastic excitation. To address these gaps, an automated data-driven framework is proposed for the simultaneous yet uncoupled discovery of Lagrange densities and the volatility function of stochastic excitation by leveraging the sparse regression. This novel framework offers several advantages over existing approaches. Firstly, it provides an interpretable description of the underlying Lagrange density, allowing for a deeper understanding of system dynamics under stochastic excitations. Secondly, it identifies the interpretable form of the generalized stochastic force, addressing the limitations of existing deterministic approaches. Additionally, the framework demonstrates robustness and versatility through numerical case studies encompassing both stochastic differential equations (SDEs) and stochastic partial differential equations (SPDEs), with results showing almost exact approximations to true system behavior and minimal relative error in derived equations of motion.


title: Theory-Independent Realism

abstract: The distinctive features of quantum mechanics, which set it apart from other physical theories, challenge our notions of realism. Recovering realism from purely philosophical grounds, a quantitative and operational criterion was proposed in the past, but solely for the context of quantum mechanics. We use a framework of generalized probabilistic theories to expand the notion of realism for a theory-independent context, providing a criterion uniquely based on the probabilities assigned to measurement outcomes. More so, using robustness and the Kullback-Leibler divergence, we propose quantifiers for the realism of arbitrary physical properties given a particular state of a generic physical theory. These theory-independent quantifiers are then employed in quantum mechanics and we investigate their relation with another well-established irrealism measure.


title: Fact-and-Reflection (FaR) Improves Confidence Calibration of Large Language Models

abstract: For a LLM to be trustworthy, its confidence level should be well-calibrated with its actual performance. While it is now common sense that LLM performances are greatly impacted by prompts, the confidence calibration in prompting LLMs has yet to be thoroughly explored. In this paper, we explore how different prompting strategies influence LLM confidence calibration and how it could be improved. We conduct extensive experiments on six prompting methods in the question-answering context and we observe that, while these methods help improve the expected LLM calibration, they also trigger LLMs to be over-confident when responding to some instances. Inspired by human cognition, we propose Fact-and-Reflection (FaR) prompting, which improves the LLM calibration in two steps. First, FaR elicits the known "facts" that are relevant to the input prompt from the LLM. And then it asks the model to "reflect" over them to generate the final answer. Experiments show that FaR prompting achieves significantly better calibration; it lowers the Expected Calibration Error by 23.5% on our multi-purpose QA tasks. Notably, FaR prompting even elicits the capability of verbally expressing concerns in less confident scenarios, which helps trigger retrieval augmentation for solving these harder instances.


title: Waveform Simulation for Scintillation Characteristics of NaI(Tl) Crystal

abstract: The lowering of the energy threshold in the NaI detector is crucial not only for comprehensive validation of DAMA/LIBRA but also for exploring new possibilities in the search for low-mass dark matter and observing coherent elastic scattering between neutrino and nucleus. Alongside hardware enhancements, extensive efforts have focused on refining event selection to discern noise, achieved through parameter development and the application of machine learning. Acquiring pure, unbiased datasets is crucial in this endeavor, for which a waveform simulation was developed. The simulation data were compared with the experimental data using several pulse shape discrimination parameters to test its performance in describing the experimental data. Additionally, we present the outcomes of multi-variable machine learning trained with simulation data as a scintillation signal sample. The distributions of outcomes for experimental and simulation data show a good agreement. As an application of the waveform simulation, we validate the trigger efficiency alongside estimations derived from the minimally biased measurement data.


title: Design principles of nonlinear optical materials for Terahertz lasers

abstract: We have investigated both inter-band and intra-band second order nonlinear optical conductivity based on the velocity correlation formalism and the spectral expansion technique. We propose a scenario in which the second order intra-band process is nonzero while the inter-band process is zero. This occurs for a band structure with momentum asymmetry in the Brillouin zone. Very low-energy photons are blocked by the Pauli exclusion principle from participating in the inter-band process; however, they are permitted to participate in the intra-band process, with the band smeared by some impurity scattering. We establish a connection between the inter-band nonlinear optical conductivity in the velocity gauge and the shift vector in the length gauge for a two-band model. Using a quasiclassical kinetic approach, we demonstrate the importance of intra-band transitions in high harmonic generations for the single tilted Dirac cone model and hexagonal warping model. We confirm that the Kramers-Kronig relations break down for the limit case of ($\omega$, $-\omega$) in the nonlinear optical conductivity. Finally, we calculate the superconducting transition temperature of NbN and the dielectric function of AlN, and the resistance of the NbN/AlN junction. The natural non-linearity of the Josephson junction brings a Josephson plasma with frequency in the Terahertz region.


title: Experimental Study: Enhancing Voice Spoofing Detection Models with wav2vec 2.0

abstract: Conventional spoofing detection systems have heavily relied on the use of handcrafted features derived from speech data. However, a notable shift has recently emerged towards the direct utilization of raw speech waveforms, as demonstrated by methods like SincNet filters. This shift underscores the demand for more sophisticated audio sample features. Moreover, the success of deep learning models, particularly those utilizing large pretrained wav2vec 2.0 as a featurization front-end, highlights the importance of refined feature encoders. In response, this research assessed the representational capability of wav2vec 2.0 as an audio feature extractor, modifying the size of its pretrained Transformer layers through two key adjustments: (1) selecting a subset of layers starting from the leftmost one and (2) fine-tuning a portion of the selected layers from the rightmost one. We complemented this analysis with five spoofing detection back-end models, with a primary focus on AASIST, enabling us to pinpoint the optimal configuration for the selection and fine-tuning process. In contrast to conventional handcrafted features, our investigation identified several spoofing detection systems that achieve state-of-the-art performance in the ASVspoof 2019 LA dataset. This comprehensive exploration offers valuable insights into feature selection strategies, advancing the field of spoofing detection.


title: OSCaR: Object State Captioning and State Change Representation

abstract: The capability of intelligent models to extrapolate and comprehend changes in object states is a crucial yet demanding aspect of AI research, particularly through the lens of human interaction in real-world settings. This task involves describing complex visual environments, identifying active objects, and interpreting their changes as conveyed through language. Traditional methods, which isolate object captioning and state change detection, offer a limited view of dynamic environments. Moreover, relying on a small set of symbolic words to represent changes has restricted the expressiveness of the language. To address these challenges, in this paper, we introduce the Object State Captioning and State Change Representation (OSCaR) dataset and benchmark. OSCaR consists of 14,084 annotated video segments with nearly 1,000 unique objects from various egocentric video collections. It sets a new testbed for evaluating multimodal large language models (MLLMs). Our experiments demonstrate that while MLLMs show some skill, they lack a full understanding of object state changes. The benchmark includes a fine-tuned model that, despite initial capabilities, requires significant improvements in accuracy and generalization ability for effective understanding of these changes. Our code and dataset are available at https://github.com/nguyennm1024/OSCaR.


title: Side Information-Driven Session-based Recommendation: A Survey

abstract: The session-based recommendation (SBR) garners increasing attention due to its ability to predict anonymous user intents within limited interactions. Emerging efforts incorporate various kinds of side information into their methods for enhancing task performance. In this survey, we thoroughly review the side information-driven session-based recommendation from a data-centric perspective. Our survey commences with an illustration of the motivation and necessity behind this research topic. This is followed by a detailed exploration of various benchmarks rich in side information, pivotal for advancing research in this field. Moreover, we delve into how these diverse types of side information enhance SBR, underscoring their characteristics and utility. A systematic review of research progress is then presented, offering an analysis of the most recent and representative developments within this topic. Finally, we present the future prospects of this vibrant topic.


title: Privacy-Preserving Map-Free Exploration for Confirming the Absence of a Radioactive Source

abstract: Performing an inspection task while maintaining the privacy of the inspected site is a challenging balancing act. In this work, we are motivated by the future of nuclear arms control verification, which requires both a high level of privacy and guaranteed correctness. For scenarios with limitations on sensors and stored information due to the potentially secret nature of observable features, we propose a robotic verification procedure that provides map-free exploration to perform a source verification task without requiring, nor revealing, any task-irrelevant, site-specific information. We provide theoretical guarantees on the privacy and correctness of our approach, validated by extensive simulated and hardware experiments.


title: Predicting O-GlcNAcylation Sites in Mammalian Proteins with Transformers and RNNs Trained with a New Loss Function

abstract: Glycosylation, a protein modification, has multiple essential functional and structural roles. O-GlcNAcylation, a subtype of glycosylation, has the potential to be an important target for therapeutics, but methods to reliably predict O-GlcNAcylation sites had not been available until 2023; a 2021 review correctly noted that published models were insufficient and failed to generalize. Moreover, many are no longer usable. In 2023, a considerably better RNN model with an F$_1$ score of 36.17% and an MCC of 34.57% on a large dataset was published. This article first sought to improve these metrics using transformer encoders. While transformers displayed high performance on this dataset, their performance was inferior to that of the previously published RNN. We then created a new loss function, which we call the weighted focal differentiable MCC, to improve the performance of classification models. RNN models trained with this new function display superior performance to models trained using the weighted cross-entropy loss; this new function can also be used to fine-tune trained models. A two-cell RNN trained with this loss achieves state-of-the-art performance in O-GlcNAcylation site prediction with an F$_1$ score of 38.82% and an MCC of 38.21% on that large dataset.


title: A Bayesian Committee Machine Potential for Organic Nitrogen Compounds

abstract: Large-scale computer simulations of chemical atoms are used in a wide range of applications, including batteries, drugs, and more. However, there is a problem with efficiency as it takes a long time due to the large amount of calculation. To solve these problems, machine learning interatomic potential (ML-IAP) technology is attracting attention as an alternative. ML-IAP not only has high accuracy by faithfully expressing the density functional theory (DFT), but also has the advantage of low computational cost. However, there is a problem that the potential energy changes significantly depending on the environment of each atom, and expansion to a wide range of compounds within a single model is still difficult to build in the case of a kernel-based model. To solve this problem, we would like to develop a universal ML-IAP using this active Bayesian Committee Machine (BCM) potential methodology for carbon-nitrogen-hydrogen (CNH) with various compositions. ML models are trained and generated through first-principles calculations and molecular dynamics simulations for molecules with only CNH. Using long amine structures to test an ML model trained only with short chains, the results show excellent consistency with DFT calculations. Consequently, machine learning-based models for organic molecules not only demonstrate the ability to accurately describe various physical properties but also hold promise for investigating a broad spectrum of diverse materials systems.


title: SAM-DiffSR: Structure-Modulated Diffusion Model for Image Super-Resolution

abstract: Diffusion-based super-resolution (SR) models have recently garnered significant attention due to their potent restoration capabilities. But conventional diffusion models perform noise sampling from a single distribution, constraining their ability to handle real-world scenes and complex textures across semantic regions. With the success of segment anything model (SAM), generating sufficiently fine-grained region masks can enhance the detail recovery of diffusion-based SR model. However, directly integrating SAM into SR models will result in much higher computational cost. In this paper, we propose the SAM-DiffSR model, which can utilize the fine-grained structure information from SAM in the process of sampling noise to improve the image quality without additional computational cost during inference. In the process of training, we encode structural position information into the segmentation mask from SAM. Then the encoded mask is integrated into the forward diffusion process by modulating it to the sampled noise. This adjustment allows us to independently adapt the noise mean within each corresponding segmentation area. The diffusion model is trained to estimate this modulated noise. Crucially, our proposed framework does NOT change the reverse diffusion process and does NOT require SAM at inference. Experimental results demonstrate the effectiveness of our proposed method, showcasing superior performance in suppressing artifacts, and surpassing existing diffusion-based methods by 0.74 dB at the maximum in terms of PSNR on DIV2K dataset. The code and dataset are available at https://github.com/lose4578/SAM-DiffSR.


title: Efficiently Leveraging Linguistic Priors for Scene Text Spotting

abstract: Incorporating linguistic knowledge can improve scene text recognition, but it is questionable whether the same holds for scene text spotting, which typically involves text detection and recognition. This paper proposes a method that leverages linguistic knowledge from a large text corpus to replace the traditional one-hot encoding used in auto-regressive scene text spotting and recognition models. This allows the model to capture the relationship between characters in the same word. Additionally, we introduce a technique to generate text distributions that align well with scene text datasets, removing the need for in-domain fine-tuning. As a result, the newly created text distributions are more informative than pure one-hot encoding, leading to improved spotting and recognition performance. Our method is simple and efficient, and it can easily be integrated into existing auto-regressive-based approaches. Experimental results show that our method not only improves recognition accuracy but also enables more accurate localization of words. It significantly improves both state-of-the-art scene text spotting and recognition pipelines, achieving state-of-the-art results on several benchmarks.


title: Unsupervised Zero-Shot Reinforcement Learning via Functional Reward Encodings

abstract: Can we pre-train a generalist agent from a large amount of unlabeled offline trajectories such that it can be immediately adapted to any new downstream tasks in a zero-shot manner? In this work, we present a functional reward encoding (FRE) as a general, scalable solution to this zero-shot RL problem. Our main idea is to learn functional representations of any arbitrary tasks by encoding their state-reward samples using a transformer-based variational auto-encoder. This functional encoding not only enables the pre-training of an agent from a wide diversity of general unsupervised reward functions, but also provides a way to solve any new downstream tasks in a zero-shot manner, given a small number of reward-annotated samples. We empirically show that FRE agents trained on diverse random unsupervised reward functions can generalize to solve novel tasks in a range of simulated robotic benchmarks, often outperforming previous zero-shot RL and offline RL methods. Code for this project is provided at: https://github.com/kvfrans/fre


title: Estimation of electric field in intermediate-energy heavy-ion collisions

abstract: We estimate the spacetime profile of the electric field in head-on heavy-ion collisions at intermediate collision energies $\sqrt{s_{\rm NN}} = {\mathcal O}(3 \;-\; 10\;{\rm GeV})$. Using a hadronic cascade model (JAM; Jet AA Microscopic transport model), we numerically demonstrate that the produced field has strength $eE = {\mathcal O}((30 \;-\; 60\;{\rm MeV})^2)$, which is supercritical to the Schwinger limit of QED and is non-negligibly large compared even to the hadron/QCD scale, and survives for a long time $\tau = {\mathcal O}(10\;{\rm fm}/c)$ due to the baryon stopping. We show that the produced field is nonperturbatively strong in the sense that the nonperturbativity parameters (e.g., the Keldysh parameter) are sufficiently large. This is in contrast to high-energy collisions $\sqrt{s_{\rm NN}} \gtrsim 100 \;{\rm GeV}$, where the field is extremely short-lived and hence is perturbative. Our results imply that the electromagnetic field may have phenomenological impacts on hadronic/QCD processes in intermediate-energy heavy-ion collisions and that heavy-ion collisions can be used as a new tool to explore strong-field physics in the nonperturbative regime.


title: Nowhere dense Ramsey sets

abstract: A set of points $S$ in Euclidean space $\mathbb{R}^d$ is called \textit{Ramsey} if any finite partition of $\mathbb{R}^{\infty}$ yields a monochromatic copy of $S$. While characterization of Ramsey set remains a major open problem in the area, a stronger ``density'' concept was considered in [J. Amer. Math. Soc. 3, 1--7, 1990]: If $S$ is a $d$-dimensional simplex, then for any $\mu>0$ there is an integer $d:=d(S,\mu)$ and finite configuration $X\subseteq \mathbb{R}^d$ such that any subconfiguration $Y\subseteq X$ with $|Y|\geq \mu |X|$ contains a copy of $S$. Complementing this, here we show the existence of $\mu:=\mu(S)$ and of an infinite configuration $X\subseteq \mathbb{R}^{\infty}$ with the property that any finite coloring of $X$ yields a monochromatic copy of $S$, yet for any finite set of points $Y\subseteq X$ contains a subset $Z\subseteq Y$ of size $|Z|\geq \mu |Y|$ without a copy of $S$.


title: Integrated Interpolation and Block-term Tensor Decomposition for Spectrum Map Construction

abstract: This paper addresses the challenge of reconstructing a 3D power spectrum map from sparse, scattered, and incomplete spectrum measurements. It proposes an integrated approach combining interpolation and block-term tensor decomposition (BTD). This approach leverages an interpolation model with the BTD structure to exploit the spatial correlation of power spectrum maps. Additionally, nuclear norm regularization is incorporated to effectively capture the low-rank characteristics. To implement this approach, a novel algorithm that combines alternating regression with singular value thresholding is developed. Analytical justification for the enhancement provided by the BTD structure in interpolating power spectrum maps is provided, yielding several important theoretical insights. The analysis explores the impact of the spectrum on the error in the proposed method and compares it to conventional local polynomial interpolation. Extensive numerical results demonstrate that the proposed method outperforms state-of-the-art methods in terms of signal source separation and power spectrum map construction, and remains stable under off-grid measurements and inhomogeneous measurement topologies.


title: Video as the New Language for Real-World Decision Making

abstract: Both text and video data are abundant on the internet and support large-scale self-supervised learning through next token or frame prediction. However, they have not been equally leveraged: language models have had significant real-world impact, whereas video generation has remained largely limited to media entertainment. Yet video data captures important information about the physical world that is difficult to express in language. To address this gap, we discuss an under-appreciated opportunity to extend video generation to solve tasks in the real world. We observe how, akin to language, video can serve as a unified interface that can absorb internet knowledge and represent diverse tasks. Moreover, we demonstrate how, like language models, video generation can serve as planners, agents, compute engines, and environment simulators through techniques such as in-context learning, planning and reinforcement learning. We identify major impact opportunities in domains such as robotics, self-driving, and science, supported by recent work that demonstrates how such advanced capabilities in video generation are plausibly within reach. Lastly, we identify key challenges in video generation that mitigate progress. Addressing these challenges will enable video generation models to demonstrate unique value alongside language models in a wider array of AI applications.


title: Direct Detection of Dark Photon Dark Matter with the James Webb Space Telescope

abstract: In this study, we propose an investigation into dark photon dark matter (DPDM) within the infrared frequency band, utilizing highly sensitive infrared light detectors commonly integrated into space telescopes, such as the James Webb Space Telescope (JWST). The presence of DPDM induces electron oscillations in the reflector of these detectors. Consequently, these oscillating electrons can emit monochromatic electromagnetic waves with a frequency almost equivalent to the mass of DPDM. By employing the stationary phase approximation, we can demonstrate that when the size of the reflector significantly exceeds the wavelength of the electromagnetic wave, the contribution to the electromagnetic wave field at a given position primarily stems from the surface unit perpendicular to the relative position vector. This simplification results in the reduction of electromagnetic wave calculations to ray optics. By applying this concept to JWST, our analysis of observational data demonstrates the potential to establish constraints on the kinetic mixing between the photon and dark photon within the range [10, 500] THz. Despite JWST not being optimized for DPDM searches, our findings reveal constraints comparable to those obtained from the XENON1T experiment in the laboratory, as well as astrophysical constraints from solar emission. Additionally, we explore strategies to optimize future experiments specifically designed for DPDM searches.


title: Group Action Approaches in Erdos Quotient Set Problem

abstract: Let $\mathbb{F}_q$ denote the finite field of $q$ elements. For $E \subset \mathbb{F}_q^d$, denote the distance set $\Delta(E)= \{\|x-y\|^2:=(x_1-y_1)^2+ \cdots + (x_d-y_d)^2 : (x,y)\in E^2 \}$. The Erdos quotient set problem was introduced in \cite{Iosevich_2019} where it was shown that for even $d\geq2$ that if $|E| \subset \mathbb{F}_q^2$ such that $|E| >> q^{d/2}$, then $\frac{\Delta(E)}{\Delta(E)}:= \{\frac{s}{t}:s,t \in \Delta(E), t\not=0\} =\mathbb{F}_q^d$. The proof of the latter result is quite sophisticated and in \cite{pham2023group}, a simple proof using a group-action approach was obtained for the case of $q \equiv 3 \mod 4$ when $d=2$. In the $q \equiv 3 \mod 4$ setting, for each $r \in (\mathbb{F}_q)^2$, \cite{pham2023group} showed if $E \subset \mathbb{F}_q$, then $V(r):= \# \left\{ (a,b,c,d) \in E^2: \frac{\|a-b\|^2}{\|c-d\|^2} = r \right\} >> \frac{|E|^4}{q}$. In this work we use group action techniques in the $q \equiv 3 \mod 4$ setting, for $d=2$ and improve the results of \cite{pham2023group} by removing the assumption on $r \in (\mathbb{F}_q)^2$. Specifically we show if $d=2$ and $q \equiv 3 \mod 4$, then for each $r \in \mathbb{F}_q^*$,$V(r)\geq \frac{|E|^4}{2q}$if $|E|\geq \sqrt{2}q$ for all $r \in \mathbb{F}_q$. Finally, we improve the main result of \cite{bhowmik2023near} using our proof techniques from our quotient set results.


title: Distributions of Posterior Quantiles via Matching

abstract: We offer a simple analysis of the problem of choosing a statistical experiment to optimize the induced distribution of posterior medians, or more generally $q$-quantiles for any $q \in (0,1)$. We show that all implementable distributions of the posterior $q$-quantile are implemented by a single experiment, the $q$-quantile matching experiment, which pools pairs of states across the $q$-quantile of the prior in a positively assortative manner, with weight $q$ on the lower state in each pair. A dense subset of implementable distributions of posterior $q$-quantiles can be uniquely implemented by perturbing the $q$-quantile matching experiment. A linear functional is optimized over distributions of posterior $q$-quantiles by taking the optimal selection from each set of $q$-quantiles induced by the $q$-quantile matching experiment. The $q$-quantile matching experiment is the only experiment that simultaneously implements all implementable distributions of the posterior $q$-quantile.


title: Energy-Efficient Scheduling with Predictions

abstract: An important goal of modern scheduling systems is to efficiently manage power usage. In energy-efficient scheduling, the operating system controls the speed at which a machine is processing jobs with the dual objective of minimizing energy consumption and optimizing the quality of service cost of the resulting schedule. Since machine-learned predictions about future requests can often be learned from historical data, a recent line of work on learning-augmented algorithms aims to achieve improved performance guarantees by leveraging predictions. In particular, for energy-efficient scheduling, Bamas et. al. [BamasMRS20] and Antoniadis et. al. [antoniadis2021novel] designed algorithms with predictions for the energy minimization with deadlines problem and achieved an improved competitive ratio when the prediction error is small while also maintaining worst-case bounds even when the prediction error is arbitrarily large. In this paper, we consider a general setting for energy-efficient scheduling and provide a flexible learning-augmented algorithmic framework that takes as input an offline and an online algorithm for the desired energy-efficient scheduling problem. We show that, when the prediction error is small, this framework gives improved competitive ratios for many different energy-efficient scheduling problems, including energy minimization with deadlines, while also maintaining a bounded competitive ratio regardless of the prediction error. Finally, we empirically demonstrate that this framework achieves an improved performance on real and synthetic datasets.


title: Metasql: A Generate-then-Rank Framework for Natural Language to SQL Translation

abstract: The Natural Language Interface to Databases (NLIDB) empowers non-technical users with database access through intuitive natural language (NL) interactions. Advanced approaches, utilizing neural sequence-to-sequence models or large-scale language models, typically employ auto-regressive decoding to generate unique SQL queries sequentially. While these translation models have greatly improved the overall translation accuracy, surpassing 70% on NLIDB benchmarks, the use of auto-regressive decoding to generate single SQL queries may result in sub-optimal outputs, potentially leading to erroneous translations. In this paper, we propose Metasql, a unified generate-then-rank framework that can be flexibly incorporated with existing NLIDBs to consistently improve their translation accuracy. Metasql introduces query metadata to control the generation of better SQL query candidates and uses learning-to-rank algorithms to retrieve globally optimized queries. Specifically, Metasql first breaks down the meaning of the given NL query into a set of possible query metadata, representing the basic concepts of the semantics. These metadata are then used as language constraints to steer the underlying translation model toward generating a set of candidate SQL queries. Finally, Metasql ranks the candidates to identify the best matching one for the given NL query. Extensive experiments are performed to study Metasql on two public NLIDB benchmarks. The results show that the performance of the translation models can be effectively improved using Metasql.


title: The endomorphism rings of permutation modules of $\frac{3}{2}$-transitive permutation groups

abstract: Recent classification of $\frac{3}{2}$-transitive permutation groups leaves us with six families of groups which are $2$-transitive, or Frobenius, or one-dimensional affine, or the affine solvable subgroups of $ \mathrm{AGL}(2, q)$, or special projective linear group $\mathrm{PSL}(2, q)$, or $\mathrm{P\Gamma L}(2, q)$, where $q=2^p $ with $p$ prime. According to a case by case analysis, we prove that the endomorphism ring of the natural permutation module for a $\frac{3}{2}$-transitive permutation group is a symmetric algebra.


title: Target Speaker Extraction by Directly Exploiting Contextual Information in the Time-Frequency Domain

abstract: In target speaker extraction, many studies rely on the speaker embedding which is obtained from an enrollment of the target speaker and employed as the guidance. However, solely using speaker embedding may not fully utilize the contextual information contained in the enrollment. In this paper, we directly exploit this contextual information in the time-frequency (T-F) domain. Specifically, the T-F representations of the enrollment and the mixed signal are interacted to compute the weighting matrices through an attention mechanism. These weighting matrices reflect the similarity among different frames of the T-F representations and are further employed to obtain the consistent T-F representations of the enrollment. These consistent representations are served as the guidance, allowing for better exploitation of the contextual information. Furthermore, the proposed method achieves the state-of-the-art performance on the benchmark dataset and shows its effectiveness in the complex scenarios.


title: On the significance of radiative corrections on measurements of the EMC effect

abstract: Analyzing global data on the EMC effect, which denotes differences in parton distribution functions in nuclei compared to unbound nucleons, reveals tensions. Precise measurements at Jefferson Lab, studying both x and A dependence, show systematic discrepancies among experiments, making the extraction of the A dependence of the EMC effect sensitive to the selection of datasets. By comparing various methods and assumptions used to calculate radiative corrections, we have identified differences that, while not large, significantly impact the EMC ratios and show that using a consistent radiative correction procedure resolves this discrepancy, leading to a more coherent global picture, and allowing for a more robust extraction of the EMC effect for infinite nuclear matter.


title: Time series generation for option pricing on quantum computers using tensor network

abstract: Finance, especially option pricing, is a promising industrial field that might benefit from quantum computing. While quantum algorithms for option pricing have been proposed, it is desired to devise more efficient implementations of costly operations in the algorithms, one of which is preparing a quantum state that encodes a probability distribution of the underlying asset price. In particular, in pricing a path-dependent option, we need to generate a state encoding a joint distribution of the underlying asset price at multiple time points, which is more demanding. To address these issues, we propose a novel approach using Matrix Product State (MPS) as a generative model for time series generation. To validate our approach, taking the Heston model as a target, we conduct numerical experiments to generate time series in the model. Our findings demonstrate the capability of the MPS model to generate paths in the Heston model, highlighting its potential for path-dependent option pricing on quantum computers.


title: Spatial Distribution of Inertial Particles in Turbulent Taylor-Couette Flow

abstract: This study investigates the spatial distribution of inertial particles in turbulent Taylor-Couette flow. Direct numerical simulations are performed using a one-way coupled Eulerian-Lagrangian approach, with a fixed inner wall Reynolds number of 2500 for the carrier flow, while the particle Stokes number varies from 0.034 to 1 for the dispersed phase. We first examine the issue of preferential concentration of particles near the outer wall region. Employing two-dimensional (2D) Voronoi analysis, we observe a pronounced particle clustering with increasing $St$, particularly evident in regions of low fluid velocity. Additionally, we investigate the concentration balance equation, inspired by the work of johnson et al.(2020), to examine particle radial distribution. We discern the predominant sources of influence, namely biased sampling, turbophoresis, and centrifugal effects. Across all cases, centrifugal force emerges as the primary driver, causing particle migration towards the outer wall. Biased sampling predominantly affects smaller inertial particles, driving them towards the inner wall due to sampling within Taylor rolls with inward radial velocity. Conversely, turbophoresis primarily impacts larger inertial particles, inducing migration towards both walls where turbulent intensity is weaker compared to the bulk. With the revealed physics, our work provides a basis for predicting and controlling particle movement and distribution in industrial applications.


title: All actions of LERF groups on sets are sofic

abstract: In [GKEP24], a notion of sofic actions on sets, heavily inspired by [HS18], was introduced and applications to proving soficity of generalized wreath products were presented. In it, two classes of groups were shown to have all their actions being sofic, namely amenable groups and free groups. In this paper, we shall identify a new large class of groups, containing free groups and surface groups, such that any action by any such group is sofic.


title: Clustering Document Parts: Detecting and Characterizing Influence Campaigns from Documents

abstract: We propose a novel clustering pipeline to detect and characterize influence campaigns from documents. This approach clusters parts of document, detects clusters that likely reflect an influence campaign, and then identifies documents linked to an influence campaign via their association with the high-influence clusters. Our approach outperforms both the direct document-level classification and the direct document-level clustering approach in predicting if a document is part of an influence campaign. We propose various novel techniques to enhance our pipeline, including using an existing event factuality prediction system to obtain document parts, and aggregating multiple clustering experiments to improve the performance of both cluster and document classification. Classifying documents after clustering not only accurately extracts the parts of the documents that are relevant to influence campaigns, but also captures influence campaigns as a coordinated and holistic phenomenon. Our approach makes possible more fine-grained and interpretable characterizations of influence campaigns from documents.


title: Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations

abstract: Large-scale recommendation systems are characterized by their reliance on high cardinality, heterogeneous features and the need to handle tens of billions of user actions on a daily basis. Despite being trained on huge volume of data with thousands of features, most Deep Learning Recommendation Models (DLRMs) in industry fail to scale with compute. Inspired by success achieved by Transformers in language and vision domains, we revisit fundamental design choices in recommendation systems. We reformulate recommendation problems as sequential transduction tasks within a generative modeling framework ("Generative Recommenders"), and propose a new architecture, HSTU, designed for high cardinality, non-stationary streaming recommendation data. HSTU outperforms baselines over synthetic and public datasets by up to 65.8% in NDCG, and is 5.3x to 15.2x faster than FlashAttention2-based Transformers on 8192 length sequences. HSTU-based Generative Recommenders, with 1.5 trillion parameters, improve metrics in online A/B tests by 12.4% and have been deployed on multiple surfaces of a large internet platform with billions of users. More importantly, the model quality of Generative Recommenders empirically scales as a power-law of training compute across three orders of magnitude, up to GPT-3/LLaMa-2 scale, which reduces carbon footprint needed for future model developments, and further paves the way for the first foundational models in recommendations.


title: Exact and efficient phylodynamic simulation from arbitrarily large populations

abstract: Many biological studies involve inferring the genealogical history of a sample of individuals from a large population and interpreting the reconstructed tree. Such an ascertained tree typically represents only a small part of a comprehensive population tree and is distorted by survivorship and sampling biases. Inferring evolutionary parameters from ascertained trees requires modeling both the underlying population dynamics and the ascertainment process. A crucial component of this phylodynamic modeling involves tree simulation, which is used to benchmark probabilistic inference methods. To simulate an ascertained tree, one must first simulate the full population tree and then prune unobserved lineages. Consequently, the computational cost is determined not by the size of the final simulated tree, but by the size of the population tree in which it is embedded. In most biological scenarios, simulations of the entire population are prohibitively expensive due to computational demands placed on lineages without sampled descendants. Here, we address this challenge by proving that, for any partially ascertained process from a general multi-type birth-death-mutation-sampling (BDMS) model, there exists an equivalent pure birth process (i.e., no death) with mutation and complete sampling. The final trees generated under these processes have exactly the same distribution. Leveraging this property, we propose a highly efficient algorithm for simulating trees under a general BDMS model. Our algorithm scales linearly with the size of the final simulated tree and is independent of the population size, enabling simulations from extremely large populations beyond the reach of current methods but essential for various biological applications. We anticipate that this unprecedented speedup will significantly advance the development of novel inference methods that require extensive training data.


title: Existence for the Supercooled Stefan Problem in General Dimensions

abstract: We prove the global-time existence of weak solutions to the supercooled Stefan problem. Our result holds in general space dimensions and with a general class of initial data. In addition, our solution is maximal in the sense of a certain stochastic order, among all comparable weak solutions starting from the same initial data. Our approach is based on a free target optimization problem for Brownian stopping times, where the main idea is to introduce a superharmonic cost function in the optimization problem. We will show that our choice of the cost function causes the target measure to accumulate near the prescribed domain boundary as much as possible. A central ingredient in our proof lies in the usage of dual problem: we prove the dual attainment and use the dual optimal solution to characterize the primal optimal solution. It follows in turn that the underlying particle dynamics yields a solution to the supercooled Stefan problem.


title: Acceptor-induced bulk dielectric loss in superconducting circuits on silicon

abstract: The performance of superconducting quantum circuits is primarily limited by dielectric loss due to interactions with two-level systems (TLS). State-of-the-art circuits with engineered material interfaces are approaching a limit where dielectric loss from bulk substrates plays an important role. However, a microscopic understanding of dielectric loss in crystalline substrates is still lacking. In this work, we show that boron acceptors in silicon constitute a strongly coupled TLS bath for superconducting circuits. We discuss how the electronic structure of boron acceptors leads to an effective TLS response in silicon. We sweep the boron concentration in silicon and demonstrate the bulk dielectric loss limit from boron acceptors. We show that boron-induced dielectric loss can be reduced in a magnetic field due to the spin-orbit structure of boron. This work provides the first detailed microscopic description of a TLS bath for superconducting circuits, and demonstrates the need for ultrahigh purity substrates for next-generation superconducting quantum processors.


title: TaxDiff: Taxonomic-Guided Diffusion Model for Protein Sequence Generation

abstract: Designing protein sequences with specific biological functions and structural stability is crucial in biology and chemistry. Generative models already demonstrated their capabilities for reliable protein design. However, previous models are limited to the unconditional generation of protein sequences and lack the controllable generation ability that is vital to biological tasks. In this work, we propose TaxDiff, a taxonomic-guided diffusion model for controllable protein sequence generation that combines biological species information with the generative capabilities of diffusion models to generate structurally stable proteins within the sequence space. Specifically, taxonomic control information is inserted into each layer of the transformer block to achieve fine-grained control. The combination of global and local attention ensures the sequence consistency and structural foldability of taxonomic-specific proteins. Extensive experiments demonstrate that TaxDiff can consistently achieve better performance on multiple protein sequence generation benchmarks in both taxonomic-guided controllable generation and unconditional generation. Remarkably, the sequences generated by TaxDiff even surpass those produced by direct-structure-generation models in terms of confidence based on predicted structures and require only a quarter of the time of models based on the diffusion model. The code for generating proteins and training new versions of TaxDiff is available at:https://github.com/Linzy19/TaxDiff.


title: Generative Learning for Forecasting the Dynamics of Complex Systems

abstract: We introduce generative models for accelerating simulations of complex systems through learning and evolving their effective dynamics. In the proposed Generative Learning of Effective Dynamics (G-LED), instances of high dimensional data are down sampled to a lower dimensional manifold that is evolved through an auto-regressive attention mechanism. In turn, Bayesian diffusion models, that map this low-dimensional manifold onto its corresponding high-dimensional space, capture the statistics of the system dynamics. We demonstrate the capabilities and drawbacks of G-LED in simulations of several benchmark systems, including the Kuramoto-Sivashinsky (KS) equation, two-dimensional high Reynolds number flow over a backward-facing step, and simulations of three-dimensional turbulent channel flow. The results demonstrate that generative learning offers new frontiers for the accurate forecasting of the statistical properties of complex systems at a reduced computational cost.

categories: cs.LG physics.comp-ph physics.flu-dyn stat.ML


title: A Szemer\'edi type theorem for sets of positive density in approximate lattices

abstract: An extension of Szemer\'edi's Theorem is proved for sets of positive density in cut-and-project sets in general locally compact and second countable abelian groups. As a consequence, we establish a recent conjecture of Klick, Strungaru and Tcaciuc. Furthermore, we show a Szemeredi type theorem for sets of positive density in the set of fractional parts of $\mathbb{Q}_p$. Via a novel version of Furstenberg's Correspondence principle, which should be of independent interest, we show that our Szemer\'edi Theorems can be deduced from a general \emph{transverse} multiple recurrence theorem, which we establish using recent works of Austin.


title: NocPlace: Nocturnal Visual Place Recognition via Generative and Inherited Knowledge Transfer

abstract: Visual Place Recognition (VPR) is crucial in computer vision, aiming to retrieve database images similar to a query image from an extensive collection of known images. However, like many vision tasks, VPR always degrades at night due to the scarcity of nighttime images. Moreover, VPR needs to address the cross-domain problem of night-to-day rather than just the issue of a single nighttime domain. In response to these issues, we present NocPlace, which leverages generative and inherited knowledge transfer to embed resilience against dazzling lights and extreme darkness in the global descriptor. First, we establish a day-night urban scene dataset called NightCities, capturing diverse lighting variations and dark scenarios across 60 cities globally. Then, an image generation network is trained on this dataset and processes a large-scale VPR dataset, obtaining its nighttime version. Finally, VPR models are fine-tuned using descriptors inherited from themselves and night-style images, which builds explicit cross-domain contrastive relationships. Comprehensive experiments on various datasets demonstrate our contributions and the superiority of NocPlace. Without adding any real-time computing resources, NocPlace improves the performance of Eigenplaces by 7.6% on Tokyo 24/7 Night and 16.8% on SVOX Night.


title: Choosing Behind the Veil: Tight Bounds for Identity-Blind Online Algorithms

abstract: In Bayesian online settings, every element has a value that is drawn from a known underlying distribution, which we refer to as the element's identity. The elements arrive sequentially. Upon the arrival of an element, its value is revealed, and the decision maker needs to decide, immediately and irrevocably, whether to accept it or not. While most previous work has assumed that the decision maker, upon observing the element's value, also becomes aware of its identity -- namely, its distribution -- practical scenarios frequently demand that decisions be made based solely on the element's value, without considering its identity. This necessity arises either from the algorithm's ignorance of the element's identity or due to the pursuit of fairness. We call such algorithms identity-blind algorithms, and propose the identity-blindness gap as a metric to evaluate the performance loss caused by identity-blindness. This gap is defined as the maximum ratio between the expected performance of an identity-blind online algorithm and an optimal online algorithm that knows the arrival order, thus also the identities. We study the identity-blindness gap in the paradigmatic prophet inequality problem, under the two objectives of maximizing the expected value, and maximizing the probability to obtain the highest value. For the max-expectation objective, the celebrated prophet inequality establishes a single-threshold algorithm that gives at least 1/2 of the offline optimum, thus also an identity-blindness gap of at least 1/2. We show that this bound is tight. For the max-probability objective, while the competitive ratio is tightly 1/e, we provide a deterministic single-threshold algorithm that gives an identity-blindness gap of $\sim 0.562$ under the assumption that there are no large point masses. Moreover, we show that this bound is tight with respect to deterministic algorithms.


title: Large Language Model for Participatory Urban Planning

abstract: Participatory urban planning is the mainstream of modern urban planning that involves the active engagement of residents. However, the traditional participatory paradigm requires experienced planning experts and is often time-consuming and costly. Fortunately, the emerging Large Language Models (LLMs) have shown considerable ability to simulate human-like agents, which can be used to emulate the participatory process easily. In this work, we introduce an LLM-based multi-agent collaboration framework for participatory urban planning, which can generate land-use plans for urban regions considering the diverse needs of residents. Specifically, we construct LLM agents to simulate a planner and thousands of residents with diverse profiles and backgrounds. We first ask the planner to carry out an initial land-use plan. To deal with the different facilities needs of residents, we initiate a discussion among the residents in each community about the plan, where residents provide feedback based on their profiles. Furthermore, to improve the efficiency of discussion, we adopt a fishbowl discussion mechanism, where part of the residents discuss and the rest of them act as listeners in each round. Finally, we let the planner modify the plan based on residents' feedback. We deploy our method on two real-world regions in Beijing. Experiments show that our method achieves state-of-the-art performance in residents satisfaction and inclusion metrics, and also outperforms human experts in terms of service accessibility and ecology metrics.


title: Gluon GTMDs at nonzero skewness and impact parameter dependent parton distributions

abstract: We investigate the leading twist generalized transverse momentum dependent parton distributions (GTMDs) of the unpolarized and longitudinally polarized gluons in the nucleon. We adopt a light-front gluon-triquark model for the nucleon motivated by soft-wall AdS/QCD. The gluon GTMDs are defined through the off-forward gluon-gluon generalized correlator and are expressed as the overlap of light-cone wave functions. The GTMDs can be employed to provide the generalized parton distributions (GPDs) by integrating out the transverse momentum. The Fourier transform of the GPDs encodes the parton distributions in the transverse position space, namely, the impact parameter dependent parton distributions (IPDs). We also calculate the three gluon IPDs corresponding to the GPDs $H^g$, $E^g$ and $\widetilde{H}^g$, and present their dependence on $x$ and $b_\perp$, respectively.


title: FORECASTOR -- II. Simulating Galaxy Surveys with the Cosmological Advanced Survey Telescope for Optical and UV Research

abstract: The Cosmological Advanced Survey Telescope for Optical and UV Research (CASTOR) is a planned flagship space telescope, covering the blue-optical and UV part of the spectrum. Here we introduce the CASTOR image simulator, a Python GalSim package-based script capable of generating mock CASTOR images from an input catalogue. We generate example images from the CASTOR Wide, Deep, and Ultra-Deep surveys using simulated light-cones from the Santa Cruz Semi-Analytic Model. We make predictions for the performance of these surveys by comparing galaxies that are extracted from each image using Source Extractor to the input catalogue. We find that the Wide, Deep, and Ultra-Deep surveys will be complete to ~27, 29 and 30 mag, respectively, in the UV, u, and g filters, with the UV-split and u-split filters reaching a shallower depth. With a large area of ~2200 deg$^2$, the Wide survey will detect hundreds of millions of galaxies out to z~4, mostly with $M_\ast \gtrsim 10^9 M_\odot$. The Ultra-Deep survey will probe to z~5, detecting a large fraction of $M_\ast \simeq 10^8 M_\odot$ galaxies. These powerful samples will enable precision measurements of the distribution of star formation in the cosmic web, connecting the growth of stellar mass to the assembly of dark matter halos over two thirds of the history of the Universe, and other core goals of CASTOR's legacy surveys. These image simulations and the tools developed to generate them will be a vital planning tool to estimate CASTOR's performance and iterate the telescope and survey designs prior to launch.


title: Withdrawal Success Optimization in a Pooled Annuity Fund

abstract: Consider a closed pooled annuity fund investing in n assets with discrete-time rebalancing. At time 0, each annuitant makes an initial contribution to the fund, committing to a predetermined schedule of withdrawals. Require annuitants to be homogeneous in the sense that their initial contributions and predetermined withdrawal schedules are identical, and their mortality distributions are identical and independent. Under the forementioned setup, the probability for a particular annuitant to complete the prescribed withdrawals until death is maximized over progressively measurable portfolio weight functions. Applications consider fund portfolios that mix two assets: the S&P Composite Index and an inflation-protected bond. The maximum probability is computed for annually rebalanced schedules consisting of an initial investment and then equal annual withdrawals until death. A considerable increase in the maximum probability is achieved by increasing the number of annuitants initially in the pool. For example, when the per-annuitant initial contribution and annual withdrawal amount are held constant, starting with 20 annuitants instead of just 1 can increase the maximum probability (measured on a scale from 0 to 1) by as much as .15.


title: Few-shot adaptation for morphology-independent cell instance segmentation

abstract: Microscopy data collections are becoming larger and more frequent. Accurate and precise quantitative analysis tools like cell instance segmentation are necessary to benefit from them. This is challenging due to the variability in the data, which requires retraining the segmentation model to maintain high accuracy on new collections. This is needed especially for segmenting cells with elongated and non-convex morphology like bacteria. We propose to reduce the amount of annotation and computing power needed for retraining the model by introducing a few-shot domain adaptation approach that requires annotating only one to five cells of the new data to process and that quickly adapts the model to maintain high accuracy. Our results show a significant boost in accuracy after adaptation to very challenging bacteria datasets.


title: Layer Coherence Origin of Intrinsic Planar Hall Effect in 2D Limit

abstract: The intrinsic planar Hall effect has attracted intensive interest inspired by recent experiments. Existing theories of this effect require three dimensional orbital motion, or strong spin-orbit coupling of certain forms, which do not exist in van der Waals thin films. Here, we uncover a new origin of the planar Hall effect - as an intrinsic property of layer coherent electrons - that allows its presence even in bilayer and trilayer atomically thin limit. As examples, we show that the effect can be triggered by strain and interlayer sliding respectively in twisted bilayer graphene and trilayer transition metal dichalcogenides, where the effect features rich tunability and even stronger magnitude than those induced by topological nodal structures in bulk materials. The layer mechanism also provides a new route towards quantized Hall response upon a topological phase transition induced by in-plane magnetic field. These results unveil the unexplored potential of quantum layertronics and moir\'e flat band for planar Hall transport.


title: Converse Barrier Certificates for Finite-time Safety Verification of Continuous-time Perturbed Deterministic Systems

abstract: In this paper, we investigate the problem of verifying the finite-time safety of continuous-time perturbed deterministic systems represented by ordinary differential equations in the presence of measurable disturbances. Given a finite time horizon, if the system is safe, it, starting from a compact initial set, will remain within an open and bounded safe region throughout the specified time horizon, regardless of the disturbances. The main contribution of this work is to uncover that there exists a time-dependent barrier certificate if and only if the system is safe. This barrier certificate satisfies the following conditions: negativity over the initial set at the initial time instant, non-negativity over the boundary of the safe set, and non-increasing behavior along the system dynamics over the specified finite time horizon. The existence problem is explored using a Hamilton-Jacobi differential equation, which has a unique Lipschitz viscosity solution.


title: Benchmarking Data Science Agents

abstract: In the era of data-driven decision-making, the complexity of data analysis necessitates advanced expertise and tools of data science, presenting significant challenges even for specialists. Large Language Models (LLMs) have emerged as promising aids as data science agents, assisting humans in data analysis and processing. Yet their practical efficacy remains constrained by the varied demands of real-world applications and complicated analytical process. In this paper, we introduce DSEval -- a novel evaluation paradigm, as well as a series of innovative benchmarks tailored for assessing the performance of these agents throughout the entire data science lifecycle. Incorporating a novel bootstrapped annotation method, we streamline dataset preparation, improve the evaluation coverage, and expand benchmarking comprehensiveness. Our findings uncover prevalent obstacles and provide critical insights to inform future advancements in the field.


title: Deep Umbra: A Generative Approach for Sunlight Access Computation in Urban Spaces

abstract: Sunlight and shadow play critical roles in how urban spaces are utilized, thrive, and grow. While access to sunlight is essential to the success of urban environments, shadows can provide shaded places to stay during the hot seasons, mitigate heat island effect, and increase pedestrian comfort levels. Properly quantifying sunlight access and shadows in large urban environments is key in tackling some of the important challenges facing cities today. In this paper, we propose Deep Umbra, a novel computational framework that enables the quantification of sunlight access and shadows at a global scale. Our framework is based on a conditional generative adversarial network that considers the physical form of cities to compute high-resolution spatial information of accumulated sunlight access for the different seasons of the year. We use data from seven different cities to train our model, and show, through an extensive set of experiments, its low overall RMSE (below 0.1) as well as its extensibility to cities that were not part of the training set. Additionally, we contribute a set of case studies and a comprehensive dataset with sunlight access information for more than 100 cities across six continents of the world. Deep Umbra is available at https://urbantk.org/shadows.


title: Distributed Sequential Quadratic Programming with Overlapping Graph Decomposition and Exact Augmented Lagrangian

abstract: In this paper, we address the challenge of solving large-scale graph-structured nonlinear programs (gsNLPs) in a scalable manner. GsNLPs are problems in which the objective and constraint functions are associated with nodes on a graph and depend on the variables of adjacent nodes. This graph-structured formulation encompasses various specific instances, such as dynamic optimization, PDE-constrained optimization, multistage stochastic optimization, and general network optimization. By leveraging the sequential quadratic programming (SQP) framework, we propose a globally convergent overlapping graph decomposition method to solve large-scale gsNLPs under standard mild regularity conditions on the graph topology. In each iteration, we perform an overlapping graph decomposition to compute an approximate Newton direction in a parallel environment. Then, we select a suitable stepsize and update the primal-dual iterate by performing a backtracking line search on an exact augmented Lagrangian merit function. Built on the exponential decay of sensitivity of gsNLPs, we show that the approximate Newton direction is a descent direction of the augmented Lagrangian, which leads to global convergence with a local linear convergence rate. In particular, global convergence is achieved for sufficiently large overlaps, and the local linear convergence rate improves exponentially in terms of the overlap size. Our results match existing state-of-the-art guarantees established for dynamic programs (which simply correspond to linear graphs). We validate the theory on a semilinear elliptic PDE-constrained problem.


title: LiveHPS: LiDAR-based Scene-level Human Pose and Shape Estimation in Free Environment

abstract: For human-centric large-scale scenes, fine-grained modeling for 3D human global pose and shape is significant for scene understanding and can benefit many real-world applications. In this paper, we present LiveHPS, a novel single-LiDAR-based approach for scene-level human pose and shape estimation without any limitation of light conditions and wearable devices. In particular, we design a distillation mechanism to mitigate the distribution-varying effect of LiDAR point clouds and exploit the temporal-spatial geometric and dynamic information existing in consecutive frames to solve the occlusion and noise disturbance. LiveHPS, with its efficient configuration and high-quality output, is well-suited for real-world applications. Moreover, we propose a huge human motion dataset, named FreeMotion, which is collected in various scenarios with diverse human poses, shapes and translations. It consists of multi-modal and multi-view acquisition data from calibrated and synchronized LiDARs, cameras, and IMUs. Extensive experiments on our new dataset and other public datasets demonstrate the SOTA performance and robustness of our approach. We will release our code and dataset soon.


title: Lane2Seq: Towards Unified Lane Detection via Sequence Generation

abstract: In this paper, we present a novel sequence generation-based framework for lane detection, called Lane2Seq. It unifies various lane detection formats by casting lane detection as a sequence generation task. This is different from previous lane detection methods, which depend on well-designed task-specific head networks and corresponding loss functions. Lane2Seq only adopts a plain transformer-based encoder-decoder architecture with a simple cross-entropy loss. Additionally, we propose a new multi-format model tuning based on reinforcement learning to incorporate the task-specific knowledge into Lane2Seq. Experimental results demonstrate that such a simple sequence generation paradigm not only unifies lane detection but also achieves competitive performance on benchmarks. For example, Lane2Seq gets 97.95\% and 97.42\% F1 score on Tusimple and LLAMAS datasets, establishing a new state-of-the-art result for two benchmarks.


title: Weighted EF1 and PO Allocations with Few Types of Agents or Chores

abstract: We investigate the existence of fair and efficient allocations of indivisible chores to asymmetric agents who have unequal entitlements or weights. We consider the fairness notion of weighted envy-freeness up to one chore (wEF1) and the efficiency notion of Pareto-optimality (PO). The existence of EF1 and PO allocations of chores to symmetric agents is a major open problem in discrete fair division, and positive results are known only for certain structured instances. In this paper, we study this problem for a more general setting of asymmetric agents and show that an allocation that is wEF1 and PO exists and can be computed in polynomial time for instances with: - Three types of agents, where agents with the same type have identical preferences but can have different weights. - Two types of chores, where the chores can be partitioned into two sets, each containing copies of the same chore. For symmetric agents, our results establish that EF1 and PO allocations exist for three types of agents and also generalize known results for three agents, two types of agents, and two types of chores. Our algorithms use a weighted picking sequence algorithm as a subroutine; we expect this idea and our analysis to be of independent interest.


title: On some special cases of Gaiotto's positivity conjecture

abstract: We prove a conjecture of D. Gaiotto on positivity of inner products arising in studying Landau-Ginzburg boundary conditions in the 1-dimensional case, and in special cases in higher dimensions, for 3d free hypermultiplets.


title: Assessment of Precision and Accuracy of Brain White Matter Microstructure using Combined Diffusion MRI and Relaxometry

abstract: Joint modeling of diffusion and relaxation has seen growing interest due to its potential to provide complementary information about tissue microstructure. For brain white matter, we designed an optimal diffusion-relaxometry MRI protocol that samples multiple b-values, B-tensor shapes, and echo times (TE). This variable-TE protocol (27 min) has as subsets a fixed-TE protocol (15 min) and a 2-shell dMRI protocol (7 min), both characterizing diffusion only. We assessed the sensitivity, specificity and reproducibility of these protocols with synthetic experiments and in six healthy volunteers. Compared with the fixed-TE protocol, the variable-TE protocol enables estimation of free water fractions while also capturing compartmental $T_2$ relaxation times. Jointly measuring diffusion and relaxation offers increased sensitivity and specificity to microstructure parameters in brain white matter with voxelwise coefficients of variation below 10%.


title: DeepDRK: Deep Dependency Regularized Knockoff for Feature Selection

abstract: Model-X knockoff, among various feature selection methods, received much attention recently due to its guarantee on false discovery rate (FDR) control. Subsequent to its introduction in parametric design, knockoff is advanced to handle arbitrary data distributions using deep learning-based generative modeling. However, we observed that current implementations of the deep Model-X knockoff framework exhibit limitations. Notably, the "swap property" that knockoffs necessitate frequently encounter challenges on sample level, leading to a diminished selection power. To overcome, we develop "Deep Dependency Regularized Knockoff (DeepDRK)", a distribution-free deep learning method that strikes a balance between FDR and power. In DeepDRK, a generative model grounded in a transformer architecture is introduced to better achieve the "swap property". Novel efficient regularization techniques are also proposed to reach higher power. Our model outperforms other benchmarks in synthetic, semi-synthetic, and real-world data, especially when sample size is small and data distribution is complex.


title: Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models

abstract: Sora is a text-to-video generative AI model, released by OpenAI in February 2024. The model is trained to generate videos of realistic or imaginative scenes from text instructions and show potential in simulating the physical world. Based on public technical reports and reverse engineering, this paper presents a comprehensive review of the model's background, related technologies, applications, remaining challenges, and future directions of text-to-video AI models. We first trace Sora's development and investigate the underlying technologies used to build this "world simulator". Then, we describe in detail the applications and potential impact of Sora in multiple industries ranging from film-making and education to marketing. We discuss the main challenges and limitations that need to be addressed to widely deploy Sora, such as ensuring safe and unbiased video generation. Lastly, we discuss the future development of Sora and video generation models in general, and how advancements in the field could enable new ways of human-AI interaction, boosting productivity and creativity of video generation.


title: NeuralSI: Neural Design of Semantic Interaction for Interactive Deep Learning

abstract: An increasing number of studies have utilized interactive deep learning as the analytic model of visual analytics systems for complex sensemaking tasks. In these systems, traditional interactive dimensionality reduction (DR) models are commonly utilized to build a bi-directional bridge between high-dimensional deep learning representations and low-dimensional visualizations. While these systems better capture analysts' intents in the context of human-in-the-loop interactive deep learning, traditional DR cannot support several desired properties for visual analytics, including out-of-sample extensions, stability, and real-time inference. To avoid this issue, we propose the neural design framework of semantic interaction for interactive deep learning. In our framework, we replace the traditional DR with a neural projection network and append it to the deep learning model as the task-specific output layer. Therefore, the analytic model (deep learning) and visualization method (interactive DR) form one integrated end-to-end trainable deep neural network. In order to understand the performance of the neural design in comparison to the state-of-the-art, we systematically performed two complementary studies, a human-centered qualitative case study and an algorithm-centered simulation-based quantitative experiment. The results of these studies indicate that the neural design can give semantic interaction systems substantial advantages while still keeping comparable inference ability compared to the state-of-the-art model.


title: Dual-Space Optimization: Improved Molecule Sequence Design by Latent Prompt Transformer

abstract: Designing molecules with desirable properties, such as drug-likeliness and high binding affinities towards protein targets, is a challenging problem. In this paper, we propose the Dual-Space Optimization (DSO) method that integrates latent space sampling and data space selection to solve this problem. DSO iteratively updates a latent space generative model and a synthetic dataset in an optimization process that gradually shifts the generative model and the synthetic data towards regions of desired property values. Our generative model takes the form of a Latent Prompt Transformer (LPT) where the latent vector serves as the prompt of a causal transformer. Our extensive experiments demonstrate effectiveness of the proposed method, which sets new performance benchmarks across single-objective, multi-objective and constrained molecule design tasks.


title: Performance analysis of MUSIC-type imaging without diagonal elements of multi-static response matrix

abstract: Generally, to apply the MUltiple SIgnal Classification (MUSIC) algorithm for the rapid imaging of small inhomogeneities, the complete elements of the multi-static response (MSR) matrix must be collected. However, in real-world applications such as microwave imaging or bistatic measurement configuration, diagonal elements of the MSR matrix are unknown. Nevertheless, it is possible to obtain imaging results using a traditional approach but theoretical reason of the applicability has not been investigated yet. In this paper, we establish mathematical structures of the imaging function of MUSIC from an MSR matrix without diagonal elements in both transverse magnetic (TM) and transverse electric (TE) polarizations. The established structures demonstrate why the shape of the location of small inhomogeneities can be retrieved via MUSIC without the diagonal elements of the MSR matrix. In addition, they reveal the intrinsic properties of imaging and the fundamental limitations. Results of numerical simulations are also provided to support the identified structures.


title: On the variety of X-states

abstract: We introduce the notion of an X-state on $n$-qubits. After taking the Zariski closure of the set of X-states in the space of all mixed states, we obtain a complex algebraic variety $\scr X$ that is equipped with the action of the Lie group of local symmetries $G$. We show that the field of $G$-invariant rational functions on $\scr X$ is purely transcendental over the complex numbers of degree $2^{2n-1}-n-1$.

categories: math-ph math.AG math.MP math.QA quant-ph


title: Methylation Operation Wizard (MeOW): Identification of differentially methylated regions in long-read sequencing data

abstract: Long-read sequencing (LRS) is able to simultaneously capture information about both DNA sequence and modifications, such as CpG methylation in a single sequencing experiment. Here we present Methylation Operation Wizard (MeOW), a program to identify and prioritize differentially methylated regions (DMRs) genome-wide using LRS data. MeOW can be run using either a file containing counts of per-nucleotide methylated CpG sites or with a bam file containing modified base tags.


title: QW-Search/Zeta Correspondence

abstract: We consider the connection between this zeta function and quantum search via quantum walk. First, we give an explicit expression of the zeta function on the one-dimensional torus in the general case of the number and position of marked vertices. Moreover, we deal with the two special cases of the position of the marked vertices on the $d$-dimensional torus $(d \ge 2)$. Additionally, we treat the property of the zeta function by using the Mahler measure. Our results show the relationship between the zeta function and quantum search algorithms for the first time.


title: Extreme Encoder Output Frame Rate Reduction: Improving Computational Latencies of Large End-to-End Models

abstract: The accuracy of end-to-end (E2E) automatic speech recognition (ASR) models continues to improve as they are scaled to larger sizes, with some now reaching billions of parameters. Widespread deployment and adoption of these models, however, requires computationally efficient strategies for decoding. In the present work, we study one such strategy: applying multiple frame reduction layers in the encoder to compress encoder outputs into a small number of output frames. While similar techniques have been investigated in previous work, we achieve dramatically more reduction than has previously been demonstrated through the use of multiple funnel reduction layers. Through ablations, we study the impact of various architectural choices in the encoder to identify the most effective strategies. We demonstrate that we can generate one encoder output frame for every 2.56 sec of input speech, without significantly affecting word error rate on a large-scale voice search task, while improving encoder and decoder latencies by 48% and 92% respectively, relative to a strong but computationally expensive baseline.


title: Inpainting Computational Fluid Dynamics with Deep Learning

abstract: Fluid data completion is a research problem with high potential benefit for both experimental and computational fluid dynamics. An effective fluid data completion method reduces the required number of sensors in a fluid dynamics experiment, and allows a coarser and more adaptive mesh for a Computational Fluid Dynamics (CFD) simulation. However, the ill-posed nature of the fluid data completion problem makes it prohibitively difficult to obtain a theoretical solution and presents high numerical uncertainty and instability for a data-driven approach (e.g., a neural network model). To address these challenges, we leverage recent advancements in computer vision, employing the vector quantization technique to map both complete and incomplete fluid data spaces onto discrete-valued lower-dimensional representations via a two-stage learning procedure. We demonstrated the effectiveness of our approach on Kolmogorov flow data (Reynolds number: 1000) occluded by masks of different size and arrangement. Experimental results show that our proposed model consistently outperforms benchmark models under different occlusion settings in terms of point-wise reconstruction accuracy as well as turbulent energy spectrum and vorticity distribution.


title: Design Rules for Interconnects Based on Graphene Nanoribbon Junctions

abstract: Graphene nanoribbons (GNRs) produced by means of bottom-up chemical self-assembly are considered promising candidates for the next-generation nanoelectronic devices. We address the electronic transport properties of angled two-terminal GNR junctions, which are inevitable in the interconnects in graphene-based integrated circuits. We construct a library of over 400000 distinct configurations of 60$^\circ$ and 120$^\circ$ junctions connecting armchair GNRs of different widths. Numerical calculations combining the tight-binding approximation and the Green's function formalism allow identifying numerous junctions with conductance close to the limit defined by the GNR leads. Further analysis reveals underlying structure-property relationships with crucial roles played by the bipartite symmetry of graphene lattice and the presence of resonant states localized at the junction. In particular, we discover and explain the phenomenon of binary conductance in 120$^\circ$ junctions connecting metallic GNR leads that guarantees maximum possible conductance. Overall, our study defines the guidelines for engineering GNR junctions with desired electrical properties.


title: PE-MVCNet: Multi-view and Cross-modal Fusion Network for Pulmonary Embolism Prediction

abstract: The early detection of a pulmonary embolism (PE) is critical for enhancing patient survival rates. Both image-based and non-image-based features are of utmost importance in medical classification tasks. In a clinical setting, physicians tend to rely on the contextual information provided by Electronic Medical Records (EMR) to interpret medical imaging. However, very few models effectively integrate clinical information with imaging data. To address this shortcoming, we suggest a multimodal fusion methodology, termed PE-MVCNet, which capitalizes on Computed Tomography Pulmonary Angiography imaging and EMR data. This method comprises the Image-only module with an integrated multi-view block, the EMR-only module, and the Cross-modal Attention Fusion (CMAF) module. These modules cooperate to extract comprehensive features that subsequently generate predictions for PE. We conducted experiments using the publicly accessible Stanford University Medical Center dataset, achieving an AUROC of 94.1%, an accuracy rate of 90.2%, and an F1 score of 90.6%. Our proposed model outperforms existing methodologies, corroborating that our multimodal fusion model excels compared to models that use a single data modality. Our source code is available at https://github.com/LeavingStarW/PE-MVCNET.


title: PromptMM: Multi-Modal Knowledge Distillation for Recommendation with Prompt-Tuning

abstract: Multimedia online platforms (e.g., Amazon, TikTok) have greatly benefited from the incorporation of multimedia (e.g., visual, textual, and acoustic) content into their personal recommender systems. These modalities provide intuitive semantics that facilitate modality-aware user preference modeling. However, two key challenges in multi-modal recommenders remain unresolved: i) The introduction of multi-modal encoders with a large number of additional parameters causes overfitting, given high-dimensional multi-modal features provided by extractors (e.g., ViT, BERT). ii) Side information inevitably introduces inaccuracies and redundancies, which skew the modality-interaction dependency from reflecting true user preference. To tackle these problems, we propose to simplify and empower recommenders through Multi-modal Knowledge Distillation (PromptMM) with the prompt-tuning that enables adaptive quality distillation. Specifically, PromptMM conducts model compression through distilling u-i edge relationship and multi-modal node content from cumbersome teachers to relieve students from the additional feature reduction parameters. To bridge the semantic gap between multi-modal context and collaborative signals for empowering the overfitting teacher, soft prompt-tuning is introduced to perform student task-adaptive. Additionally, to adjust the impact of inaccuracies in multimedia data, a disentangled multi-modal list-wise distillation is developed with modality-aware re-weighting mechanism. Experiments on real-world data demonstrate PromptMM's superiority over existing techniques. Ablation tests confirm the effectiveness of key components. Additional tests show the efficiency and effectiveness.


title: An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglement

abstract: With the massive developments of end-to-end (E2E) neural networks, recent years have witnessed unprecedented breakthroughs in automatic speech recognition (ASR). However, the codeswitching phenomenon remains a major obstacle that hinders ASR from perfection, as the lack of labeled data and the variations between languages often lead to degradation of ASR performance. In this paper, we focus exclusively on improving the acoustic encoder of E2E ASR to tackle the challenge caused by the codeswitching phenomenon. Our main contributions are threefold: First, we introduce a novel disentanglement loss to enable the lower-layer of the encoder to capture inter-lingual acoustic information while mitigating linguistic confusion at the higher-layer of the encoder. Second, through comprehensive experiments, we verify that our proposed method outperforms the prior-art methods using pretrained dual-encoders, meanwhile having access only to the codeswitching corpus and consuming half of the parameterization. Third, the apparent differentiation of the encoders' output features also corroborates the complementarity between the disentanglement loss and the mixture-of-experts (MoE) architecture.


title: Conservation of distortion of gravitationally lensed images

abstract: We recently hypothesized that a distortion parameter exists such that its signed sum for all images of singular gravitational lensing of a source vanishes identically [K. S. Virbhadra, Phys. Rev. D {\bf 106}, 064038 (2022)]. We found a distortion parameter (the ratio of the tangential to radial magnifications) that satisfied the hypothesis for the images of Schwarzschild lensing with flying colors. We now show that another distortion parameter (the difference of tangential and radial magnifications) also magnificently supports our hypothesis when we perform computations with the primary-secondary and relativistic images. The distortion parameters, which satisfy the aesthetically appealing hypothesis, will likely aid in developing gravitational lensing theory. Finally, we discuss the conservation of distortion of images in gravitational lensing.


title: AI-Driven Anonymization: Protecting Personal Data Privacy While Leveraging Machine Learning

abstract: The development of artificial intelligence has significantly transformed people's lives. However, it has also posed a significant threat to privacy and security, with numerous instances of personal information being exposed online and reports of criminal attacks and theft. Consequently, the need to achieve intelligent protection of personal information through machine learning algorithms has become a paramount concern. Artificial intelligence leverages advanced algorithms and technologies to effectively encrypt and anonymize personal data, enabling valuable data analysis and utilization while safeguarding privacy. This paper focuses on personal data privacy protection and the promotion of anonymity as its core research objectives. It achieves personal data privacy protection and detection through the use of machine learning's differential privacy protection algorithm. The paper also addresses existing challenges in machine learning related to privacy and personal data protection, offers improvement suggestions, and analyzes factors impacting datasets to enable timely personal data privacy detection and protection.


title: Differentiable Biomechanics Unlocks Opportunities for Markerless Motion Capture

abstract: Recent developments have created differentiable physics simulators designed for machine learning pipelines that can be accelerated on a GPU. While these can simulate biomechanical models, these opportunities have not been exploited for biomechanics research or markerless motion capture. We show that these simulators can be used to fit inverse kinematics to markerless motion capture data, including scaling the model to fit the anthropomorphic measurements of an individual. This is performed end-to-end with an implicit representation of the movement trajectory, which is propagated through the forward kinematic model to minimize the error from the 3D markers reprojected into the images. The differential optimizer yields other opportunities, such as adding bundle adjustment during trajectory optimization to refine the extrinsic camera parameters or meta-optimization to improve the base model jointly over trajectories from multiple participants. This approach improves the reprojection error from markerless motion capture over prior methods and produces accurate spatial step parameters compared to an instrumented walkway for control and clinical populations.


title: When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method

abstract: While large language models (LLMs) often adopt finetuning to unlock their capabilities for downstream applications, our understanding on the inductive biases (especially the scaling properties) of different finetuning methods is still limited. To fill this gap, we conduct systematic experiments studying whether and how different scaling factors, including LLM model size, pretraining data size, new finetuning parameter size and finetuning data size, affect the finetuning performance. We consider two types of finetuning -- full-model tuning (FMT) and parameter efficient tuning (PET, including prompt tuning and LoRA), and explore their scaling behaviors in the data-limited regime where the LLM model size substantially outweighs the finetuning data size. Based on two sets of pretrained bilingual LLMs from 1B to 16B and experiments on bilingual machine translation and multilingual summarization benchmarks, we find that 1) LLM finetuning follows a powerbased multiplicative joint scaling law between finetuning data size and each other scaling factor; 2) LLM finetuning benefits more from LLM model scaling than pretraining data scaling, and PET parameter scaling is generally ineffective; and 3) the optimal finetuning method is highly task- and finetuning data-dependent. We hope our findings could shed light on understanding, selecting and developing LLM finetuning methods.