title: D3-brane supergravity solutions from Ricci-flat metrics on canonical bundles of K\"ahler-Einstein surfaces

abstract: D3-brane solutions of type IIB supergravity can be obtained by means a classical ansatz involving a harmonic warp factor and two summands, the first being the flat Minkowskian metric of the D3 brane world-sheet and the second a Ricci flat metric on a suitable 6-dimensional transverse space, both twisted by the warp factor. Of particular interest is the case of the total space of thecanonical bundle over a complex K\"ahler 2-fold. This situation emerges in many cases while considering the resolution of finite quotient singulaties. When the group is $\mathbb{Z}_4$, the complex 2-fold is the second Hirzebruch surface endowed with a K\"ahler metric having SU(2)xU(1) isometry. There is actually an entire class of such metrics parameterized by a single function, and best described in the AMSY symplectic formalism. We recover the existence of a two parameter subclass of K\"ahler-Einstein metrics on manifolds that are homeorphic to $S^2\times S^2$, and study in detail this class. The K"ahler-Einstein nature of these manifolds allows the construction of the Ricci flat metric on their canonical bundle via the Calabi Ansatz, which we recast in the AMSY formalism deriving some new elegant formulae. Furthermore we show the full integrability of the differential system of geodesics equations thanks to an additional conserved quantity that we unveil and which is similar to the Carter constant in the case of the Kerr metric.


title: CRONOS: Colorization and Contrastive Learning for Device-Free NLoS Human Presence Detection using Wi-Fi CSI

abstract: In recent years, the demand for pervasive smart services and applications has increased rapidly. Device-free human detection through sensors or cameras has been widely adopted, but it comes with privacy issues as well as misdetection for motionless people. To address these drawbacks, channel state information (CSI) captured from commercialized Wi-Fi devices provides rich signal features for accurate detection. However, existing systems suffer from inaccurate classification under a non-line-of-sight (NLoS) and stationary scenario, such as when a person is standing still in a room corner. In this work, we propose a system called CRONOS (Colorization and Contrastive Learning Enhanced NLoS Human Presence Detection), which generates dynamic recurrence plots (RPs) and color-coded CSI ratios to distinguish mobile and stationary people from vacancy in a room, respectively. We also incorporate supervised contrastive learning to retrieve substantial representations, where consultation loss is formulated to differentiate the representative distances between dynamic and stationary cases. Furthermore, we propose a self-switched static feature enhanced classifier (S3FEC) to determine the utilization of either RPs or color-coded CSI ratios. Our comprehensive experimental results show that CRONOS outperforms existing systems that either apply machine learning or non-learning based methods, as well as non-CSI based features in open literature. CRONOS achieves the highest human presence detection accuracy in vacancy, mobility, line-of-sight (LoS), and NLoS scenarios.


title: Discriminating sensor activation in activity recognition within multi-occupancy environments based on nearby interaction

abstract: This work presents a computer model to discriminate sensor activation in multi-occupancy environments based on proximity interaction. Current proximity-based and indoor location methods allow the estimation of the positions or areas where inhabitants carry out their daily human activities. The spatial-temporal relation between location and sensor activations is described in this work to generate a sensor interaction matrix for each inhabitant. This enables the use of classical HAR models to reduce the complexity of the multi-occupancy problem. A case study deployed with UWB and binary sensors is presented.


title: Packing $1.35\cdot 10^{11}$ rectangles into a unit square

abstract: It is known that $\sum\limits_{i=1}^{\infty} \frac{1}{i (i+1)} = 1$. In 1968, Meir and Moser asked for finding the smallest $\epsilon$ such that all the rectangles of sizes $1/i \times 1/(i + 1)$ for $i = 1, 2, \ldots$, can be packed into a unit square or a rectangle of area $1 + \epsilon$. In this paper, we show that we can pack the first $1.35\cdot10^{11}$ rectangles into the unit square and give an estimate for $\epsilon$ from this packing.


title: Hydrodynamical Simulations of Black-Hole Binary Formation in AGN Disks

abstract: We study the close encounters between two single black holes (BHs) embedded in an AGN disk using a series of global 2D hydrodynamics simulations. We find that when the disk density is sufficiently high, bound BH binaries can be formed by the collision of their circum-single disks. Our analysis demonstrates that, after a BH pair passes the pericenter of their relative trajectory, a gas post-collision drag may slow down the BHs, possibly forcing the two BHs to stay tightly bound. A binary formed by a close encounter can have a compact semi-major axis, large eccentricity, and retrograde orbital angular momentum. We provide a fitting formula that can accurately predict whether a close encounter can form a binary based on the gas mass and the incoming energy of the encounter. This fitting formula can be easily implemented in other long-term simulations that study the dynamical evolution of BHs in AGN disks.


title: Thin Film Rupture from the Atomic Scale

abstract: The retraction of thin films, as described by the Taylor-Culick (TC) theory, is subject to widespread debate, particularly for films at the nanoscale. We use non-equilibrium molecular dynamics simulations to explore the validity of the assumptions used in continuum models, by tracking the evolution of holes in a film. By deriving a new mathematical form for the surface shape and considering a locally varying surface tension at the front of the retracting film, we reconcile the original theory with our simulation data to recover a corrected TC speed valid at the nanoscale.


title: Comparable dark matter and baryon abundances with a heavy dark sector

abstract: We propose a scenario that explains the comparable abundances of dark matter (DM) and baryons without any coincidence in the corresponding particle masses. Here, DM corresponds to heavy "dark baryons" in a hidden MSSM-like dark sector, where the supersymmetry breaking scale can be several orders of magnitude larger than in the visible sector. In both sectors a baryon asymmetry is generated via the Affleck-Dine mechanism, and the smaller dark baryon-to-entropy ratio partially compensates the larger dark baryon masses to give similar densities in the two sectors. The large mass hierarchy also naturally results in an asymmetric reheating of these sequestered sectors. Moreover, this scenario predicts uncorrelated DM and baryon isocurvature perturbations.


title: Data efficient surrogate modeling for engineering design: Ensemble-free batch mode deep active learning for regression

abstract: In a computer-aided engineering design optimization problem that involves notoriously complex and time-consuming simulator, the prevalent approach is to replace these simulations with a data-driven surrogate that approximates the simulator's behavior at a much cheaper cost. The main challenge in creating an inexpensive data-driven surrogate is the generation of a sheer number of data using these computationally expensive numerical simulations. In such cases, Active Learning (AL) methods have been used that attempt to learn an input--output behavior while labeling the fewest samples possible. The current trend in AL for a regression problem is dominated by the Bayesian framework that needs training an ensemble of learning models that makes surrogate training computationally tedious if the underlying learning model is Deep Neural Networks (DNNs). However, DNNs have an excellent capability to learn highly nonlinear and complex relationships even for a very high dimensional problem. To leverage the excellent learning capability of deep networks along with avoiding the computational complexity of the Bayesian paradigm, in this work we propose a simple and scalable approach for active learning that works in a student-teacher manner to train a surrogate model. By using this proposed approach, we are able to achieve the same level of surrogate accuracy as the other baselines like DBAL and Monte Carlo sampling with up to 40 % fewer samples. We empirically evaluated this method on multiple use cases including three different engineering design domains:finite element analysis, computational fluid dynamics, and propeller design.


title: Electroplating based engineering of plasmonic nanorod metamaterials for biosensing applications

abstract: Sensing lower molecular weight in a diluted solution using a label-free biosensor is challenging and requires a miniaturized plasmonic structure, e.g., a vertical Au nanorod (AuNR) array based metamaterials. The sensitivity of a sensor mainly depends on transducer properties and hence for instance, the AuNR array geometry requires optimization. Physical vapour deposition methods (e.g., sputtering and e-beam evaporation) require a vacuum environment to deposit Au, which is costly, time-consuming, and thickness-limited. On the other hand, chemical deposition, i.e., electroplating deposit higher thickness in less time and at lower cost, becomes an alternative method for Au deposition. In this work, we present a detailed optimization for electroplating based fabrication of these metamaterials. We find that slightly acidic (6.0 < pH < 7.0) gold sulfite solution supports immersion deposition, which should be minimized to avoid uncontrolled Au deposition. Immersion deposition leads to plate-like (for smaller radius AuNR) or capped-like, i.e., mushroom (for higher radius AuNR) structure formation. The electroplating time and DC supply are the tuning parameters that decide the geometry of the vertically aligned AuNR array in area-dependent electroplating deposition. This work will have implications for developing plasmonic metamaterial based sensors.


title: Damping analysis of Floating Offshore Wind Turbine (FOWT): a new control strategy reducing the platform vibrations

abstract: In this paper, the coupled dynamics of the floating platform and the WTG rotor is analysed. In particular, the damping is explicitly derived from the coupled equations of rotor and floating platform. The analysis of the damping leads to the study of the instability phenomena and it derives the explicit conditions that lead to the Non Minimum Phase Zero (NMPZ). Two NMPZs, one related to the rotor dynamics and the other one to the platform pitch dynamics, are analysed. The latter is a novelty and it is analysed in this work, providing the community of an explicit condition for its verification. The domain of the instability of the platform is explicitly derived from the coupled system of equations. In the second part of the paper, from the analysis of the damping of the floating platform, a new strategy for the control of FOWTs is proposed. This strategy allows one to impose to the controller an explicit level of damping in the platform pitch motion without changing the period of platform pitching. Finally the new strategy is compared to the one without compensation by performing aero-hydro-servo-elastic numerical simulations of the UMaine IEA15MW FOWT. Generated power, movements, blade pitch and tower base fatigue are compared showing that the new control strategy can reduce fatigue in the structure without affecting the power production.


title: Always Valid Risk Monitoring for Online Matrix Completion

abstract: Always-valid concentration inequalities are increasingly used as performance measures for online statistical learning, notably in the learning of generative models and supervised learning. Such inequality advances the online learning algorithms design by allowing random, adaptively chosen sample sizes instead of a fixed pre-specified size in offline statistical learning. However, establishing such an always-valid type result for the task of matrix completion is challenging and far from understood in the literature. Due to the importance of such type of result, this work establishes and devises the always-valid risk bound process for online matrix completion problems. Such theoretical advances are made possible by a novel combination of non-asymptotic martingale concentration and regularized low-rank matrix regression. Our result enables a more sample-efficient online algorithm design and serves as a foundation to evaluate online experiment policies on the task of online matrix completion.


title: The Mean Time to Absorption on Horizontal Partitioned Sierpinski Gasket Networks

abstract: The random walk is one of the most basic dynamic properties of complex networks, which has gradually become a research hotspot in recent years due to its many applications in actual networks. An important characteristic of the random walk is the mean time to absorption, which plays an extremely important role in the study of topology, dynamics and practical application of complex networks. Analyzing the mean time to absorption on the regular iterative self-similar network models is an important way to explore the influence of self-similarity on the properties of random walks on the network. The existing literatures have proved that even local self-similar structures can greatly affect the properties of random walks on the global network, but they have failed to prove whether these effects are related to the scale of these self-similar structures. In this article, we construct and study a class of Horizontal Partitioned Sierpinski Gasket network model based on the classic Sierpinski gasket network, which is composed of local self-similar structures, and the scale of these structures will be controlled by the partition coefficient $k$. Then, the analytical expressions and approximate expressions of the mean time to absorption on the network model are obtained, which prove that the size of the self-similar structure in the network will directly restrict the influence of the self-similar structure on the properties of random walks on the network. Finally, we also analyzed the mean time to absorption of different absorption nodes on the network to find the location of the node with the highest absorption efficiency.


title: Structured pseudospectrum and structured condition pseudospectrum of non-archimedean matrices

abstract: In this paper, the structured pseudospectrum of non-archimedean matrices and structured pseudospectrum of non-archimedean matrix pencils are introduced. Many results are proved about them and we give a few examples.


title: A flexible and scalable single-level framework for OD matrix inference using multiple sources of transport information

abstract: This study proposes a flexible and scalable single-level framework for origin-destination matrix (ODM) inference using data from IoT (Internet of Things) and other sources. The framework allows the analyst to integrate information from multiple data sources, while controlling for differences in data quality across sources. We assess the effectiveness of the framework through a real-world experiment in Greater Adelaide (GA), Australia. We infer car OD flows within the region using four separate data sources: site-level traffic counts from loop detectors, vehicle trajectories recorded by roadside Bluetooth sensors, partial OD flows based on data from in-vehicle navigation systems, and journey-to-work data collected by the Australian Census. We compare our OD inferences with those from the current version of the Metropolitan Adelaide Strategic Transport Model (MASTEM), calibrated using data from traditional household travel surveys. We find remarkable consistency between our inferences and those from MASTEM, despite differences in input data and methodologies. For example, for the morning peak period, we predict the total number of trips made within GA to be equal to 556,000, while the corresponding prediction from MASTEM is equal to 484,000. The two predictions are within 20 per cent of each other. When we compare the spatial distribution of trips, in terms of origins and destinations, we find that our inferred OD matrix has an 86 per cent cosine similarity to the corresponding MASTEM matrix. In summary, our results show that the proposed framework can produce highly comparable ODM, trip production and trip attraction patterns to those inferred from traditional household travel survey-based transportation demand modelling methods.


title: Solvable points on higher genus curves

abstract: It is known that for a curve defined over $\mathbb{Q}$ of genus $g \leq 4$, there exists a point on the curve defined over a solvable extension of $\mathbb{Q}$. We relate points on curves of genus $g \geq 5$ over solvable extensions to the Bombieri-Lang conjecture. Specifically, it shows that varieties parameterising points defined over extensions with a fixed solvable Galois group are of general type. Moreover, we show the existence of certain subvarieties in these varieties imply the existence of solvable morphisms from the curve.


title: The norm residue symbol for formal Drinfeld modules

abstract: In this paper, we study the Kummer pairing associated with formal Drinfeld modules having stable reduction of height one. We give an explicit description of the pairing \`a la Kolyvagin, in terms of the logarithm of the formal Drinfeld module, a certain derivation, torsion points and the trace. The results obtained give a generalization of the results of Angl\`es proved for Carlitz modules, and of Bars and Longhi proved for sign-normalized rank one Drinfeld modules. It also presents an extension of our previous formulas to arbitrary finite extensions of loca fields containing enough torsion points.


title: Vehicular Safety Applications and Approaches: A Technical Survey

abstract: This paper proposes an extensive overview of safety applications and approaches as it relates to automated driving from the prospectives of sensor configurations, vehicle dynamics modelling, tyre modeling, and estimation approaches. First, different Advanced-Driver Assistance Systems (ADAS) are introduced along with the main sensing components and technologies. Then, different kinematics modelling of vehicles and tyres are discussed. Finally, various communicational technologies and architectures along with self-driving modules are presented. Moreover, some interesting perspectives for future research are listed based on the extensive experience of the authors. The objective of this study is to teach and guide the beginner and expert for choosing the most suitable approach for autonomous driving applications in safety and stability targeted issues.


title: Invariant Learning via Diffusion Dreamed Distribution Shifts

abstract: Though the background is an important signal for image classification, over reliance on it can lead to incorrect predictions when spurious correlations between foreground and background are broken at test time. Training on a dataset where these correlations are unbiased would lead to more robust models. In this paper, we propose such a dataset called Diffusion Dreamed Distribution Shifts (D3S). D3S consists of synthetic images generated through StableDiffusion using text prompts and image guides obtained by pasting a sample foreground image onto a background template image. Using this scalable approach we generate 120K images of objects from all 1000 ImageNet classes in 10 diverse backgrounds. Due to the incredible photorealism of the diffusion model, our images are much closer to natural images than previous synthetic datasets. D3S contains a validation set of more than 17K images whose labels are human-verified in an MTurk study. Using the validation set, we evaluate several popular DNN image classifiers and find that the classification performance of models generally suffers on our background diverse images. Next, we leverage the foreground & background labels in D3S to learn a foreground (background) representation that is invariant to changes in background (foreground) by penalizing the mutual information between the foreground (background) features and the background (foreground) labels. Linear classifiers trained on these features to predict foreground (background) from foreground (background) have high accuracies at 82.9% (93.8%), while classifiers that predict these labels from background and foreground have a much lower accuracy of 2.4% and 45.6% respectively. This suggests that our foreground and background features are well disentangled. We further test the efficacy of these representations by training classifiers on a task with strong spurious correlations.


title: Heterogeneous Hidden Markov Models for Sleep Activity Recognition from Multi-Source Passively Sensed Data

abstract: Psychiatric patients' passive activity monitoring is crucial to detect behavioural shifts in real-time, comprising a tool that helps clinicians supervise patients' evolution over time and enhance the associated treatments' outcomes. Frequently, sleep disturbances and mental health deterioration are closely related, as mental health condition worsening regularly entails shifts in the patients' circadian rhythms. Therefore, Sleep Activity Recognition constitutes a behavioural marker to portray patients' activity cycles and to detect behavioural changes among them. Moreover, mobile passively sensed data captured from smartphones, thanks to these devices' ubiquity, constitute an excellent alternative to profile patients' biorhythm. In this work, we aim to identify major sleep episodes based on passively sensed data. To do so, a Heterogeneous Hidden Markov Model is proposed to model a discrete latent variable process associated with the Sleep Activity Recognition task in a self-supervised way. We validate our results against sleep metrics reported by clinically tested wearables, proving the effectiveness of the proposed approach.


title: Out-of-equilibrium photon production and electric conductivity in a holographic Bjorken expanding plasma

abstract: We analytically compute the out-of-equilibrium direct photon production rate and electric conductivity, in a strongly coupled and expanding Bjorken plasma, from holography. Our results are valid at late times where the expanding plasma asymptotes Bjorken hydrodynamics. The out-of-equilibrium rates are substantially harder and larger, early on in the Bjorken expansion phase.


title: The density of states method in Yang-Mills theories and first order phase transitions

abstract: Extensions of the standard model that lead to first-order phase transitions in the early universe can produce a stochastic background of gravitational waves, which may be accessible to future detectors. Thermodynamic observables at the transition, such as the latent heat, can be determined by lattice simulations, and then used to predict the expected signatures in a given theory. In lattice calculations, the emergence of metastabilities in proximity of the phase transition may make the precise determination of these observables quite challenging, and may lead to large uncontrolled numerical errors. In this contribution, we discuss as a prototype lattice calculation the first order deconfinement transition that arises in the strong SU(3) Yang-Mills sector. We adopt the novel logarithmic linear relaxation method, which can provide a determination of the density of states of the system with exponential error suppression. Thermodynamic observables can be reconstructed with a controlled error, providing a promising direction for accurate model predictions in the future.


title: Compass state: Effect of squeezing and displacement on the Fock space

abstract: We investigate a broad class of non-classical states, composed of superposed squeezed and displaced number states. The phase space structure is analysed, keeping in mind, Heisenberg limited sensitivity in parameter estimation. Appropriate squeezing and displacement parameters are identified, wherein state fidelity in comparison to metrologically sensitive compass state, is more than 99$\%$. Also, the variance in small shifts measurements, is found equal for both proposed and compass states. They show similar behaviour with change in average photon number. In metrological application, number variance of the compass state being small for low coherent amplitude, suggests its potential to estimate damping parameter.


title: Existence of the Map $det^{S^3}$

abstract: In this paper we show the existence of a nontrivial linear map $det^{S^3}:V_d^{\otimes\binom{3d}{3}}\to k$ with the property that $det^{S^3}(\otimes_{1\leq i<j<k\leq 3d}(v_{i,j,k}))=0$ if there exists $1\leq x<y<z<t\leq 3d$ such that $v_{x,y,z}=v_{x,y,t}=v_{x,z,t}=v_{y,z,t}$. This gives a partial answer to a conjecture from [10]. As an application, we use the map $det^{S^3}$ to study those d-partitions of the complete hypergraph $K^3_{3d}$ that have zero Betti numbers. We also discuss algebraic and combinatorial properties of a map $det^{S^r}:V_d^{\otimes\binom{rd}{r}}\to k$ which generalizes the determinant map, the map $det^{S^2}$ from [9], and $det^{S^3}$.


title: DarkPack: A modular software to compute BSM squared amplitudes for particle physics and dark matter observables

abstract: We present here a new package to automatically generate a complete library of 2 to 2 squared amplitudes at leading order in any New Physics models. The package is written in C++ and based on the MARTY software. The numerical library generated allows for the computation of relic density by embedding the algorithms of SuperIso Relic.


title: On the Ramsey number of daisies I

abstract: Daisies are a special type of hypergraphs introduced by Bollob\'{a}s, Leader and Malvenuto. An $r$-daisy determined by a pair of disjoint sets $K$ and $M$ is the $(r+|K|)$-uniform hypergraph $\{K\cup P:\: P\in M^{(r)}\}$. In [Combin. Probab. Comput. 20, no. 5, 743-747, 2011] the authors studied Tur\'{a}n type density problems for daisies. This paper deals with Ramsey numbers of Daisies, which are natural generalizations of classical Ramsey numbers. We discuss upper and lower bounds for the Ramsey number of $r$-daisies and also for special cases where the size of the kernel is bounded.


title: Comparing Explanation Methods for Traditional Machine Learning Models Part 2: Quantifying Model Explainability Faithfulness and Improvements with Dimensionality Reduction

abstract: Machine learning (ML) models are becoming increasingly common in the atmospheric science community with a wide range of applications. To enable users to understand what an ML model has learned, ML explainability has become a field of active research. In Part I of this two-part study, we described several explainability methods and demonstrated that feature rankings from different methods can substantially disagree with each other. It is unclear, though, whether the disagreement is overinflated due to some methods being less faithful in assigning importance. Herein, "faithfulness" or "fidelity" refer to the correspondence between the assigned feature importance and the contribution of the feature to model performance. In the present study, we evaluate the faithfulness of feature ranking methods using multiple methods. Given the sensitivity of explanation methods to feature correlations, we also quantify how much explainability faithfulness improves after correlated features are limited. Before dimensionality reduction, the feature relevance methods [e.g., SHAP, LIME, ALE variance, and logistic regression (LR) coefficients] were generally more faithful than the permutation importance methods due to the negative impact of correlated features. Once correlated features were reduced, traditional permutation importance became the most faithful method. In addition, the ranking uncertainty (i.e., the spread in rank assigned to a feature by the different ranking methods) was reduced by a factor of 2-10, and excluding less faithful feature ranking methods reduces it further. This study is one of the first to quantify the improvement in explainability from limiting correlated features and knowing the relative fidelity of different explainability methods.


title: Arbitrarily Accurate Classification Applied to Specific Emitter Identification

abstract: This article introduces a method of evaluating subsamples until any prescribed level of classification accuracy is attained, thus obtaining arbitrary accuracy. A logarithmic reduction in error rate is obtained with a linear increase in sample count. The technique is applied to specific emitter identification on a published dataset of physically recorded over-the-air signals from 16 ostensibly identical high-performance radios. The technique uses a multi-channel deep learning convolutional neural network acting on the bispectra of I/Q signal subsamples each consisting of 56 parts per million (ppm) of the original signal duration. High levels of accuracy are obtained with minimal computation time: in this application, each addition of eight samples decreases error by one order of magnitude.


title: On Waring's problem for larger powers

abstract: Let $G(k)$ denote the least number $s$ having the property that every sufficiently large natural number is the sum of at most $s$ positive integral $k$-th powers. Then for all $k\in \mathbb N$, one has \[ G(k)\le \lceil k(\log k+4.20032)\rceil . \] Our new methods improve on all bounds available hitherto when $k\ge 14$.


title: Environmental Sensor Placement with Convolutional Gaussian Neural Processes

abstract: Environmental sensors are crucial for monitoring weather conditions and the impacts of climate change. However, it is challenging to place sensors in a way that maximises the informativeness of their measurements, particularly in remote regions like Antarctica. Probabilistic machine learning models can suggest informative sensor placements by finding sites that maximally reduce prediction uncertainty. Gaussian process (GP) models are widely used for this purpose, but they struggle with capturing complex non-stationary behaviour and scaling to large datasets. This paper proposes using a convolutional Gaussian neural process (ConvGNP) to address these issues. A ConvGNP uses neural networks to parameterise a joint Gaussian distribution at arbitrary target locations, enabling flexibility and scalability. Using simulated surface air temperature anomaly over Antarctica as training data, the ConvGNP learns spatial and seasonal non-stationarities, outperforming a non-stationary GP baseline. In a simulated sensor placement experiment, the ConvGNP better predicts the performance boost obtained from new observations than GP baselines, leading to more informative sensor placements. We contrast our approach with physics-based sensor placement methods and propose future steps towards an operational sensor placement recommendation system. Our work could help to realise environmental digital twins that actively direct measurement sampling to improve the digital representation of reality.


title: Informative Sample-Aware Proxy for Deep Metric Learning

abstract: Among various supervised deep metric learning methods proxy-based approaches have achieved high retrieval accuracies. Proxies, which are class-representative points in an embedding space, receive updates based on proxy-sample similarities in a similar manner to sample representations. In existing methods, a relatively small number of samples can produce large gradient magnitudes (ie, hard samples), and a relatively large number of samples can produce small gradient magnitudes (ie, easy samples); these can play a major part in updates. Assuming that acquiring too much sensitivity to such extreme sets of samples would deteriorate the generalizability of a method, we propose a novel proxy-based method called Informative Sample-Aware Proxy (Proxy-ISA), which directly modifies a gradient weighting factor for each sample using a scheduled threshold function, so that the model is more sensitive to the informative samples. Extensive experiments on the CUB-200-2011, Cars-196, Stanford Online Products and In-shop Clothes Retrieval datasets demonstrate the superiority of Proxy-ISA compared with the state-of-the-art methods.


title: Programmable Heisenberg interactions between Floquet qubits

abstract: The fundamental trade-off between robustness and tunability is a central challenge in the pursuit of quantum simulation and fault-tolerant quantum computation. In particular, many emerging quantum architectures are designed to achieve high coherence at the expense of having fixed spectra and consequently limited types of controllable interactions. Here, by adiabatically transforming fixed-frequency superconducting circuits into modifiable Floquet qubits, we demonstrate an XXZ Heisenberg interaction with fully adjustable anisotropy. This interaction model is on one hand the basis for many-body quantum simulation of spin systems, and on the other hand the primitive for an expressive quantum gate set. To illustrate the robustness and versatility of our Floquet protocol, we tailor the Heisenberg Hamiltonian and implement two-qubit iSWAP, CZ, and SWAP gates with estimated fidelities of 99.32(3)%, 99.72(2)%, and 98.93(5)%, respectively. In addition, we implement a Heisenberg interaction between higher energy levels and employ it to construct a three-qubit CCZ gate with a fidelity of 96.18(5)%. Importantly, the protocol is applicable to various fixed-frequency high-coherence platforms, thereby unlocking a suite of essential interactions for high-performance quantum information processing. From a broader perspective, our work provides compelling avenues for future exploration of quantum electrodynamics and optimal control using the Floquet framework.


title: Indexing AI Risks with Incidents, Issues, and Variants

abstract: Two years after publicly launching the AI Incident Database (AIID) as a collection of harms or near harms produced by AI in the world, a backlog of "issues" that do not meet its incident ingestion criteria have accumulated in its review queue. Despite not passing the database's current criteria for incidents, these issues advance human understanding of where AI presents the potential for harm. Similar to databases in aviation and computer security, the AIID proposes to adopt a two-tiered system for indexing AI incidents (i.e., a harm or near harm event) and issues (i.e., a risk of a harm event). Further, as some machine learning-based systems will sometimes produce a large number of incidents, the notion of an incident "variant" is introduced. These proposed changes mark the transition of the AIID to a new version in response to lessons learned from editing 2,000+ incident reports and additional reports that fall under the new category of "issue."


title: On the Ramsey number of daisies II

abstract: A $(k+r)$-uniform hypergraph $H$ on $(k+m)$ vertices is an $(r,m,k)$-daisy if there exists a partition of the vertices $V(H)=K\cup M$ with $|K|=k$, $|M|=m$ such that the set of edges of $H$ is all the $(k+r)$-tuples $K\cup P$, where $P$ is an $r$-tuple of $M$. Complementing results in ["On the Ramsey number of daisies I"], we obtain an $(r-2)$-iterated exponential lower bound to the Ramsey number of an $(r,m,k)$-daisy for $2$-colors. This matches the order of magnitude of the best lower bounds for the Ramsey number of a complete $r$-graph.


title: On generalized conjugacy and some related problems

abstract: We establish a connection between the generalized conjugacy problem for a $G$-by-$\mathbb{Z}$ group, $GCP(G \rtimes \mathbb{Z})$, and two algorithmic problems for $G$: the generalized Brinkmann's conjugacy problem, $GBrCP(G)$, and the generalized twisted conjugacy problem, $GTCP(G)$. We explore this connection for generalizations of different kinds: relative to finitely generated subgroups, to theirs cosets, or to recognizable, rational, context-free or algebraic subsets of the group. Using this result, we are able to prove that $GBrCP(G)$ is decidable (with respect to cosets) when $G$ is a virtually polycyclic group, which implies in particular that the generalized Brinkmann's equality problem, $GBrP(G)$, is decidable if $G$ is a finitely generated abelian group. Finally, we prove that if $G$ is a finitely generated virtually free group, then the simple versions of Brinkmann's equality problem and of the twisted conjugacy problem, $BrP(G)$ and $TCP(G)$, are decidable.


title: Partitio Numerorum: sums of a prime and a number of $k$-th powers

abstract: Let $k$ be a natural number and let $c=2.134693\ldots$ be the unique real solution of the equation $2c=2+\log (5c-1)$ in $[1,\infty)$. Then, when $s\ge ck+4$, we establish an asymptotic lower bound of the expected order of magnitude for the number of representations of a large positive integer as the sum of one prime and $s$ positive integral $k$-th powers.


title: Patch-Based Denoising Diffusion Probabilistic Model for Sparse-View CT Reconstruction

abstract: Sparse-view computed tomography (CT) can be used to reduce radiation dose greatly but is suffers from severe image artifacts. Recently, the deep learning based method for sparse-view CT reconstruction has attracted a major attention. However, neural networks often have a limited ability to remove the artifacts when they only work in the image domain. Deep learning-based sinogram processing can achieve a better anti-artifact performance, but it inevitably requires feature maps of the whole image in a video memory, which makes handling large-scale or three-dimensional (3D) images rather challenging. In this paper, we propose a patch-based denoising diffusion probabilistic model (DDPM) for sparse-view CT reconstruction. A DDPM network based on patches extracted from fully sampled projection data is trained and then used to inpaint down-sampled projection data. The network does not require paired full-sampled and down-sampled data, enabling unsupervised learning. Since the data processing is patch-based, the deep learning workflow can be distributed in parallel, overcoming the memory problem of large-scale data. Our experiments show that the proposed method can effectively suppress few-view artifacts while faithfully preserving textural details.


title: Coupled cluster theory: Towards an algebraic geometry formulation

abstract: Coupled cluster theory produced arguably the most widely used high-accuracy computational quantum chemistry methods. Despite the approach's overall great computational success, its mathematical understanding is so far limited to results within the realm of functional analysis. The coupled cluster amplitudes, which are the targeted objects in coupled cluster theory, correspond to solutions to the coupled cluster equations, which is a system of polynomial equations of at most degree four. The high dimensionality of the electronic Schr\"odinger equation and the non-linearity of the coupled cluster ansatz have so far stalled a formal analysis of this polynomial system. In this article, we present algebraic investigations that shed light on the coupled cluster equations and the root structure of this ansatz. This is of importance for the a posteriori evaluation of coupled cluster calculations. To that end, we investigate the root structure by means of Newton polytopes. We derive a general v-description, which is subsequently turned into an h-description for explicit examples. This perspective reveals an apparent connection between Pauli's exclusion principle and the geometrical structure of the Newton polytopes. We also propose an alternative characterization of the coupled cluster equations projected onto singles and doubles as cubic polynomials on an algebraic variety with certain sparsity patterns. Moreover, we provide numerical simulations of two computationally tractable systems, namely, the two electrons in four spin-orbitals system and the three electrons in six spin-orbitals system. These simulations provide novel insight into the root structure of the coupled cluster solutions when the coupled cluster ansatz is truncated.


title: Generalized Positive Energy Representations of Groups of Jets

abstract: Let $V$ be a finite-dimensional real vector space and $K$ a compact simple Lie group with Lie algebra $\mathfrak{k}$. Consider the Fr\'echet-Lie group $G := J_0^\infty(V; K)$ of $\infty$-jets at $0 \in V$ of smooth maps $V \to K$, with Lie algebra $\mathfrak{g} = J_0^\infty(V; \mathfrak{k})$. Let $P$ be a Lie group and write $\mathfrak{p} := \textrm{Lie}(P)$. Let $\alpha$ be a smooth $P$-action on $G$. We study smooth projective unitary representations $\bar{\rho}$ of $G \rtimes_\alpha P$ that satisfy a so-called generalized positive energy condition. In particular, this class captures representations that are in a suitable sense compatible with a KMS state on the von Neumann algebra generated by $\bar{\rho}(G)$. We show that this condition imposes severe restrictions on the derived representation $d\bar{\rho}$ of $\mathfrak{g} \rtimes \mathfrak{p}$, leading in particular to sufficient conditions for $\bar{\rho}\big|_{G}$ to factor through $J_0^2(V; K)$, or even through $K$.


title: Hunting for bumps in the margins

abstract: Data driven modelling is vital to many analyses at collider experiments, however the derived inference of physical properties becomes subject to details of the model fitting procedure. This work brings a principled Bayesian picture, based on the marginal likelihood, of both data modelling and signal extraction to a common collider physics scenario. First the marginal likelihood based method is used to propose a more principled construction of the background process, systematically exploring a variety of candidate shapes. Second the picture is extended to propose the marginal likelihood as a useful tool for anomaly detection challenges in particle physics. This proposal offers insight into both precise background model determination and demonstrates a flexible method to extend signal determination beyond a simple bump hunt.


title: Fokas diagonalization

abstract: A method for solving linear initial boundary value problems was recently reimplemented as a true spectral transform method. As part of this reformulation, the precise sense in which the spectral transforms diagonalize the underlying spatial differential operator was elucidated. That work concentrated on two point initial boundary value problems and interface problems on networks of finite intervals. In the present work, we extend these results, by means of three examples, to new classes of problems: problems on semiinfinite domains, problems with nonlocal boundary conditions, and problems in which the partial differential equation features mixed derivatives. We show that the transform pair derived via the Fokas transform method features the same Fokas diagonalization property in each of these new settings, and we argue that this weak diagonalization property is precisely that needed to ensure success of a spectral transform method.


title: Collision-induced three-body polarizability of helium

abstract: We present first-principles theoretical determination of the three-body polarizability and the third dielectric virial coefficient of helium. Coupled-cluster theory and the full configuration interaction procedure were used to perform required electronic structure calculations. The mean absolute relative uncertainty of the trace of the three-body polarizability tensor, resulting from the incompleteness of orbital basis set, was determined using extrapolation techniques. Additional uncertainty due to approximate treatment of triple and the neglect of higher excitations was estimated using full configuration interaction calculations. An analytic function was developed to describe the behavior of the polarizability and its asymptotic decay to three-atomic and atom-diatom fragmentation channels. We also developed an analytic function describing the local behavior of the total uncertainty of our calculations. Using both fits we calculated the third dielectric virial coefficient and its uncertainty using the classical and semiclassical Feynman-Hibbs approaches. The results of our calculations were compared with available experimental data and with recent Path-Integral Monte Carlo (PIMC) calculations employing the so-called superposition approximation of the three-body polarizability. For temperatures above 200 K we observed significant discrepancy between the classical results obtained using either the superposition approximation or the ab initio computed polarizability. The theoretical data reported in this work eliminate the main accuracy bottleneck of the development of optical pressure standard and are expected to facilitate further progress in the field of quantum thermal metrology


title: New form of the Kerr-Newman solution

abstract: A new form of the Kerr-Newman solution is presented. The solution involves a time coordinate which represents the local proper time for a charged massive particle released from rest at spatial infinity. The chosen coordinates ensure that the solution is well-behaved at horizons and enable an intuitive description of many physical phenomena. If the charge of the particle $e = 0$, the coordinates reduce to Doran coordinates for the Kerr solution with the replacement $M \to M - Q^2/(2r)$, where $M$ and $Q$ are the mass and charge of the black hole, respectively. Such coordinates are valid only for $r \ge Q^2/(2M)$, however, which corresponds to the region that a neutral particle released from rest at infinity can penetrate. By contrast, for $e \neq 0$ and of opposite sign to $Q$, the new coordinates have a progressively extended range of validity as $|e|$ increases and tend to advanced Eddington-Finkelstein (EF) null coordinates as $|e| \to \infty$, hence becoming global in this limit. The Kerr solution (i.e.\ with $Q=0$) may also be written in terms of the new coordinates by setting $eQ = -\alpha$, where $\alpha$ is a real parameter unrelated to charge; in this case the coordinate system is global for all non-negative values of $\alpha$ and the limits $\alpha = 0$ and $\alpha \to \infty$ correspond to Doran coordinates and advanced EF null coordinates, respectively, without any need to transform between them.


title: Hydraulic Parameter Estimation in District Heating Networks

abstract: Using hydraulic models in control design in district heating networks can increase pumping efficiency and reduce sensitivity to hydraulic bottlenecks. These models are usually white-box, as they are obtained based on full knowledge of the district heating network and its parameters. This type of model is time-consuming to obtain, and might differ from the actual behavior of the system. In this paper, a method is proposed to obtain a grey-box hydraulic model for tree-shaped district heating systems: hydraulic parameters are estimated based on pressure measurements in only two locations. While previous works only estimate parameters related to pressure losses in pipes, this work also includes customers valves in the grey-box model structure, an important inclusion for control-oriented applications. Finally, a numerical example illustrates the proposed method on a small district heating network, showing its ability to obtain an accurate model on the basis of noisy measurements.


title: Particle Physics at the European Spallation Source

abstract: Presently under construction in Lund, Sweden, the European Spallation Source (ESS) will be the world's brightest neutron source. As such, it has the potential for a particle physics program with a unique reach and which is complementary to that available at other facilities. This paper describes proposed particle physics activities for the ESS. These encompass the exploitation of both the neutrons and neutrinos produced at the ESS for high precision (sensitivity) measurements (searches).


title: Pairs of diagonal quartic forms: the asymptotic formulae

abstract: We establish an asymptotic formula for the number of integral solutions of bounded height for pairs of diagonal quartic equations in $26$ or more variables. In certain cases, pairs in $25$ variables can be handled.


title: Improved Approximations for Unrelated Machine Scheduling

abstract: We revisit two well-studied scheduling problems in the unrelated machines setting where each job can have a different processing time on each machine. For minimizing total weighted completion time we give a 1.45-approximation, which improves upon the previous 1.488-approximation [Im and Shadloo SODA 2020]. The key technical ingredient in this improvement lies in a new rounding scheme that gives strong negative correlation with less restrictions. For minimizing $L_k$-norms of machine loads, inspired by [Kalaitzis et al. SODA 2017], we give better approximation algorithms. In particular we give a $\sqrt {4/3}$-approximation for the $L_2$-norm which improves upon the former $\sqrt 2$-approximations due to [Azar-Epstein STOC 2005] and [Kumar et al. JACM 2009].


title: Valuations and Nonzero Torsion in Module of Differentials

abstract: Let $(R,\mathfrak{m}_R,k)$ be a one-dimensional complete local reduced $k$-algebra over a field of characteristic zero. R. Berger conjectured that $R$ is regular if and only if the universally finite module of differentials $\Omega_R$ is torsion free. When $R$ is a domain, we prove the conjecture in several cases. Our techniques are primarily reliant on making use of the valuation semi-group of $R$. First, we establish a method of verifying the conjecture by analyzing the valuation semi-group of $R$ and orders of units of the integral closure of $R$. We also prove the conjecture in the case when certain monomials are missing from the monomial support of the defining ideal of $R$. These monomials are based on the smallest power of $\mathfrak{m}_R$ that is contained within the conductor ideal. This also generalizes a previous result of Corti\~nas, Geller and Weibel.


title: On Weakly Hausdorff Spaces and Locally Strongly Sober Spaces

abstract: We show that the locally strongly sober spaces are exactly the coherent sober spaces that are weakly Hausdorff in the sense of Keimel and Lawson. This allows us to describe their Stone duals explicitly. As another application, we show that weak Hausdorffness is a sufficient condition for lenses and of quasi-lenses to form homeomorphic spaces, generalizing previously known results.


title: Tsallis holographic dark energy under Complex form of Quintessence model

abstract: In this paper, we use a Tsallis holographic dark energy model in two forms, interacting and non-interacting cases, to acquire some parameters as the equation of state for the energy density of the Tsallis model in the FRW universe concerning the complex form of quintessence model. We will study the cosmology of complex quintessence by revamping the potential and investigating the scalar field dynamics. Then we analyze ($\omega-\omega'$) and stability in two cases, i.e., non-interacting and interacting. We will explore whether these cases describe a real universe by calculating fractional energy density $\Omega_{D}$ and concerning two parts of the quintessence field effect ( complex and real part ) by considering the real part of this field to be a slow-roll field. We know that the part in which the fractional energy density ($\Omega_{D} > 1$) does not describe a real universe. Also, we specified an interacting coupling parameter $b^{2}$ that depends on the constant parameter of the Tsallis holographic model ($\delta$) with respect to fractional energy density ($0.73$). Unlike independence between the fractional energy density and interacting coupling in the real quintessence model, we determine a relationship among these parameters in this theory. Finally, by plotting some figures, we specify the features of ($\omega-\omega'$) and ($\nu_{s}^{2}$) in two cases and compare the result with each other.


title: High-Statistics Measurement of Antineutrino Quasielastic-like scattering at $E_\nu \sim$ 6~GeV on a Hydrocarbon Target

abstract: We present measurements of the cross section for anti-neutrino charged-current quasielastic-like scattering on hydrocarbon using the medium energy (ME) NuMI wide-band neutrino beam peaking at $<E_{\nu}>\sim 6$ GeV. The cross section measurements are presented as a function of the longitudinal momentum ($p_{||}$) and transverse momentum ($p_{T}$) of the final state muon. This work complements our previously reported high statistics measurement in the neutrino channel and extends the previous anti-neutrino measurement made in the low energy (LE) beam at neutrino energy($<E_{\nu}>$) $\sim$ 3.5 GeV to $p_{T}$ of 2.5 GeV/c. Current theoretical models do not completely describe the data in this previously unexplored high $p_{T}$ region. The single differential cross section as a function of four momentum transfer ($Q^{2}_{QE}$) now extends to 4 GeV$^2$ with high statistics. The cross section as a function of $Q^{2}_{QE}$ shows that the tuned simulations developed by the MINERvA collaboration that agreed well with the low energy beam measurements do not agree as well with the medium energy beam measurements. Newer neutrino interaction models such as the GENIE 3 tunes are better able to simulate the high $Q^{2}_{QE}$.


title: Bandwidth and visibility improvement in detection of a weak signal using mode entanglement and swapping

abstract: Quantum fluctuations constitute the primary noise barrier limiting cavity-based axion dark matter searches. In an experiment designed to mimic a real axion search, we employ a quantum-enhanced sensing technique to detect a synthetic axion-like microwave tone at an unknown frequency weakly coupled to a resonator, demonstrating a factor of 5.6 acceleration relative to a quantum-limited search for the same tone. The acceleration comes from increases to both the visibility bandwidth and the peak visibility of a detector. This speedup is achieved by dynamically coupling the resonator mode to a second (readout) mode with balanced swapping and two-mode squeezing interactions. A small fractional imbalance between the two interaction rates yields further scan rate enhancement and we demonstrate that an 8-fold acceleration can be achieved.


title: Orbital-ordered ferromagnetic insulating state in tensile-strained SrCoO$_{3}$ thin films

abstract: At ambient pressure, bulk SrCoO$_{3}$ is a ferromagnetic (FM) metal in cubic perovskite structure. By contrast, magnetic properties of epitaxial SrCoO$_{3}$ thin films, especially at high tensile strain ($\varepsilon \gtrsim 3$\%), remain unclear: Previous calculations had predicted antiferromagnetic (AFM) states more energetically favorable in this regime, but recent experiments indicated a FM insulating state. In this work, using first-principles calculations, we perform an extensive search for the structural, spin, magnetic, and orbital states of SrCoO$_{3}$ thin films. Our calculations indicate that at $0 < \varepsilon \lesssim 2.5$\%, SrCoO$_{3}$ favors a FM half-metallic state with intermediate-spin ($t_{2g}^{5}e_{g}^{1}$-like) Co exhibiting $d^{6}\underline L$ character. At $\varepsilon \gtrsim 2.5$\%, a FM insulating state with high-spin ($t_{2g}^{4}e_{g}^{2}$-like) Co dominates. This FM insulating state is achieved via complicated orbital ordering, cooperative Jahn--Teller distortion, and octahedral tilting about all three crystal axes.


title: A Note on Generating Sets for Semiflows

abstract: In this short note, we are interested in discussing characteristics of finite generating sets for $\mathcal{F}$, the set of all semiflows with non negative coefficients of a Petri Net. By systematically positioning these results over semi rings such as $\mathbb{N}$ or $\mathbb{Q^+}$ then over a field such as $\mathbb{Q}$, we were able to discover a handful of new results


title: Unitarized one-loop graviton-graviton scattering

abstract: In this work we interpret the Einstein-Hilbert (EH) Lagrangian of gravitation as the first term of a low-energy effective theory similar to those considered in the chiral Lagrangian approach to low-energy hadron physics or the electroweak chiral Lagragians describing the symmetry breaking sector of the Standard Model (SM). Starting from the one-loop computation of the elastic graviton-graviton scattering amplitude by Dunbar and Norridge, we unitarize the IR regularized partial waves by using the Inverse Amplitude Method (IAM). This method enlarges the regime of applicability of the perturbative results to higher energies of the order of the Plank scale $M_P$ and allows for the possibility of poles in the second Riemann which have the natural interpretation of dynamical resonances. In this work we look for these possible resonances for the $++++$ and $ -- -$ helicity channels and the $J=0$, $2$ and $4$ partial waves.


title: Materials Science Ontology Design with an Analytico-Synthetic Facet Analysis Framework

abstract: Researchers across nearly every discipline seek to leverage ontologies for knowledge discovery and computational tasks; yet, the number of machine readable materials science ontologies is limited. The work presented in this paper explores the Processing, Structure, Properties and Performance (PSPP) framework for accelerating the development of materials science ontologies. We pursue a case study framed by the creation of an Aerogel ontology and a Battery Cathode ontology and demonstrate the Helping Interdisciplinary Vocabulary Engineer for Materials Science (HIVE4MAT) as a proof of concept showing PSPP relationships. The paper includes background context covering materials science, the PSPP framework, and faceted analysis for ontologies. We report our research objectives, methods, research procedures, and results. The findings indicate that the PSPP framework offers a rubric that may help guide and potentially accelerate ontology development.


title: CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flow

abstract: Despite impressive performance for high-level downstream tasks, self-supervised pre-training methods have not yet fully delivered on dense geometric vision tasks such as stereo matching or optical flow. The application of self-supervised concepts, such as instance discrimination or masked image modeling, to geometric tasks is an active area of research. In this work, we build on the recent cross-view completion framework, a variation of masked image modeling that leverages a second view from the same scene which makes it well suited for binocular downstream tasks. The applicability of this concept has so far been limited in at least two ways: (a) by the difficulty of collecting real-world image pairs -- in practice only synthetic data have been used -- and (b) by the lack of generalization of vanilla transformers to dense downstream tasks for which relative position is more meaningful than absolute position. We explore three avenues of improvement. First, we introduce a method to collect suitable real-world image pairs at large scale. Second, we experiment with relative positional embeddings and show that they enable vision transformers to perform substantially better. Third, we scale up vision transformer based cross-completion architectures, which is made possible by the use of large amounts of data. With these improvements, we show for the first time that state-of-the-art results on stereo matching and optical flow can be reached without using any classical task-specific techniques like correlation volume, iterative estimation, image warping or multi-scale reasoning, thus paving the way towards universal vision models.


title: AXI-Pack: Near-Memory Bus Packing for Bandwidth-Efficient Irregular Workloads

abstract: Data-intensive applications involving irregular memory streams are inefficiently handled by modern processors and memory systems highly optimized for regular, contiguous data. Recent work tackles these inefficiencies in hardware through core-side stream extensions or memory-side prefetchers and accelerators, but fails to provide end-to-end solutions which also achieve high efficiency in on-chip interconnects. We propose AXI-Pack, an extension to ARM's AXI4 protocol introducing bandwidth-efficient strided and indirect bursts to enable end-to-end irregular streams. AXI-Pack adds irregular stream semantics to memory requests and avoids inefficient narrow-bus transfers by packing multiple narrow data elements onto a wide bus. It retains full compatibility with AXI4 and does not require modifications to non-burst-reshaping interconnect IPs. To demonstrate our approach end-to-end, we extend an open-source RISC-V vector processor to leverage AXI-Pack at its memory interface for strided and indexed accesses. On the memory side, we design a banked memory controller efficiently handling AXI-Pack requests. On a system with a 256-bit-wide interconnect running FP32 workloads, AXI-Pack achieves near-ideal peak on-chip bus utilizations of 87% and 39%, speedups of 5.4x and 2.4x, and energy efficiency improvements of 5.3x and 2.1x over a baseline using an AXI4 bus on strided and indirect benchmarks, respectively.


title: Theory of Linewidth-Narrowing in Fano Lasers

abstract: We present a general theory for the coherence of Fano lasers based on a bound state in the continuum. We find that such lasers enable orders of magnitude reduction of the quantum-limited linewidth, and by introducing mirror symmetry breaking, the linewidth can be further reduced. In contrast to ordinary macroscopic lasers, though, the linewidth may re-broaden due to optical nonlinearities enhanced by the strong light localization. This leads to the identification of optimal material systems. We also show that the coherence of this new type of microscopic laser can be understood intuitively using a simple, effective potential model. Based on this model, we examine the laser stability and deduce the dependence of the laser linewidth on the general Fano lineshape. Our model facilitates the incorporation of other degrees of design freedom and can be applied to a general class of lasers with strongly dispersive mirrors.


title: CITADEL: Conditional Token Interaction via Dynamic Lexical Routing for Efficient and Effective Multi-Vector Retrieval

abstract: Multi-vector retrieval methods combine the merits of sparse (e.g. BM25) and dense (e.g. DPR) retrievers and have achieved state-of-the-art performance on various retrieval tasks. These methods, however, are orders of magnitude slower and need much more space to store their indices compared to their single-vector counterparts. In this paper, we unify different multi-vector retrieval models from a token routing viewpoint and propose conditional token interaction via dynamic lexical routing, namely CITADEL, for efficient and effective multi-vector retrieval. CITADEL learns to route different token vectors to the predicted lexical ``keys'' such that a query token vector only interacts with document token vectors routed to the same key. This design significantly reduces the computation cost while maintaining high accuracy. Notably, CITADEL achieves the same or slightly better performance than the previous state of the art, ColBERT-v2, on both in-domain (MS MARCO) and out-of-domain (BEIR) evaluations, while being nearly 40 times faster. Code and data are available at https://github.com/facebookresearch/dpr-scale.


title: Video Unsupervised Domain Adaptation with Deep Learning: A Comprehensive Survey

abstract: Video analysis tasks such as action recognition have received increasing research interest with growing applications in fields such as smart healthcare, thanks to the introduction of large-scale datasets and deep learning-based representations. However, video models trained on existing datasets suffer from significant performance degradation when deployed directly to real-world applications due to domain shifts between the training public video datasets (source video domains) and real-world videos (target video domains). Further, with the high cost of video annotation, it is more practical to use unlabeled videos for training. To tackle performance degradation and address concerns in high video annotation cost uniformly, the video unsupervised domain adaptation (VUDA) is introduced to adapt video models from the labeled source domain to the unlabeled target domain by alleviating video domain shift, improving the generalizability and portability of video models. This paper surveys recent progress in VUDA with deep learning. We begin with the motivation of VUDA, followed by its definition, and recent progress of methods for both closed-set VUDA and VUDA under different scenarios, and current benchmark datasets for VUDA research. Eventually, future directions are provided to promote further VUDA research.


title: TSN-FlexTest: Flexible TSN Measurement Testbed (Extended Version)

abstract: Robust, reliable, and deterministic networks are essential for a variety of applications. In order to provide guaranteed communication network services, Time-Sensitive Networking (TSN) unites a set of standards for time-synchronization, flow control, enhanced reliability, and management. We design the TSN-FlexTest testbed with generic commodity hardware and open-source software components to enable flexible TSN measurements. We have conducted extensive measurements to validate the TSN-FlexTest testbed and to examine TSN characteristics. The measurements provide insights into the effects of TSN configurations, such as increasing the number of synchronization messages for the Precision Time Protocol, indicating that a measurement accuracy of 15 ns can be achieved. The TSN measurements included extensive evaluations of the Time-aware Shaper (TAS) for sets of Tactile Internet (TI) packet traffic streams. The measurements elucidate the effects of different scheduling and shaping approaches, while revealing the need for pervasive network control that synchronizes the sending nodes with the network switches. We present the first measurements of distributed TAS with synchronized senders on a commodity hardware testbed, demonstrating the same Quality-of-Service as with dedicated wires for high-priority TI streams despite a 200% over-saturation cross traffic load. The testbed is provided as an open-source project to facilitate future TSN research.


title: Particle creation and the Schwinger model

abstract: We study the particle creation process in the Schwinger model coupled with an external classical source. One can approach the problem by taking advantage that the full quantized model is solvable and equivalent to a (massive) gauge field with a non-local effective action. Alternatively, one can also face the problem following the standard semiclassical route. This means quantizing the massless Dirac field and considering the electromagnetic field as a classical background. We evaluate the energy created by a generic, homogeneous, and time-dependent source. The results exactly match in both approaches. This proves in a very direct and economical way the validity of the semiclassical approach for the (massless) Schwinger model, in agreement with previous analysis based on the linear response equation. Our discussion suggests that a similar analysis for the massive Schwinger model could be used as a non-trivial laboratory to confront a fully quantized solvable model with its semiclassical approximation, therefore mimicking the long-standing confrontation of quantum gravity with quantum field theory in curved spacetime.


title: Intelligent Reflecting Surface assisted Integrated Sensing and Communication System

abstract: High-speed communication and accurate sensing are of vital importance for future transportation system. Integrated sensing and communication (ISAC) system has the advantages of high spectrum efficiency and low hardware cost, satisfying the requirements of sensing and communication. Therefore, ISAC is considered to be a promising technology in the future transportation system. However, due to the low transmit power of signal and the influence of harsh transmission environment on radar sensing, the signal to noise ratio (SNR) at the radar receiver is low, which affects the sensing performance. This paper introduces the intelligent reflecting surface (IRS) into ISAC system. With IRS composed of M sub-surfaces implemented on the surface of the target. The SNR at the radar receiver is 20lg(M) times larger than the scheme without IRS. Correspondingly, radar detection probability is significantly improved, and Cramer-Rao Lower Bound (CRLB) for ranging and velocity estimation is reduced. This paper proves the efficiency of IRS enabled ISAC system, which motivates the implementation of IRS to enhance the sensing capability in ISAC system.


title: Inverse Design of Nanophotonic Devices using Dynamic Binarization

abstract: The complexity of applications addressed with photonic integrated circuits is steadily rising and poses increasingly challenging demands on individual component functionality, performance and footprint. Inverse design methods have recently shown great promise to address these demands using fully automated design procedures that enable access to non-intuitive device layouts beyond conventional nanophotonic design concepts. Here we present a dynamic binarization method for the objective-first algorithm that lies at the core of the currently most successful inverse design algorithms. Our results demonstrate significant performance advantages over previous implementations of objective first algorithms, which we show for a fundamental TE00 to TE20 waveguide mode converter both in simulation and in experiments with fabricated devices.


title: The change in the direction of the electric field using the Lorentz-type transformation

abstract: In the present work, we will derive the expression for the change in direction of the electric field using the Lorentz transformation for inertial frame or un-accelerated frame. The acceleration also influences the observed rate of a moving clock in addition to the influence due to its velocity. So we will also derive the expression for the change in direction of the electric field using the Lorentz-type transformation (as given by Friedman) for non-inertial frame or uniformly accelerated frame.


title: Sample-efficient Quantum Born Machine through Coding Rate Reduction

abstract: The quantum circuit Born machine (QCBM) is a quantum physics inspired implicit generative model naturally suitable for learning binary images, with a potential advantage of modeling discrete distributions that are hard to simulate classically. As data samples are generated quantum-mechanically, QCBMs encompass a unique optimization landscape. However, pioneering works on QCBMs do not consider the practical scenario where only small batch sizes are allowed during training. QCBMs trained with a statistical two-sample test objective in the image space require large amounts of projective measurements to approximate the model distribution well, unpractical for large-scale quantum systems due to the exponential scaling of the probability space. QCBMs trained adversarially against a deep neural network discriminator are proof-of-concept models that face mode collapse. In this work we investigate practical learning of QCBMs. We use the information-theoretic \textit{Maximal Coding Rate Reduction} (MCR$^2$) metric as a second moment matching tool and study its effect on mode collapse in QCBMs. We compute the sampling based gradient of MCR$^2$ with respect to quantum circuit parameters with or without an explicit feature mapping. We experimentally show that matching up to the second moment alone is not sufficient for training the quantum generator, but when combined with the class probability estimation loss, MCR$^2$ is able to resist mode collapse. In addition, we show that adversarially trained neural network kernel for infinite moment matching is also effective against mode collapse. On the Bars and Stripes dataset, our proposed techniques alleviate mode collapse to a larger degree than previous QCBM training schemes, moving one step closer towards practicality and scalability.


title: A Neural Active Inference Model of Perceptual-Motor Learning

abstract: The active inference framework (AIF) is a promising new computational framework grounded in contemporary neuroscience that can produce human-like behavior through reward-based learning. In this study, we test the ability for the AIF to capture the role of anticipation in the visual guidance of action in humans through the systematic investigation of a visual-motor task that has been well-explored -- that of intercepting a target moving over a ground plane. Previous research demonstrated that humans performing this task resorted to anticipatory changes in speed intended to compensate for semi-predictable changes in target speed later in the approach. To capture this behavior, our proposed "neural" AIF agent uses artificial neural networks to select actions on the basis of a very short term prediction of the information about the task environment that these actions would reveal along with a long-term estimate of the resulting cumulative expected free energy. Systematic variation revealed that anticipatory behavior emerged only when required by limitations on the agent's movement capabilities, and only when the agent was able to estimate accumulated free energy over sufficiently long durations into the future. In addition, we present a novel formulation of the prior function that maps a multi-dimensional world-state to a uni-dimensional distribution of free-energy. Together, these results demonstrate the use of AIF as a plausible model of anticipatory visually guided behavior in humans.


title: Mirror Sinkhorn: Fast Online Optimization on Transport Polytopes

abstract: Optimal transport is an important tool in machine learning, allowing to capture geometric properties of the data through a linear program on transport polytopes. We present a single-loop optimization algorithm for minimizing general convex objectives on these domains, utilizing the principles of Sinkhorn matrix scaling and mirror descent. The proposed algorithm is robust to noise, and can be used in an online setting. We provide theoretical guarantees for convex objectives and experimental results showcasing it effectiveness on both synthetic and real-world data.


title: CNeRV: Content-adaptive Neural Representation for Visual Data

abstract: Compression and reconstruction of visual data have been widely studied in the computer vision community, even before the popularization of deep learning. More recently, some have used deep learning to improve or refine existing pipelines, while others have proposed end-to-end approaches, including autoencoders and implicit neural representations, such as SIREN and NeRV. In this work, we propose Neural Visual Representation with Content-adaptive Embedding (CNeRV), which combines the generalizability of autoencoders with the simplicity and compactness of implicit representation. We introduce a novel content-adaptive embedding that is unified, concise, and internally (within-video) generalizable, that compliments a powerful decoder with a single-layer encoder. We match the performance of NeRV, a state-of-the-art implicit neural representation, on the reconstruction task for frames seen during training while far surpassing for frames that are skipped during training (unseen images). To achieve similar reconstruction quality on unseen images, NeRV needs 120x more time to overfit per-frame due to its lack of internal generalization. With the same latent code length and similar model size, CNeRV outperforms autoencoders on reconstruction of both seen and unseen images. We also show promising results for visual data compression. More details can be found in the project pagehttps://haochen-rye.github.io/CNeRV/


title: Forecasting labels under distribution-shift for machine-guided sequence design

abstract: The ability to design and optimize biological sequences with specific functionalities would unlock enormous value in technology and healthcare. In recent years, machine learning-guided sequence design has progressed this goal significantly, though validating designed sequences in the lab or clinic takes many months and substantial labor. It is therefore valuable to assess the likelihood that a designed set contains sequences of the desired quality (which often lies outside the label distribution in our training data) before committing resources to an experiment. Forecasting, a prominent concept in many domains where feedback can be delayed (e.g. elections), has not been used or studied in the context of sequence design. Here we propose a method to guide decision-making that forecasts the performance of high-throughput libraries (e.g. containing $10^5$ unique variants) based on estimates provided by models, providing a posterior for the distribution of labels in the library. We show that our method outperforms baselines that naively use model scores to estimate library performance, which are the only tool available today for this purpose.


title: Angstrom-Scale Imaging of Magnetization in Antiferromagnetic Fe$_2$As via 4D-STEM

abstract: We demonstrate a combination of computational tools and experimental 4D-STEM methods to image the local magnetic moment in antiferromagnetic Fe$_2$As with 6 angstrom spatial resolution. Our techniques utilize magnetic diffraction peaks, common in antiferromagnetic materials, to create imaging modes that directly visualize the magnetic lattice. Using this approach, we show that center-of-mass analysis can determine the local magnetization component in the plane perpendicular to the path of the electron beam. Moreover, we develop Magnstem, a quantum mechanical electron scattering simulation code, to model electron scattering of an angstrom-scale probe from magnetic materials. Using these tools, we identify optimal experimental conditions for separating weak magnetic signals from the much stronger interactions of an angstrom-scale probe with electrostatic potentials. Our techniques should be useful for characterizing the local magnetic order in systems such in thin films, interfaces, and domain boundaries of antiferromagnetic materials, which are difficult to probe with existing methods.


title: Quantum theory of light-driven coherent lattice dynamics

abstract: The exposure to intense electromagnetic radiation can induce distortions and symmetry breaking in the crystal structure of solids, providing a route for the all-optical control of their properties. In this manuscript, we formulate a unified theoretical approach to describe the coherent lattice dynamics in presence of external driving fields, electron-phonon and phonon-phonon interactions, and quantum nuclear effects. The main mechanisms for the excitation of coherent phonons - including infrared absorption, displacive excitation, inelastic stimulated Raman scattering, and ionic Raman scattering - can be seamlessly accounted for. We apply this formalism to a model consisting of two coupled phonon modes, where we illustrate the influence of quantum nuclei on structural distortions induced by ionic Raman scattering. Besides validating the widely-employed classical models for the coherent lattice dynamics, our work provides a versatile approach to methodically explore the emergence of quantum nuclear effects in the structural response of crystal lattice to strong fields.


title: Density of $p$-adic polynomials generating extensions with fixed splitting type

abstract: We prove that the density of polynomials $P(x)=\sum_{i=0}^n a_n x^n$ over a local field $K$ generating an \'etale extension with specified splitting type is a rational function in terms of the size of the residue field of $K$ in the case where the splitting type is tame. Moreover, we give a computable recursive formula for these densities and compute the asymptotics of this density as the size of the residue field tends to infinity.


title: Surface-dominated conductance scaling in Weyl semimetal NbAs

abstract: Protected surface states arising from non-trivial bandstructure topology in semimetals can potentially enable new device functionalities in compute, memory, interconnect, sensing, and communication. This necessitates a fundamental understanding of surface-state transport in nanoscale topological semimetals. Here, we investigate quantum transport in a prototypical topological semimetal NbAs to evaluate the potential of this class of materials for beyond-Cu interconnects in highly-scaled integrated circuits. Using density functional theory (DFT) coupled with non-equilibrium Green's function (NEGF) calculations, we show that the resistance-area RA product in NbAs films decreases with decreasing thickness at the nanometer scale, in contrast to a nearly constant RA product in ideal Cu films. This anomalous scaling originates from the disproportionately large number of surface conduction states which dominate the ballistic conductance by up to 70% in NbAs thin films. We also show that this favorable RA scaling persists even in the presence of surface defects, in contrast to RA sharply increasing with reducing thickness for films of conventional metals, such as Cu, in the presence of surface defects. These results underscore the promise of topological semimetals like NbAs as future back-end-of-line (BEOL) interconnect metals.


title: Sharp lower bounds for the number of maximum matchings in bipartite multigraphs

abstract: We study the minimum number of maximum matchings in a bipartite multigraph G with parts $X$ and $Y$ under various conditions, refining the well-known lower bound due to M. Hall. When $|X|=n$, every vertex in $X$ has degree at least $k$, and every vertex in $X$ has at least $r$ distinct neighbors, the minimum is $r!(k-r+1)$ when $n\ge r$ and is $[r+n(k-r)]\prod_{i=1}^{n-1}(r-i)$ when $n<r$. When every vertex has at least two neighbors and $|Y|-|X|=t\ge 0$, the minimum is $[(n-1)t+2+b](t+1)$, where $b=|E(G)|-2(n+t)$. We also determine the minimum number of maximum matchings in several other situations. We provide a variety of sharpness constructions.


title: Mutating signed $\tau$-exceptional sequences

abstract: We establish some properties of $\tau$-exceptional sequences for finite-dimensional algebras. In an earlier paper we established a bijection between the set of ordered support $\tau$-tilting modules and the set of complete signed $\tau$-exceptional sequences. We describe the action of the symmetric group on the latter induced by its natural action on the former. Similarly, we describe the effect on a $\tau$-exceptional sequence obtained by mutating the corresponding ordered support $\tau$-tilting module via a construction of Adachi-Iyama-Reiten.


title: Interface Capturing Flow Boiling Simulations in a Compact Heat Exchanger

abstract: High-fidelity flow boiling simulations are conducted in a vertical minichannel with offset strip fins (OSF) using R113 as a working fluid. Finite-element code PHASTA coupled with level set method for interface capturing is employed to model multiple sequential bubble nucleation using transient three-dimensional approach. The code performance is validated against experiments for a single nucleation site in a vertical rectangular channel. To test the code performance, the studies for a bubble departing from the wall in a minichannel with OSF are carried out first. Due to low heat flux values applied to the channel (1 kW/m2) contribution from the microlayer is not considered. The influence of surface characteristics such as contact angle and liquid superheat on bubble dynamics are analyzed. Local two-phase heat transfer coefficient is also investigated. To achieve higher void fractions, two conic nucleation cavities are introduced in the same channel with OSF. Observed bubble characteristics (departure diameter, bubble departure frequency) are evaluated and bubble trajectories are presented and analyzed. Local heat transfer coefficient is evaluated for each simulation case. The results show approximately 2.5 times increase in the local heat transfer coefficient when individual bubbles approach the wall. With a smaller bubble nucleation diameter, heat transfer coefficient increases by two times. The current work shows the capability of modeling flow boiling phenomena in such complex geometry as OSF as well as data processing advantages of high-resolution simulations.


title: Real time evolution of Anderson impurity models via tensor network influence functionals

abstract: In this work we present and analyze two tensor network-based influence functional approaches for simulating the real-time dynamics of quantum impurity models such as the Anderson model. Via comparison with recent numerically exact simulations, we show that such methods accurately capture the long-time non-equilibrium quench dynamics. The two parameters that must be controlled in these tensor network influence functional approaches are a time discretization (Trotter) error and a bond dimension (tensor network truncation) error. We show that the actual numerical uncertainties are controlled by an intricate interplay of these two approximations which we demonstrate in different regimes. Our work opens the door to using these tensor network influence functional methods as general impurity solvers.


title: Improving ECG-based COVID-19 diagnosis and mortality predictions using pre-pandemic medical records at population-scale

abstract: Pandemic outbreaks such as COVID-19 occur unexpectedly, and need immediate action due to their potential devastating consequences on global health. Point-of-care routine assessments such as electrocardiogram (ECG), can be used to develop prediction models for identifying individuals at risk. However, there is often too little clinically-annotated medical data, especially in early phases of a pandemic, to develop accurate prediction models. In such situations, historical pre-pandemic health records can be utilized to estimate a preliminary model, which can then be fine-tuned based on limited available pandemic data. This study shows this approach -- pre-train deep learning models with pre-pandemic data -- can work effectively, by demonstrating substantial performance improvement over three different COVID-19 related diagnostic and prognostic prediction tasks. Similar transfer learning strategies can be useful for developing timely artificial intelligence solutions in future pandemic outbreaks.


title: Strong cosmological constraints on the neutrino magnetic moment

abstract: A sizable magnetic moment for neutrinos would be evidence of exotic physics. In the early Universe, left-handed neutrinos with a magnetic moment would interact with electromagnetic fields in the primordial plasma, flipping their helicity and producing a population of right-handed (RH) neutrinos. In this work, we present a new calculation of the production rate of RH neutrinos in a multi-component primordial plasma and quantify their contribution to the total energy density of relativistic species at early times, stressing the implications of the dependence on the initial time for production. Our results improve the previous cosmological limits by almost two orders of magnitudes. Prospects for upcoming cosmological experiments are also discussed.


title: Bremsstrahlung High-frequency Gravitational Wave Signatures of High-scale Non-thermal Leptogenesis

abstract: Inflaton seeds non-thermal leptogenesis by pair producing right-handed neutrinos in the seesaw model. We show that the inevitable graviton bremsstrahlung associated with inflaton decay can be a unique probe of non-thermal leptogenesis. The emitted gravitons contribute to a high-frequency stochastic gravitational waves background with a characteristic fall-off below the peak frequency. Besides leading to a lower bound on the frequency ($f\gtrsim 10^{11}$ Hz), the seesaw-perturbativity condition makes the mechanism sensitive to the lightest neutrino mass. For an inflaton mass close to the Planck scale, the gravitational waves contribute to sizeable dark radiation, which is within the projected sensitivity limits of future experiments such as CMB-S4 and CMB-HD.


title: Convexity for free boundaries with singular term (nonlinear elliptic case)

abstract: We consider a free boundary problem in an exterior domain \begin{cases}\begin{array}{cc} Lu=g(u) & \text{in }\Omega\setminus K, \\ u=1 & \text{on }\partial K,\\ |\nabla u|=0 &\text{on }\partial \Omega, \end{array}\end{cases} where $K$ is a (given) convex and compact set in $\mathbb{R}^n$ ($n\ge2$), $\Omega=\{u>0\}\supset K$ is an unknown set, and $L$ is either a fully nonlinear or the $p$-Laplace operator. Under suitable assumptions on $K$ and $g$, we prove the existence of a nonnegative quasi-concave solution to the above problem. We also consider the cases when the set $K$ is contained in $\{x_n=0\}$, and obtain similar results.


title: PAL: Program-aided Language Models

abstract: Large language models (LLMs) have recently demonstrated an impressive ability to perform arithmetic and symbolic reasoning tasks, when provided with a few examples at test time ("few-shot prompting"). Much of this success can be attributed to prompting methods such as "chain-of-thought'', which employ LLMs for both understanding the problem description by decomposing it into steps, as well as solving each step of the problem. While LLMs seem to be adept at this sort of step-by-step decomposition, LLMs often make logical and arithmetic mistakes in the solution part, even when the problem is decomposed correctly. In this paper, we present Program-Aided Language models (PAL): a novel approach that uses the LLM to read natural language problems and generate programs as the intermediate reasoning steps, but offloads the solution step to a runtime such as a Python interpreter. With PAL, decomposing the natural language problem into runnable steps remains the only learning task for the LLM, while solving is delegated to the interpreter. We demonstrate this synergy between a neural LLM and a symbolic interpreter across 13 mathematical, symbolic, and algorithmic reasoning tasks from BIG-Bench Hard and other benchmarks. In all these natural language reasoning tasks, generating code using an LLM and reasoning using a Python interpreter leads to more accurate results than much larger models. For example, PAL using Codex achieves state-of-the-art few-shot accuracy on the GSM8K benchmark of math word problems, surpassing PaLM-540B which uses chain-of-thought by absolute 15% top-1. Our code and data are publicly available at http://reasonwithpal.com/ .


title: Squeezing and overcoming the Heisenberg scaling with spin-orbit coupled quantum gases

abstract: We predict that exploiting spin-orbit coupling in a harmonically trapped spinor quantum gas can lead to scaling of the optimal measurement precision beyond the Heisenberg scaling. We show that quadratic scaling with the number of atoms can be facilitated via squeezed center-of-mass excitations of the atomic motion using a 1D spin-orbit coupled fermions or strongly interacting bosons (Tonks-Girardeau gas). Based on predictions derived from analytic calculations of the corresponding quantum Fisher information, we then introduce a protocol which overcomes the Heisenberg scaling (and limit) with help of a tailored excited and entangled many-body state of a non-interacting Bose-Einstein condensate. We identify corresponding optimal measurements and argue that even finite temperature as a source of decoherence is, in principle, rather favorable for the obtainable precision scaling.


title: A Structure-Guided Diffusion Model for Large-Hole Image Completion

abstract: Image completion techniques have made significant progress in filling missing regions (i.e., holes) in images. However, large-hole completion remains challenging due to limited structural information. In this paper, we address this problem by integrating explicit structural guidance into diffusion-based image completion, forming our structure-guided diffusion model (SGDM). It consists of two cascaded diffusion probabilistic models: structure and texture generators. The structure generator generates an edge image representing plausible structures within the holes, which is then used for guiding the texture generation process. To train both generators jointly, we devise a novel strategy that leverages optimal Bayesian denoising, which denoises the output of the structure generator in a single step and thus allows backpropagation. Our diffusion-based approach enables a diversity of plausible completions, while the editable edges allow for editing parts of an image. Our experiments on natural scene (Places) and face (CelebA-HQ) datasets demonstrate that our method achieves a superior or comparable visual quality compared to state-of-the-art approaches. The code is available for research purposes at https://github.com/UdonDa/Structure_Guided_Diffusion_Model.


title: SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

abstract: Large language models (LLMs) show excellent performance but are compute- and memory-intensive. Quantization can reduce memory and accelerate inference. However, existing methods cannot maintain accuracy and hardware efficiency at the same time. We propose SmoothQuant, a training-free, accuracy-preserving, and general-purpose post-training quantization (PTQ) solution to enable 8-bit weight, 8-bit activation (W8A8) quantization for LLMs. Based on the fact that weights are easy to quantize while activations are not, SmoothQuant smooths the activation outliers by offline migrating the quantization difficulty from activations to weights with a mathematically equivalent transformation. SmoothQuant enables an INT8 quantization of both weights and activations for all the matrix multiplications in LLMs, including OPT, BLOOM, GLM, MT-NLG, Llama-1/2, Falcon, Mistral, and Mixtral models. We demonstrate up to 1.56x speedup and 2x memory reduction for LLMs with negligible loss in accuracy. SmoothQuant enables serving 530B LLM within a single node. Our work offers a turn-key solution that reduces hardware costs and democratizes LLMs. Code is available at https://github.com/mit-han-lab/smoothquant.


title: BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervision

abstract: We present a novel bird's-eye-view (BEV) detector with perspective supervision, which converges faster and better suits modern image backbones. Existing state-of-the-art BEV detectors are often tied to certain depth pre-trained backbones like VoVNet, hindering the synergy between booming image backbones and BEV detectors. To address this limitation, we prioritize easing the optimization of BEV detectors by introducing perspective space supervision. To this end, we propose a two-stage BEV detector, where proposals from the perspective head are fed into the bird's-eye-view head for final predictions. To evaluate the effectiveness of our model, we conduct extensive ablation studies focusing on the form of supervision and the generality of the proposed detector. The proposed method is verified with a wide spectrum of traditional and modern image backbones and achieves new SoTA results on the large-scale nuScenes dataset. The code shall be released soon.


title: Magic3D: High-Resolution Text-to-3D Content Creation

abstract: DreamFusion has recently demonstrated the utility of a pre-trained text-to-image diffusion model to optimize Neural Radiance Fields (NeRF), achieving remarkable text-to-3D synthesis results. However, the method has two inherent limitations: (a) extremely slow optimization of NeRF and (b) low-resolution image space supervision on NeRF, leading to low-quality 3D models with a long processing time. In this paper, we address these limitations by utilizing a two-stage optimization framework. First, we obtain a coarse model using a low-resolution diffusion prior and accelerate with a sparse 3D hash grid structure. Using the coarse representation as the initialization, we further optimize a textured 3D mesh model with an efficient differentiable renderer interacting with a high-resolution latent diffusion model. Our method, dubbed Magic3D, can create high quality 3D mesh models in 40 minutes, which is 2x faster than DreamFusion (reportedly taking 1.5 hours on average), while also achieving higher resolution. User studies show 61.7% raters to prefer our approach over DreamFusion. Together with the image-conditioned generation capabilities, we provide users with new ways to control 3D synthesis, opening up new avenues to various creative applications.