title: Identifying and Characterizing the Most Heavily Dust-Obscured Galaxies at $1 \le z \le 4$

abstract: We present 65 extremely dust-obscured galaxies from the UltraVISTA DR3 survey of the COSMOS field at $1<z<4$. In contrast to other studies of dusty galaxies, we select our sample based on dust attenuation measured by UV-MIR spectral energy distribution (SED) modeling that allows for extreme attenuation levels. We construct our sample by making cuts at $1 \le z \le 4$, A$_V \ge 3$, and log(M$_*$/M$_\odot$)$ \ge 10.5$. This method reliably selects galaxies exhibiting independent indicators of significant dust content, including FIR detection rates. We perform panchromatic SED modeling with matched $Herschel$ photometry and find stellar and dust properties that differ from typical sub-millimeter galaxy (SMG) samples as well as $Herschel$ sources matched in redshift and stellar mass. Our sources have lower star formation rates and higher A$_V$ than SMGs, but comparable total IR luminosities. Most of our sample falls on or near the star-forming main sequence for this redshift range. Finally, we perform a morphological analysis with GALFIT using the $K_S$-band images and $Hubble$ $F814W$ and $F160W$ imaging when available. Typical axis ratios of $\sim 0.4$ suggest disk-like morphology for the majority of our sources, and we note only three apparent merging systems. Our sample generally agrees with the size-mass relation for star-forming galaxies, with a tail extending to smaller sizes. We conclude that the most heavily obscured galaxies in this redshift range share many characteristics with typical star-forming galaxies, forming a population of dusty galaxies that overlaps, but is not encompassed by, those selected through dust emission.


title: The unique coclique extension property for apartments of buildings

abstract: We show that the Kneser graph of objects of a fixed type in a building of spherical type has the unique coclique extension property when the corresponding representation has minuscule weight and also when the diagram is simply laced and the representation is adjoint.


title: On the principal series of potassium

abstract: We revisit the photoabsorption from the ground state of K through the first ionization limit, and provide recommended values for the optical oscillator strengths. The anomaly in the oscillator strength ratio within each doublet is also revisited and compared with both the experimental data available and the relativistic calculations available.


title: Effect of topology on the collapse transition and the instantaneous shape of a model heteropolymer

abstract: The effect of topology on the collapse transition and instantaneous shape of an energy polydisperse polymer (a model heteropolymer) is studied by means of computer simulations. In particular, we consider three different chain topology, namely, linear (L), ring (R) and trefoil knot (T). The heteropolymer is modeled by assigning each monomer an interaction parameter, $\varepsilon_i$, drawn randomly from a Gaussian distribution. Through chain size scaling the transition temperature, $\theta$, is located and compared among the chains of different topogies. The influence of topology is reflected in the value of $\theta$ and observed that $\theta(\text{L}) > \theta(\text{R}) > \theta(\text{T})$ in a similar fashion to that of the homopolymer counterpart. Also studied chain size distributions, and the shape changes across the transition temperature characterised through shape parameters based on the eigenvalues of the gyration tensor. It is observed that, for the model heteropolymer, in addition to chain topology the $\theta$-temperature also depends on energy polydispersity.


title: Inferring Maps of the Sun's Far-side Unsigned Magnetic Flux from Far-side Helioseismic Images using Machine Learning Techniques

abstract: Accurate modeling of the Sun's coronal magnetic field and solar wind structures require inputs of the solar global magnetic field, including both the near and far sides, but the Sun's far-side magnetic field cannot be directly observed. However, the Sun's far-side active regions are routinely monitored by helioseismic imaging methods, which only require continuous near-side observations. It is therefore both feasible and useful to estimate the far-side magnetic-flux maps using the far-side helioseismic images despite their relatively low spatial resolution and large uncertainties. In this work, we train two machine-learning models to achieve this goal. The first machine-learning training pairs simultaneous SDO/HMI-observed magnetic-flux maps and SDO/AIA-observed EUV 304$\r{A}$ images, and the resulting model can convert 304$\r{A}$ images into magnetic-flux maps. This model is then applied on the STEREO/EUVI-observed far-side 304$\r{A}$ images, available for about 4.3 years, for the far-side magnetic-flux maps. These EUV-converted magnetic-flux maps are then paired with simultaneous far-side helioseismic images for a second machine-learning training, and the resulting model can convert far-side helioseismic images into magnetic-flux maps. These helioseismically derived far-side magnetic-flux maps, despite their limitations in spatial resolution and accuracy, can be routinely available on a daily basis, providing useful magnetic information on the Sun's far side using only the near-side observations.


title: Joint Secure Communication and Radar Beamforming: A Secrecy-Estimation Rate-Based Design

abstract: This paper considers transmit beamforming in dual-function radar-communication (DFRC) system, where a DFRC transmitter simultaneously communicates with a communication user and detects a malicious target with the same waveform. Since the waveform is embedded with information, the information is risked to be intercepted by the target. To address this problem, physical-layer security technique is exploited. By using secrecy rate and estimation rate as performance measure for communication and radar, respectively, three secrecy rate maximization (SRM) problems are formulated, including the SRM with and without artificial noise (AN), and robust SRM. For the SRM beamforming, we prove that the optimal beamformer can be computed in closed form. For the AN-aided SRM, by leveraging alternating optimization similar closed-form solution is obtained for the beamformer and the AN covariance matrix. Finally, the imperfect CSI of the target is also considered under the premise of a moment-based random phase-error model on the direction of arrival at the target. Simulation results demonstrate the efficacy and robustness of the proposed designs.


title: DyRRen: A Dynamic Retriever-Reranker-Generator Model for Numerical Reasoning over Tabular and Textual Data

abstract: Numerical reasoning over hybrid data containing tables and long texts has recently received research attention from the AI community. To generate an executable reasoning program consisting of math and table operations to answer a question, state-of-the-art methods use a retriever-generator pipeline. However, their retrieval results are static, while different generation steps may rely on different sentences. To attend to the retrieved information that is relevant to each generation step, in this paper, we propose DyRRen, an extended retriever-reranker-generator framework where each generation step is enhanced by a dynamic reranking of retrieved sentences. It outperforms existing baselines on the FinQA dataset.


title: Revenue Comparisons of Auctions with Ambiguity Averse Sellers

abstract: We study the revenue comparison problem of auctions when the seller has a maxmin expected utility preference. The seller holds a set of priors around some reference belief, interpreted as an approximating model of the true probability law or the focal point distribution. We develop a methodology for comparing the revenue performances of auctions: the seller prefers auction X to auction Y if their transfer functions satisfy a weak form of the single-crossing condition. Intuitively, this condition means that a bidder's payment is more negatively associated with the competitor's type in X than in Y. Applying this methodology, we show that when the reference belief is independent and identically distributed (IID) and the bidders are ambiguity neutral, (i) the first-price auction outperforms the second-price and all-pay auctions, and (ii) the second-price and all-pay auctions outperform the war of attrition. Our methodology yields results opposite to those of the Linkage Principle.


title: Expressibility-Enhancing Strategies for Quantum Neural Networks

abstract: Quantum neural networks (QNNs), represented by parameterized quantum circuits, can be trained in the paradigm of supervised learning to map input data to predictions. Much work has focused on theoretically analyzing the expressive power of QNNs. However, in almost all literature, QNNs' expressive power is numerically validated using only simple univariate functions. We surprisingly discover that state-of-the-art QNNs with strong expressive power can have poor performance in approximating even just a simple sinusoidal function. To fill the gap, we propose four expressibility-enhancing strategies for QNNs: Sinusoidal-friendly embedding, redundant measurement, post-measurement function, and random training data. We analyze the effectiveness of these strategies via mathematical analysis and/or numerical studies including learning complex sinusoidal-based functions. Our results from comparative experiments validate that the four strategies can significantly increase the QNNs' performance in approximating complex multivariable functions and reduce the quantum circuit depth and qubits required.


title: 3-D Positioning and Resource Allocation for Multi-UAV Base Stations Under Blockage-Aware Channel Model

abstract: In this paper, we propose to deploy multiple unmanned aerial vehicle (UAV) mounted base stations to serve ground users in outdoor environments with obstacles. In particular, the geographic information is employed to capture the blockage effects for air-to-ground (A2G) links caused by buildings, and a realistic blockage-aware A2G channel model is proposed to characterize the continuous variation of the channels at different locations. Based on the proposed channel model, we formulate the joint optimization problem of UAV three-dimensional (3-D) positioning and resource allocation, by power allocation, user association, and subcarrier allocation, to maximize the minimum achievable rate among users. To solve this non-convex combinatorial programming problem, we introduce a penalty term to relax it and develop a suboptimal solution via a penalty-based double-loop iterative optimization framework. The inner loop solves the penalized problem by employing the block successive convex approximation (BSCA) technique, where the UAV positioning and resource allocation are alternately optimized in each iteration. The outer loop aims to obtain proper penalty multipliers to ensure the solution of the penalized problem converges to that of the original problem. Simulation results demonstrate the superiority of the proposed algorithm over other benchmark schemes in terms of the minimum achievable rate.


title: Quantum Otto engine with quantum correlations

abstract: We theoretically prose and investigate a photo-Otto engine that is working with a single-mode radiation field inside an optical cavity and alternatively driven by a hot and a cold reservoir, where the hot reservoir is realized by sending one of a pair of correlated two-level atoms to pass through the optical cavity, and the cold one is made of a collection of noninteracting boson modes. In terms of the quantum discord of the pair of atoms, we derive the analytical expressions for the performance parameters (power and efficiency) and stability measure (coefficient of variation for power). We show that quantum discord boosts the performance and efficiency of the quantum engine, and even may change the operation mode. We also demonstrate that quantum discord improves the stability of machine by decreasing the coefficient of variation for power which satisfies the generalized thermodynamic uncertainty relation. Finally, we find that these results can be transferred to another photo-Otto engine model, where the optical cavity is alternatively coupled to a hot thermal bosonic bath and to a beam of pairs of the two correlated atoms that play the role of a cold reservoir.


title: Mechanical Theory of Nonequilibrium Coexistence and Motility-Induced Phase Separation

abstract: Nonequilibrium phase transitions are routinely observed in both natural and synthetic systems. The ubiquity of these transitions highlights the conspicuous absence of a general theory of phase coexistence that is broadly applicable to both nonequilibrium and equilibrium systems. Here, we present a general mechanical theory for phase separation rooted in ideas explored nearly a half-century ago in the study of inhomogeneous fluids. The core idea is that the mechanical forces within the interface separating two coexisting phases uniquely determine coexistence criteria, regardless of whether a system is in equilibrium or not. We demonstrate the power and utility of this theory by applying it to active Brownian particles, predicting a quantitative phase diagram for motility-induced phase separation in both two and three dimensions. This formulation additionally allows for the prediction of novel interfacial phenomena, such as an increasing interface width while moving deeper into the two-phase region, a uniquely nonequilibrium effect confirmed by computer simulations. The self-consistent determination of bulk phase behavior and interfacial phenomena offered by this mechanical perspective provide a concrete path forward towards a general theory for nonequilibrium phase transitions.


title: Semantic-aware One-shot Face Re-enactment with Dense Correspondence Estimation

abstract: One-shot face re-enactment is a challenging task due to the identity mismatch between source and driving faces. Specifically, the suboptimally disentangled identity information of driving subjects would inevitably interfere with the re-enactment results and lead to face shape distortion. To solve this problem, this paper proposes to use 3D Morphable Model (3DMM) for explicit facial semantic decomposition and identity disentanglement. Instead of using 3D coefficients alone for re-enactment control, we take the advantage of the generative ability of 3DMM to render textured face proxies. These proxies contain abundant yet compact geometric and semantic information of human faces, which enable us to compute the face motion field between source and driving images by estimating the dense correspondence. In this way, we could approximate re-enactment results by warping source images according to the motion field, and a Generative Adversarial Network (GAN) is adopted to further improve the visual quality of warping results. Extensive experiments on various datasets demonstrate the advantages of the proposed method over existing start-of-the-art benchmarks in both identity preservation and re-enactment fulfillment.


title: Comparison of the Core-Collapse Evolution of Two Nearly Equal Mass Progenitors

abstract: We compare the core-collapse evolution of a pair of 15.8 $M_\odot$ stars with significantly different internal structures, a consequence of bimodal variability exhibited by massive stars during their late evolutionary stages. The 15.78 and 15.79 $M_\odot $ progenitors have core masses of 1.47 and 1.78 $M_\odot$ and compactness parameters $\xi_{1.75}$ of 0.302 and 0.604. The core collapse simulations are carried out in 2D to nearly 3 s post-bounce and show substantial differences in the times of shock revival and explosion energies. The 15.78 $M_\odot$ model explodes promptly at 120 ms post-bounce when a strong density decrement at the Si--Si/O shell interface encounters the stalled shock. The 15.79 $M_\odot$ model, which lacks the density decrement, takes 100 ms longer to explode but ultimately produces a more powerful explosion. Larger mass accretion rate of the 15.79 $M_\odot$ model during the first 0.8 s post-bounce results in larger $\nu_{e}$/$\bar \nu_{e}$ luminosities and rms energies. The $\nu_{e}$/$\bar \nu_{e}$ luminosities and rms energies arising from the inner core are also larger in the 15.79 $M_\odot$ model throughout due to the larger negative temperature gradient of this core due to greater adiabatic compression. Larger luminosities and rms energies in the 15.79 $M_\odot$ model and a flatter and higher density heating region, result in more energy deposition behind the shock and more ejected matter with higher enthalpy. We find the ejected $^{56}$Ni mass of the 15.79 $M_\odot$ model is more than double that of the 15.78 $M_\odot$ model. Most of the ejecta in both models is moderately proton-rich, though counterintuitively the highest electron fraction ($Y_e=0.61$) ejecta in either model is in the less energetic 15.78 $M_\odot$ model while the lowest electron fraction ($Y_e=0.45$) ejecta in either model is in the 15.79 $M_\odot$ model.


title: The essential role of multi-point measurements in investigations of turbulence, three-dimensional structure, and dynamics: the solar wind beyond single scale and the Taylor Hypothesis

abstract: Space plasmas are three-dimensional dynamic entities. Except under very special circumstances, their structure in space and their behavior in time are not related in any simple way. Therefore, single spacecraft in situ measurements cannot unambiguously unravel the full space-time structure of the heliospheric plasmas of interest in the inner heliosphere, in the Geospace environment, or the outer heliosphere. This shortcoming leaves numerous central questions incompletely answered. Deficiencies remain in at least two important subjects, Space Weather and fundamental plasma turbulence theory, due to a lack of a more complete understanding of the space-time structure of dynamic plasmas. Only with multispacecraft measurements over suitable spans of spatial separation and temporal duration can these ambiguities be resolved. We note that these characterizations apply to turbulence across a wide range of scales, and also equally well to shocks, flux ropes, magnetic clouds, current sheets, stream interactions, etc. In the following, we will describe the basic requirements for resolving space-time structure in general, using turbulence' as both an example and a principal target or study. Several types of missions are suggested to resolve space-time structure throughout the Heliosphere.


title: Word-Level Representation From Bytes For Language Modeling

abstract: Modern language models mostly take sub-words as input, a design that balances the trade-off between vocabulary size, number of parameters, and performance. However, sub-word tokenization still has disadvantages like not being robust to noise and difficult to generalize to new languages. Also, the current trend of scaling up models reveals that larger models require larger embeddings but that makes parallelization hard. Previous work on image classification proves splitting raw input into a sequence of chucks is a strong, model-agnostic inductive bias. Based on this observation, we rethink the existing character-aware method that takes character-level inputs but makes word-level sequence modeling and prediction. We overhaul this method by introducing a cross-attention network that builds word-level representation directly from bytes, and a sub-word level prediction based on word-level hidden states to avoid the time and space requirement of word-level prediction. With these two improvements combined, we have a token free model with slim input embeddings for downstream tasks. We name our method Byte2Word and perform evaluations on language modeling and text classification. Experiments show that Byte2Word is on par with the strong sub-word baseline BERT but only takes up 10\% of embedding size. We further test our method on synthetic noise and cross-lingual transfer and find it competitive to baseline methods on both settings.


title: The Preservation of Convexity by Geodesics in the Space of K\"ahler Potentials on Complex Affine Manifolds

abstract: On a compact complex affine manifold with a constant coefficient K\"ahler metric $\omega_0$, we introduce a concept: $(S,\omega_0)$-convexity and show that $(S,\omega_0)$-convexity is preserved by geodesics in the space of K\"ahler potentials. This implies that if two potentials are both strictly $(S,\omega_0)$-convex, then the metrics along the geodesic connecting them are non-degenerate.


title: New Classes of Quasigeodesic Anosov Flows in $3$-Manifolds

abstract: Quasigeodesic behavior of flow lines is a very useful property in the study of Anosov flows. Not every Anosov flow in dimension three is quasigeodesic. In fact up to orbit equivalence, the only previously known examples of quasigeodesic Anosov flows were suspension flows. In this article, we prove that a new class of examples are quasigeodesic. These are the first examples of quasigeodesic Anosov flows on three manifolds that are neither Seifert, nor solvable, nor hyperbolic. In general, it is very hard to show that a given flow in quasigeodesic, and in this article we provide a new method to prove that an Anosov flow is quasigeodesic.


title: Triple excitations in Green's function coupled cluster solver for studies of strongly correlated systems in the framework of self-energy embedding theory

abstract: Embedding theories became important approaches used for accurate calculations of both molecules and solids. In these theories, a small chosen subset of orbitals is treated with an accurate method, called an impurity solver, capable of describing higher correlation effects. Ideally, such a chosen fragment should contain multiple orbitals responsible for the chemical and physical behavior of the compound. Handing a large number of chosen orbitals presents a very significant challenge for the current generation of solvers used in the physics and chemistry community. Here, we develop a Green's function coupled cluster singles doubles and triples (GFCCSDT) solver that can be used for a quantitative description in both molecules and solids. This solver allows us to treat orbital spaces that are inaccessible to other accurate solvers. At the same time, GFCCSDT maintains high accuracy of the resulting self-energy. Moreover, in conjunction with the GFCCSD solver, it allows us to test the systematic convergence of computational studies. Developing the CC family of solvers paves the road to fully systematic Green's function embedding calculations in solids. In this paper, we focus on the investigation of GFCCSDT self-energies for a strongly correlated problem of SrMnO$_3$ solid. Subsequently, we apply this solver to solid MnO showing that an approximate variant of GFCCSDT is capable of yielding a high accuracy orbital resolved spectral function.


title: Benchmarking Adversarially Robust Quantum Machine Learning at Scale

abstract: Machine learning (ML) methods such as artificial neural networks are rapidly becoming ubiquitous in modern science, technology and industry. Despite their accuracy and sophistication, neural networks can be easily fooled by carefully designed malicious inputs known as adversarial attacks. While such vulnerabilities remain a serious challenge for classical neural networks, the extent of their existence is not fully understood in the quantum ML setting. In this work, we benchmark the robustness of quantum ML networks, such as quantum variational classifiers (QVC), at scale by performing rigorous training for both simple and complex image datasets and through a variety of high-end adversarial attacks. Our results show that QVCs offer a notably enhanced robustness against classical adversarial attacks by learning features which are not detected by the classical neural networks, indicating a possible quantum advantage for ML tasks. Contrarily, and remarkably, the converse is not true, with attacks on quantum networks also capable of deceiving classical neural networks. By combining quantum and classical network outcomes, we propose a novel adversarial attack detection technology. Traditionally quantum advantage in ML systems has been sought through increased accuracy or algorithmic speed-up, but our work has revealed the potential for a new kind of quantum advantage through superior robustness of ML models, whose practical realisation will address serious security concerns and reliability issues of ML algorithms employed in a myriad of applications including autonomous vehicles, cybersecurity, and surveillance robotic systems.


title: Asymptotic estimate on the distance energy of lattices

abstract: Since the well-known breakthrough of L. Guth and N. Katz on the Erdos distinct distances problem in the plane, mainstream of interest is aroused by their method and the Elekes-Sharir framework. In short words, they study the second moment in the framework. One may wonder if higher moments would be more efficient. In this paper, we show that any higher moment fails the expectation. In addition, we show that the second moment gives optimal estimate in higher dimensions.


title: First-step experiment in developing optical-spring quantum locking for DECIGO: sensitivity optimization for simulated quantum noise by completing the square

abstract: DECi-hertz Interferometer Gravitational Wave Observatory (DECIGO) is a future mission for a space-borne laser interferometer. DECIGO has 1,000-km-long arm cavities mainly to detect the primordial gravitational waves (PGW) at lower frequencies around 0.1 Hz. Observations in the electromagnetic spectrum have lowered the bounds on the upper limit of PGW energy density ($\Omega_{\rm gw} \sim 10^{-15} \to 10^{-16}$). As a result, DECIGO's target sensitivity, which is mainly limited by quantum noise, needs further improvement. To maximize the feasibility of detection while constrained by DECIGO's large diffraction loss, a quantum locking technique with an optical spring was theoretically proposed to improve the signal-to-noise ratio of the PGW. In this paper, we experimentally verify one key element of the optical-spring quantum locking: sensitivity optimization by completing the square of multiple detector outputs. This experiment is operated on a simplified tabletop optical setup with classical noise simulating quantum noise. We succeed in getting the best of the sensitivities with two different laser powers by the square completion method.


title: Isochrone fitting of Galactic globular clusters -- IV. NGC6362 and NGC6723

abstract: We present new isochrone fits to the colour-magnitude diagrams of the Galactic globular clusters NGC\,6362 and NGC\,6723. We utilize 22 and 26 photometric filters for NGC\,6362 and NGC\,6723, respectively, from the ultraviolet to mid-infrared using data sets from {\it HST}, {\it Gaia}, unWISE, and other photometric sources. We use models and isochrones from the Dartmouth Stellar Evolution Database (DSED) and Bag of Stellar Tracks and Isochrones (BaSTI) for $\alpha$-enhanced [$\alpha$/Fe]$=+0.4$ and different helium abundances. The metallicities [Fe/H]$=-1.04\pm0.07$ and $-1.09\pm0.06$ are derived from the red giant branch slopes in our fitting for NGC\,6362 and NGC\,6723, respectively. They agree with spectroscopic estimates from the literature. We find a differential reddening up to $\Delta E(B-V)=0.13$ mag in the NGC\,6723 field due to the adjacent Corona Australis cloud complex. We derive the following for NGC\,6362 and NGC\,6723, respectively: distances $7.75\pm0.03\pm0.15$ (statistic and systematic error) and $8.15\pm0.04\pm0.15$ kpc; ages $12.0\pm0.1\pm0.8$ and $12.4\pm0.1\pm0.8$ Gyr; extinctions $A_\mathrm{V}=0.19\pm0.04\pm0.06$ and $0.24\pm0.03\pm0.06$ mag; reddenings $E(B-V)=0.056\pm0.01\pm0.02$ and $0.068\pm0.01\pm0.02$ mag. DSED provides systematically lower [Fe/H] and higher reddenings than BaSTI. However, the models agree in their relative estimates: NGC\,6723 is $0.44\pm0.04$ kpc further, $0.5\pm0.1$ Gyr older, $\Delta E(B-V)=0.007\pm0.002$ more reddened, and with $0.05\pm0.01$ dex lower [Fe/H] than NGC\,6362. The lower metallicity and greater age of NGC\,6723 with respect to NGC\,6362 explain their horizontal branch morphology difference. This confirms age as the second parameter for these clusters. We provide lists of the cluster members from the {\it Gaia} Data Release 3.


title: Mutual Information Learned Regressor: an Information-theoretic Viewpoint of Training Regression Systems

abstract: As one of the central tasks in machine learning, regression finds lots of applications in different fields. An existing common practice for solving regression problems is the mean square error (MSE) minimization approach or its regularized variants which require prior knowledge about the models. Recently, Yi et al., proposed a mutual information based supervised learning framework where they introduced a label entropy regularization which does not require any prior knowledge. When applied to classification tasks and solved via a stochastic gradient descent (SGD) optimization algorithm, their approach achieved significant improvement over the commonly used cross entropy loss and its variants. However, they did not provide a theoretical convergence analysis of the SGD algorithm for the proposed formulation. Besides, applying the framework to regression tasks is nontrivial due to the potentially infinite support set of the label. In this paper, we investigate the regression under the mutual information based supervised learning framework. We first argue that the MSE minimization approach is equivalent to a conditional entropy learning problem, and then propose a mutual information learning formulation for solving regression problems by using a reparameterization technique. For the proposed formulation, we give the convergence analysis of the SGD algorithm for solving it in practice. Finally, we consider a multi-output regression data model where we derive the generalization performance lower bound in terms of the mutual information associated with the underlying data distribution. The result shows that the high dimensionality can be a bless instead of a curse, which is controlled by a threshold. We hope our work will serve as a good starting point for further research on the mutual information based regression.


title: Batching of Tasks by Users of Pseudonymous Forums: Anonymity Compromise and Protection

abstract: There are a number of forums where people participate under pseudonyms. One example is peer review, where the identity of reviewers for any paper is confidential. When participating in these forums, people frequently engage in "batching": executing multiple related tasks (e.g., commenting on multiple papers) at nearly the same time. Our empirical analysis shows that batching is common in two applications we consider $\unicode{x2013}$ peer review and Wikipedia edits. In this paper, we identify and address the risk of deanonymization arising from linking batched tasks. To protect against linkage attacks, we take the approach of adding delay to the posting time of batched tasks. We first show that under some natural assumptions, no delay mechanism can provide a meaningful differential privacy guarantee. We therefore propose a "one-sided" formulation of differential privacy for protecting against linkage attacks. We design a mechanism that adds zero-inflated uniform delay to events and show it can preserve privacy. We prove that this noise distribution is in fact optimal in minimizing expected delay among mechanisms adding independent noise to each event, thereby establishing the Pareto frontier of the trade-off between the expected delay for batched and unbatched events. Finally, we conduct a series of experiments on Wikipedia and Bitcoin data that corroborate the practical utility of our algorithm in obfuscating batching without introducing onerous delay to a system.


title: Elastic Functional Changepoint Detection of Climate Impacts from Localized Sources

abstract: Detecting changepoints in functional data has become an important problem as interest in monitoring of climate phenomenon has increased, where the data is functional in nature. The observed data often contains both amplitude ($y$-axis) and phase ($x$-axis) variability. If not accounted for properly, true changepoints may be undetected, and the estimated underlying mean change functions will be incorrect. In this paper, an elastic functional changepoint method is developed which properly accounts for these types of variability. The method can detect amplitude and phase changepoints which current methods in the literature do not, as they focus solely on the amplitude changepoint. This method can easily be implemented using the functions directly or can be computed via functional principal component analysis to ease the computational burden. We apply the method and its non-elastic competitors to both simulated data and observed data to show its efficiency in handling data with phase variation with both amplitude and phase changepoints. We use the method to evaluate potential changes in stratospheric temperature due to the eruption of Mt.\ Pinatubo in the Philippines in June 1991. Using an epidemic changepoint model, we find evidence of a increase in stratospheric temperature during a period that contains the immediate aftermath of Mt.\ Pinatubo, with most detected changepoints occurring in the tropics as expected.


title: Twin-field quantum key distribution with partial phase postselection

abstract: Quantum key distribution (QKD) allows two remote parties to share information-theoretically secure keys. In recent years, a revolutionary breakthrough called twin-field (TF) QKD has been developed to overcome the linear key-rate constraint and greatly increases the achievable distance. Phase-randomization and subsequent postselection play important roles in its security proof. Later, no-phase-postselection TF-QKD was proposed and became a popular variant, since the removal of phase postselection leads to a higher key rate. However, the achievable distance is decreased compared to the original one. Here, we propose a TF-QKD protocol with partial phase postselection. Namely, its code mode is still free from global phase randomization and postselection to make sure the advantage of the high key rate remains. On other hand, phase postselection is introduced in the decoy mode to improve the performance. Applying an operator dominance condition, we prove universal security of the proposed protocol in the finite-key case under coherent attacks, and numerical simulations confirm its potential advantages in terms of key rate and achievable distance.


title: Theory and phenomenology of stressed wave-dark-matter soliton

abstract: Soliton in the hostile turbulent wave dark matter ($\Psi$DM) halo of a galaxy agitates with various kinds of excitation, and the soliton even breathes heavily under great stress. A theory of collective excitation for a $\Psi$DM soliton is presented. The collective excitation has different degrees of coupling to negative energy modes, where lower-order excitation generally necessitates more negative energy coupling. A constrained variational principle is developed to assess the frequencies and mode structures of small-amplitude perturbations. The predicted frequencies are in good agreement with those found in simulations. Soliton breathing at amplitudes on the verge of breakup is also a highlight of this work. Even in this extreme nonlinear regime, the wave function perturbation amplitudes are moderate. The simulation data shows a stable oscillation with frequency weakly dependent on the oscillation amplitude, and hints a self-consistent quasi-linear model for the wave function that accounts for modifications in the ground state wave function and the equilibrium density. The mock solution, constructed from the simulation data, can shed lights on the dynamics of the large-amplitude breathing soliton and supports the quasi-linear model, as evidenced by its ability to well predict the nonlinear eigenfrequency shifts and large-amplitude breathing frequency observed in simulations.


title: Classical analogue to the Kitaev model and Majorana-like topological bound states

abstract: This study explores the possibility and presents a methodology to synthesize a classical mechanical analogue to the quantum mechanical 1D Kitaev model. While being fundamentally different, we will identify significant conceptual similarities between the two models that culminate in the occurrence, in the classical analogue system, of topologically non-trivial bound states that are akin to Majorana zero modes. By reformulating the Hamiltonian of the classical system in a form reminiscent of second quantization, we show that a 1D staggered classical mechanical chain can exhibit dynamic characteristics analogous to the Kitaev's 1D superconducting model, as well as its characteristic bound states. The non-trivial topological nature of the bound states is further confirmed by the topological band structure analysis and by the topological invariant. While the non-Abelian nature of these states remains an open question, these results allow envisioning the possibility to achieve topological braiding in classical mechanical systems.


title: Optimal Safety for Constrained Differential Inclusions using Nonsmooth Control Barrier Functions

abstract: For a broad class of nonlinear systems, we formulate the problem of guaranteeing safety with optimality under constraints. Specifically, we define controlled safety for differential inclusions with constraints on the states and the inputs. Through the use of nonsmooth analysis tools, we show that a continuous optimal control law can be selected from a set-valued constraint capturing the system constraints and conditions guaranteeing safety using control barrier functions. Our results guarantee optimality and safety via a continuous state-feedback law designed using nonsmooth control barrier functions. An example pertaining to obstacle avoidance with a target illustrates our results and the associated benefits of using nonsmooth control barrier functions.


title: Empirical Bayes estimation: When does $g$-modeling beat $f$-modeling in theory (and in practice)?

abstract: Empirical Bayes (EB) is a popular framework for large-scale inference that aims to find data-driven estimators to compete with the Bayesian oracle that knows the true prior. Two principled approaches to EB estimation have emerged over the years: $f$-modeling, which constructs an approximate Bayes rule by estimating the marginal distribution of the data, and $g$-modeling, which estimates the prior from data and then applies the learned Bayes rule. For the Poisson model, the prototypical examples are the celebrated Robbins estimator and the nonparametric MLE (NPMLE), respectively. It has long been recognized in practice that the Robbins estimator, while being conceptually appealing and computationally simple, lacks robustness and can be easily derailed by "outliers" (data points that were rarely observed before), unlike the NPMLE which provides more stable and interpretable fit thanks to its Bayes form. On the other hand, not only do the existing theories shed little light on this phenomenon, but they all point to the opposite, as both methods have recently been shown optimal in terms of the \emph{regret} (excess over the Bayes risk) for compactly supported and subexponential priors with exact logarithmic factors. In this paper we provide a theoretical justification for the superiority of NPMLE over Robbins for heavy-tailed data by considering priors with bounded $p$th moment previously studied for the Gaussian model. For the Poisson model with sample size $n$, assuming $p>1$ (for otherwise triviality arises), we show that the NPMLE with appropriate regularization and truncation achieves a total regret $\tilde \Theta(n^{\frac{3}{2p+1}})$, which is minimax optimal within logarithmic factors. In contrast, the total regret of Robbins estimator (with similar truncation) is $\tilde{\Theta}(n^{\frac{3}{p+2}})$ and hence suboptimal by a polynomial factor.


title: An analog of polynomially integrable bodies in even-dimensional spaces

abstract: A bounded domain $K \subset \mathbb R^n$ is called polynomially integrable if the $(n-1)$-dimensional volume of the intersection $K$ with a hyperplane $\Pi$ polynomially depends on the distance from $\Pi$ to the origin. It was proved in [7] that there are no such domains with smooth boundary if $n$ is even, and if $n$ is odd then the only polynomially integrable domains with smooth boundary are ellipsoids. In this article, we modify the notion of polynomial integrability for even $n$ and consider bodies for which the sectional volume function is a polynomial up to a factor which is the square root of a quadratic polynomial, or, equivalently, the Hilbert transform of this function is a polynomial. We prove that ellipsoids in even dimensions are the only convex infinitely smooth bodies satisfying this property.


title: Non-resonant Coherent Amplitude Transfer in Attosecond Four-Wave Mixing Spectroscopy

abstract: Attosecond four-wave mixing spectroscopy using an XUV pulse and two noncollinear near-infrared pulses is employed to measure Rydberg wavepacket dynamics resulting from extreme ultraviolet excitation of a 3s electron in atomic argon into a series of autoionizing 3s-1np Rydberg states around 29 eV. The emitted signals from individual Rydberg states exhibit oscillatory structure and persist well beyond the expected lifetimes of the emitting Rydberg states. These results reflect substantial contributions of longer-lived Rydberg states to the four wave mixing emission signals of each individually detected state. A wavepacket decomposition analysis reveals that coherent amplitude transfer occurs predominantly from photoexcited 3s-1(n+1)p states to the observed 3s-1np Rydberg states. The experimental observations are reproduced by time-dependent Schr\"odinger equation simulations using electronic structure and transition moment calculations. The theory highlights that coherent amplitude transfer is driven non-resonantly to the 3s-1np states by the near-infrared light through 3s-1(n+1)s and 3s-1(n-1)d dark states during the four-wave mixing process.


title: A Genus-two Surface Code

abstract: We construct a double-toric surface code by exploiting the planar tessellation using a rhombus-shaped tile. With n data qubits, we are able to encode at least n/3 logical qubits or quantum memories. By a suitable arrangement of the tiles, the code achieves larger distances, leading to significant error-correcting capability. We demonstrate the robustness of the logical qubits thus obtained in the presence of external noise. We believe that the optimality of the code presented here will pave the way for design of efficient scalable architectures.


title: Analytic construction of sphaleron-like solution invoking higher dimensional gauge theory

abstract: We perform analytic construction of a sphaleron-like solution in the 4-dimensional (4D) space-time invoking the framework of 5D SU(2) gauge theory. By the sphaleron-like solution we mean a static finite energy solution to the equation of motion, which carries the Chern-Simons number $N_\text{CS}=\frac{1}{2}$. Since we are interested in the static solution in the low-energy effective theory, we focus on the part of the action which contains only the gauge fields in the 4D space (not space-time), $(A_{i}, A_{y}) (i = 1,2,3)$ and keep only the Kaluza-Klein zero modes of these fields. Interestingly, the self-duality condition in this 4D space is known to be nothing but the BPS condition for the 't Hooft-Polyakov monopole, once the extra-space component $A_y$ is identified with the adjoint scalar, needed for the monopole solution. Thus, the sphaleron-like solution is based on the BPS monopole embedded in the higher dimensional space-time, which may be interpreted as a self-dual gauge field. By use of the lesson we learn in the case of the instanton in ordinary 4D space-time, we achieve the sphaleron-like configuration of $A_{i}$, which carries $N_\text{CS} = \frac{1}{2}$. As a characteristic feature of this construction invoking higher dimensional gauge theory, in clear contrast to the case of the ordinary BPS monopole, the VEV of the adjoint scalar is topologically fixed, and therefore the mass of the sphaleron-like solution is determined to be $M_\text{sp} = \frac{4\pi}{g_{4}^{2}}\frac{1}{R}$ ($g_{4}$: 4D gauge coupling constant, $R$: the radius of the circle as the extra space). We also argue that the sphaleron-like solution may be regarded as a saddle point of the energy in the space of static field configurations.


title: Geometric Properties of Functions Containing Derivatives of Bessel Functions

abstract: In this paper our aim is to find the radii of $\gamma$-Spirallike of order $\alpha$ and convex $\gamma$-Spirallike of order $\alpha$ for three different kinds of normalizations of the function $N_\nu(z)=az^2J_\nu^{\prime\prime}(z)+bzJ_\nu^{\prime}(z)+cJ_\nu(z),$ where $J_\nu(z)$ is the Bessel function of the first kind of order $\nu.$ Moreover, the $\mathcal{S}^*\left(\varphi\right)-$radii and $\mathcal{C}\left(\varphi\right)-$radii of these normalized functions are investigated. The tables are created and visual verification with graphs are made by giving special values to the real numbers $a,$ $b$ and $c$ in the obtained results.


title: Rega-Net:Retina Gabor Attention for Deep Convolutional Neural Networks

abstract: Extensive research works demonstrate that the attention mechanism in convolutional neural networks (CNNs) effectively improves accuracy. Nevertheless, few works design attention mechanisms using large receptive fields. In this work, we propose a novel attention method named Rega-net to increase CNN accuracy by enlarging the receptive field. Inspired by the mechanism of the human retina, we design convolutional kernels to resemble the non-uniformly distributed structure of the human retina. Then, we sample variable-resolution values in the Gabor function distribution and fill these values in retina-like kernels. This distribution allows essential features to be more visible in the center position of the receptive field. We further design an attention module including these retina-like kernels. Experiments demonstrate that our Rega-Net achieves 79.96% top-1 accuracy on ImageNet-1K classification and 43.1% mAP on COCO2017 object detection. The mAP of the Rega-Net increased by up to 3.5% compared to baseline networks.


title: Search for an axion-like particle in radiative $J/\psi$ decays

abstract: We search for an axion-like particle (ALP) $a$ through the process $\psi(3686)\rightarrow\pi^+\pi^-J/\psi$, $J/\psi\rightarrow\gamma a$, $a\rightarrow\gamma\gamma$ in a data sample of $(2.71\pm0.01)\times10^9$ $\psi(3686)$ events collected by the BESIII detector. No significant ALP signal is observed over the expected background, and the upper limits on the branching fraction of the decay $J/\psi\rightarrow\gamma a$ and the ALP-photon coupling constant $g_{a\gamma\gamma}$ are set at 95% confidence level in the mass range of $0.165\leq m_a\leq2.84\,\mbox{GeV}/c^2$. The limits on $B(J/\psi\rightarrow\gamma a)$ range from $8.3\times10^{-8}$ to $1.8\times10^{-6}$ over the search region, and the constraints on the ALP-photon coupling are the most stringent to date for $0.165\leq m_a\leq1.468\,\mbox{GeV}/c^2$.


title: Tailored Presolve Techniques in Branch-and-Bound Method for Fast Mixed-Integer Optimal Control Applications

abstract: Mixed-integer model predictive control (MI-MPC) can be a powerful tool for modeling hybrid control systems. In case of a linear-quadratic objective in combination with linear or piecewise-linear system dynamics and inequality constraints, MI-MPC needs to solve a mixed-integer quadratic program (MIQP) at each sampling time step. This paper presents a collection of block-sparse presolve techniques to efficiently remove decision variables, and to remove or tighten inequality constraints, tailored to mixed-integer optimal control problems (MIOCP). In addition, we describe a novel heuristic approach based on an iterative presolve algorithm to compute a feasible but possibly suboptimal MIQP solution. We present benchmarking results for a C code implementation of the proposed BB-ASIPM solver, including a branch-and-bound (B&B) method with the proposed tailored presolve techniques and an active-set based interior point method (ASIPM), compared against multiple state-of-the-art MIQP solvers on a case study of motion planning with obstacle avoidance constraints. Finally, we demonstrate the computational performance of the BB-ASIPM solver on the dSPACE Scalexio real-time embedded hardware using a second case study of stabilization for an underactuated cart-pole with soft contacts.


title: Continual Learning of Natural Language Processing Tasks: A Survey

abstract: Continual learning (CL) is a learning paradigm that emulates the human capability of learning and accumulating knowledge continually without forgetting the previously learned knowledge and also transferring the learned knowledge to help learn new tasks better. This survey presents a comprehensive review and analysis of the recent progress of CL in NLP, which has significant differences from CL in computer vision and machine learning. It covers (1) all CL settings with a taxonomy of existing techniques; (2) catastrophic forgetting (CF) prevention, (3) knowledge transfer (KT), which is particularly important for NLP tasks; and (4) some theory and the hidden challenge of inter-task class separation (ICS). (1), (3) and (4) have not been included in the existing survey. Finally, a list of future directions is discussed.


title: Evaluating Feature Attribution Methods for Electrocardiogram

abstract: The performance of cardiac arrhythmia detection with electrocardiograms(ECGs) has been considerably improved since the introduction of deep learning models. In practice, the high performance alone is not sufficient and a proper explanation is also required. Recently, researchers have started adopting feature attribution methods to address this requirement, but it has been unclear which of the methods are appropriate for ECG. In this work, we identify and customize three evaluation metrics for feature attribution methods based on the characteristics of ECG: localization score, pointing game, and degradation score. Using the three evaluation metrics, we evaluate and analyze eleven widely-used feature attribution methods. We find that some of the feature attribution methods are much more adequate for explaining ECG, where Grad-CAM outperforms the second-best method by a large margin.


title: Subgroup Robustness Grows On Trees: An Empirical Baseline Investigation

abstract: Researchers have proposed many methods for fair and robust machine learning, but comprehensive empirical evaluation of their subgroup robustness is lacking. In this work, we address this gap in the context of tabular data, where sensitive subgroups are clearly-defined, real-world fairness problems abound, and prior works often do not compare to state-of-the-art tree-based models as baselines. We conduct an empirical comparison of several previously-proposed methods for fair and robust learning alongside state-of-the-art tree-based methods and other baselines. Via experiments with more than $340{,}000$ model configurations on eight datasets, we show that tree-based methods have strong subgroup robustness, even when compared to robustness- and fairness-enhancing methods. Moreover, the best tree-based models tend to show good performance over a range of metrics, while robust or group-fair models can show brittleness, with significant performance differences across different metrics for a fixed model. We also demonstrate that tree-based models show less sensitivity to hyperparameter configurations, and are less costly to train. Our work suggests that tree-based ensemble models make an effective baseline for tabular data, and are a sensible default when subgroup robustness is desired. For associated code and detailed results, see https://github.com/jpgard/subgroup-robustness-grows-on-trees .


title: Joint Design of Power Control and Access Point Scheduling for Uplink Cell-Free Massive MIMO Networks

abstract: This work proposes a joint power control and access points (APs) scheduling algorithm for uplink cell-free massive multiple-input multiple-output (CF-mMIMO) networks without channel hardening assumption. Extensive studies have done on the joint optimization problem assuming the channel hardening. However, it has been reported that the channel hardening may not be validated in some CF-mMIMO environments. In particular, the existing Use-and-then-Forget (UatF) bound based on the channel hardening often seriously underestimates user rates in CF-mMIMO. Therefore, a new performance evaluation technique without resorting to the channel hardening is indispensable for accurate performance estimations. Motivated by this, we propose a new bound on the achievable rate of uplink CF-mMIMO. It is demonstrated that the proposed bound provides a more accurate performance estimate of CF-mMIMO than that of the existing UatF bound. The proposed bound also enables us to develop a joint power control and APs scheduling algorithm targeting at both improving fairness and reducing the resource between APs and a central processing unit (CPU). We conduct extensive performance evaluations and comparisons for systems designed with the proposed and existing algorithms. The comparisons show that a considerable performance improvement is achievable with the proposed algorithm even at reduced resource between APs and CPU.


title: In-Mouth Robotic Bite Transfer with Visual and Haptic Sensing

abstract: Assistance during eating is essential for those with severe mobility issues or eating risks. However, dependence on traditional human caregivers is linked to malnutrition, weight loss, and low self-esteem. For those who require eating assistance, a semi-autonomous robotic platform can provide independence and a healthier lifestyle. We demonstrate an essential capability of this platform: safe, comfortable, and effective transfer of a bite-sized food item from a utensil directly to the inside of a person's mouth. Our system uses a force-reactive controller to safely accommodate the user's motions throughout the transfer, allowing full reactivity until bite detection then reducing reactivity in the direction of exit. Additionally, we introduce a novel dexterous wrist-like end effector capable of small, unimposing movements to reduce user discomfort. We conduct a user study with 11 participants covering 8 diverse food categories to evaluate our system end-to-end, and we find that users strongly prefer our method to a wide range of baselines. Appendices and videos are available at our website: https://tinyurl.com/btICRA.


title: Quality Assurance in MLOps Setting: An Industrial Perspective

abstract: Today, machine learning (ML) is widely used in industry to provide the core functionality of production systems. However, it is practically always used in production systems as part of a larger end-to-end software system that is made up of several other components in addition to the ML model. Due to production demand and time constraints, automated software engineering practices are highly applicable. The increased use of automated ML software engineering practices in industries such as manufacturing and utilities requires an automated Quality Assurance (QA) approach as an integral part of ML software. Here, QA helps reduce risk by offering an objective perspective on the software task. Although conventional software engineering has automated tools for QA data analysis for data-driven ML, the use of QA practices for ML in operation (MLOps) is lacking. This paper examines the QA challenges that arise in industrial MLOps and conceptualizes modular strategies to deal with data integrity and Data Quality (DQ). The paper is accompanied by real industrial use-cases from industrial partners. The paper also presents several challenges that may serve as a basis for future studies.


title: Can Open-Domain QA Reader Utilize External Knowledge Efficiently like Humans?

abstract: Recent state-of-the-art open-domain QA models are typically based on a two stage retriever-reader approach in which the retriever first finds the relevant knowledge/passages and the reader then leverages that to predict the answer. Prior work has shown that the performance of the reader usually tends to improve with the increase in the number of these passages. Thus, state-of-the-art models use a large number of passages (e.g. 100) for inference. While the reader in this approach achieves high prediction performance, its inference is computationally very expensive. We humans, on the other hand, use a more efficient strategy while answering: firstly, if we can confidently answer the question using our already acquired knowledge then we do not even use the external knowledge, and in the case when we do require external knowledge, we don't read the entire knowledge at once, instead, we only read that much knowledge that is sufficient to find the answer. Motivated by this procedure, we ask a research question "Can the open-domain QA reader utilize external knowledge efficiently like humans without sacrificing the prediction performance?" Driven by this question, we explore an approach that utilizes both 'closed-book' (leveraging knowledge already present in the model parameters) and 'open-book' inference (leveraging external knowledge). Furthermore, instead of using a large fixed number of passages for open-book inference, we dynamically read the external knowledge in multiple 'knowledge iterations'. Through comprehensive experiments on NQ and TriviaQA datasets, we demonstrate that this dynamic reading approach improves both the 'inference efficiency' and the 'prediction accuracy' of the reader. Comparing with the FiD reader, this approach matches its accuracy by utilizing just 18.32% of its reader inference cost and also outperforms it by achieving up to 55.10% accuracy on NQ Open.


title: Trace and extension theorems for homogeneous Sobolev and Besov spaces for unbounded uniform domains in metric measure spaces

abstract: In this paper we fix $1\le p<\infty$ and consider $(\Om,d,\mu)$ be an unbounded, locally compact, non-complete metric measure space equipped with a doubling measure $\mu$ supporting a $p$-Poincar\'e inequality such that $\Om$ is a uniform domain in its completion $\bar\Om$. We realize the trace of functions in the Dirichlet-Sobolev space $D^{1,p}(\Om)$ on the boundary $\partial\Om$ as functions in the homogeneous Besov space $HB^\alpha_{p,p}(\partial\Om)$ for suitable $\alpha$; here, $\partial\Om$ is equipped with a non-atomic Borel regular measure $\nu$. We show that if $\nu$ satisfies a $\theta$-codimensional condition with respect to $\mu$ for some $0<\theta<p$, then there is a bounded linear trace operator $T:D^{1,p}(\Om)\rightarrow HB^{1-\theta/p}(\partial\Om)$ and a bounded linear extension operator $E:HB^{1-\theta/p}(\partial\Om)\rightarrow D^{1,p}(\Om)$ that is a right-inverse of $T$.


title: SciAI4Industry -- Solving PDEs for industry-scale problems with deep learning

abstract: Solving partial differential equations with deep learning makes it possible to reduce simulation times by multiple orders of magnitude and unlock scientific methods that typically rely on large numbers of sequential simulations, such as optimization and uncertainty quantification. Two of the largest challenges of adopting scientific AI for industrial problem settings is that training datasets must be simulated in advance and that neural networks for solving large-scale PDEs exceed the memory capabilities of current GPUs. We introduce a distributed programming API in the Julia language for simulating training data in parallel on the cloud and without requiring users to manage the underlying HPC infrastructure. In addition, we show that model-parallel deep learning based on domain decomposition allows us to scale neural networks for solving PDEs to commercial-scale problem settings and achieve above 90% parallel efficiency. Combining our cloud API for training data generation and model-parallel deep learning, we train large-scale neural networks for solving the 3D Navier-Stokes equation and simulating 3D CO2 flow in porous media. For the CO2 example, we simulate a training dataset based on a commercial carbon capture and storage (CCS) project and train a neural network for CO2 flow simulation on a 3D grid with over 2 million cells that is 5 orders of magnitudes faster than a conventional numerical simulator and 3,200 times cheaper.


title: Topological $\pi$ modes and beyond

abstract: This short Perspective article presents an overview of the discovery of topological $\pi$ modes as well as their physical significance in quantum computing and the understanding of an exotic phase of matter, i.e., the Floquet time crystal. The recent proposals of $2\pi/k$ modes as the generalizations of $\pi$ modes are further elucidated.


title: SnCQA: A hardware-efficient equivariant quantum convolutional circuit architecture

abstract: We propose SnCQA, a set of hardware-efficient variational circuits of equivariant quantum convolutional circuits respective to permutation symmetries and spatial lattice symmetries with the number of qubits $n$. By exploiting permutation symmetries of the system, such as lattice Hamiltonians common to many quantum many-body and quantum chemistry problems, Our quantum neural networks are suitable for solving machine learning problems where permutation symmetries are present, which could lead to significant savings of computational costs. Aside from its theoretical novelty, we find our simulations perform well in practical instances of learning ground states in quantum computational chemistry, where we could achieve comparable performances to traditional methods with few tens of parameters. Compared to other traditional variational quantum circuits, such as the pure hardware-efficient ansatz (pHEA), we show that SnCQA is more scalable, accurate, and noise resilient (with $20\times$ better performance on $3 \times 4$ square lattice and $200\% - 1000\%$ resource savings in various lattice sizes and key criterions such as the number of layers, parameters, and times to converge in our cases), suggesting a potentially favorable experiment on near-time quantum devices.

categories: quant-ph cs.AI cs.AR cs.LG cs.SY eess.SY


title: Contrastive Identity-Aware Learning for Multi-Agent Value Decomposition

abstract: Value Decomposition (VD) aims to deduce the contributions of agents for decentralized policies in the presence of only global rewards, and has recently emerged as a powerful credit assignment paradigm for tackling cooperative Multi-Agent Reinforcement Learning (MARL) problems. One of the main challenges in VD is to promote diverse behaviors among agents, while existing methods directly encourage the diversity of learned agent networks with various strategies. However, we argue that these dedicated designs for agent networks are still limited by the indistinguishable VD network, leading to homogeneous agent behaviors and thus downgrading the cooperation capability. In this paper, we propose a novel Contrastive Identity-Aware learning (CIA) method, explicitly boosting the credit-level distinguishability of the VD network to break the bottleneck of multi-agent diversity. Specifically, our approach leverages contrastive learning to maximize the mutual information between the temporal credits and identity representations of different agents, encouraging the full expressiveness of credit assignment and further the emergence of individualities. The algorithm implementation of the proposed CIA module is simple yet effective that can be readily incorporated into various VD architectures. Experiments on the SMAC benchmarks and across different VD backbones demonstrate that the proposed method yields results superior to the state-of-the-art counterparts. Our code is available at https://github.com/liushunyu/CIA.


title: Reliable Robustness Evaluation via Automatically Constructed Attack Ensembles

abstract: Attack Ensemble (AE), which combines multiple attacks together, provides a reliable way to evaluate adversarial robustness. In practice, AEs are often constructed and tuned by human experts, which however tends to be sub-optimal and time-consuming. In this work, we present AutoAE, a conceptually simple approach for automatically constructing AEs. In brief, AutoAE repeatedly adds the attack and its iteration steps to the ensemble that maximizes ensemble improvement per additional iteration consumed. We show theoretically that AutoAE yields AEs provably within a constant factor of the optimal for a given defense. We then use AutoAE to construct two AEs for $l_{\infty}$ and $l_2$ attacks, and apply them without any tuning or adaptation to 45 top adversarial defenses on the RobustBench leaderboard. In all except one cases we achieve equal or better (often the latter) robustness evaluation than existing AEs, and notably, in 29 cases we achieve better robustness evaluation than the best known one. Such performance of AutoAE shows itself as a reliable evaluation protocol for adversarial robustness, which further indicates the huge potential of automatic AE construction. Code is available at \url{https://github.com/LeegerPENG/AutoAE}.


title: Developmental Plasticity-inspired Adaptive Pruning for Deep Spiking and Artificial Neural Networks

abstract: Developmental plasticity plays a prominent role in shaping the brain's structure during ongoing learning in response to dynamically changing environments. However, the existing network compression methods for deep artificial neural networks (ANNs) and spiking neural networks (SNNs) draw little inspiration from the brain's developmental plasticity mechanisms, thus limiting their ability to learn efficiently, rapidly, and accurately. This paper proposed a developmental plasticity-inspired adaptive pruning (DPAP) method, with inspiration from the adaptive developmental pruning of dendritic spines, synapses, and neurons according to the "use it or lose it, gradually decay" principle. The proposed DPAP model considers multiple biologically realistic mechanisms (such as dendritic spine dynamic plasticity, activity-dependent neural spiking trace, and local synaptic plasticity), with the addition of an adaptive pruning strategy, so that the network structure can be dynamically optimized during learning without any pre-training and retraining. We demonstrated that the proposed DPAP method applied to deep ANNs and SNNs could learn efficient network architectures. Extensive comparative experiments show consistent and remarkable performance and speed boost with the extremely compressed networks on a diverse set of benchmark tasks, especially neuromorphic datasets for SNNs. This work explores how developmental plasticity enables the complex deep networks to gradually evolve into brain-like efficient and compact structures, eventually achieving state-of-the-art (SOTA) performance for biologically realistic SNNs.


title: Embedding Compression for Text Classification Using Dictionary Screening

abstract: In this paper, we propose a dictionary screening method for embedding compression in text classification tasks. The key purpose of this method is to evaluate the importance of each keyword in the dictionary. To this end, we first train a pre-specified recurrent neural network-based model using a full dictionary. This leads to a benchmark model, which we then use to obtain the predicted class probabilities for each sample in a dataset. Next, to evaluate the impact of each keyword in affecting the predicted class probabilities, we develop a novel method for assessing the importance of each keyword in a dictionary. Consequently, each keyword can be screened, and only the most important keywords are reserved. With these screened keywords, a new dictionary with a considerably reduced size can be constructed. Accordingly, the original text sequence can be substantially compressed. The proposed method leads to significant reductions in terms of parameters, average text sequence, and dictionary size. Meanwhile, the prediction power remains very competitive compared to the benchmark model. Extensive numerical studies are presented to demonstrate the empirical performance of the proposed method.


title: Global Meets Local: Effective Multi-Label Image Classification via Category-Aware Weak Supervision

abstract: Multi-label image classification, which can be categorized into label-dependency and region-based methods, is a challenging problem due to the complex underlying object layouts. Although region-based methods are less likely to encounter issues with model generalizability than label-dependency methods, they often generate hundreds of meaningless or noisy proposals with non-discriminative information, and the contextual dependency among the localized regions is often ignored or over-simplified. This paper builds a unified framework to perform effective noisy-proposal suppression and to interact between global and local features for robust feature learning. Specifically, we propose category-aware weak supervision to concentrate on non-existent categories so as to provide deterministic information for local feature learning, restricting the local branch to focus on more high-quality regions of interest. Moreover, we develop a cross-granularity attention module to explore the complementary information between global and local features, which can build the high-order feature correlation containing not only global-to-local, but also local-to-local relations. Both advantages guarantee a boost in the performance of the whole network. Extensive experiments on two large-scale datasets (MS-COCO and VOC 2007) demonstrate that our framework achieves superior performance over state-of-the-art methods.


title: Benchmarking Bayesian Deep Learning on Diabetic Retinopathy Detection Tasks

abstract: Bayesian deep learning seeks to equip deep neural networks with the ability to precisely quantify their predictive uncertainty, and has promised to make deep learning more reliable for safety-critical real-world applications. Yet, existing Bayesian deep learning methods fall short of this promise; new methods continue to be evaluated on unrealistic test beds that do not reflect the complexities of downstream real-world tasks that would benefit most from reliable uncertainty quantification. We propose the RETINA Benchmark, a set of real-world tasks that accurately reflect such complexities and are designed to assess the reliability of predictive models in safety-critical scenarios. Specifically, we curate two publicly available datasets of high-resolution human retina images exhibiting varying degrees of diabetic retinopathy, a medical condition that can lead to blindness, and use them to design a suite of automated diagnosis tasks that require reliable predictive uncertainty quantification. We use these tasks to benchmark well-established and state-of-the-art Bayesian deep learning methods on task-specific evaluation metrics. We provide an easy-to-use codebase for fast and easy benchmarking following reproducibility and software design principles. We provide implementations of all methods included in the benchmark as well as results computed over 100 TPU days, 20 GPU days, 400 hyperparameter configurations, and evaluation on at least 6 random seeds each.


title: SMEFT deviations

abstract: This work is based on a bottom{-}up approach to the standard{-}model effective field theory (SMEFT), resulting in an equiprobable space of Wilson coefficients. The randomly generated Wilson coefficients of the SMEFT (in the Warsaw basis) are treated as pseudo-data and, for each observable, the corresponding probability density function is computed. The goal has been to understand how large are the deviations from the SM once the SMEFT scale and the range of the Wilson coefficients are selected. Correlations between different observables are also discussed.


title: Disordered topological graphs enhancing nonlinear phenomena

abstract: Complex networks play a fundamental role in understanding phenomena from the collective behavior of spins, neural networks, and power grids to the spread of diseases. Topological phenomena in such networks have recently been exploited to preserve the response of systems in the presence of disorder. We propose and demonstrate topological structurally disordered systems with a modal structure that enhances nonlinear phenomena in the topological channels by inhibiting the ultrafast leakage of energy from edge modes to bulk modes. We present the construction of the graph and show that its dynamics enhances the topologically protected photon pair generation rate by an order of magnitude. Disordered nonlinear topological graphs will enable advanced quantum interconnects, efficient nonlinear sources, and light-based information processing for artificial intelligence.


title: Wireless Sensing Data Collection and Processing for Metaverse Avatar Construction

abstract: Recent advances in emerging technologies such as artificial intelligence and extended reality have pushed the Metaverse, a virtual, shared space, into reality. In Metaverse, users can customize virtual avatars to experience a different life. While impressive, avatar construction requires a lot of data that manifest users in the physical world from various perspectives, and wireless sensing data is one of them. For example, machine learning (ML) and signal processing can help extract information about user behavior from sensing data, thereby facilitating avatar behavior construction in the Metaverse. This article presents a wireless sensing dataset to support the emerging research on Metaverse avatar construction. Rigorously, the existing data collection platforms and datasets are analyzed first. On this basis, we introduce the platform used in this paper, as well as the data collection method and scenario. We observe that the collected sensing data, i.e., channel state information (CSI), suffers from a phase shift problem, which negatively affects the extraction of user information such as behavior and heartbeat and further deteriorates the avatar construction. Therefore, we propose to detect and correct this phase shift by a sliding window and phase compensation, respectively, and then validate the proposed scheme with the collected data. Finally, several research directions related to the avatar construction are given from the perspective of datasets.


title: The codegree Tur\'an density of tight cycles minus one edge

abstract: Given $\alpha>0$ and an integer $\ell\geq5$, we prove that every sufficiently large $3$-uniform hypergraph $H$ on $n$ vertices in which every two vertices are contained in at least $\alpha n$ edges contains a copy of $C_\ell^{-}$, a tight cycle on $\ell$ vertices minus one edge. This improves a previous result by Balogh, Clemen, and Lidick\'y.


title: Higher order exchange driven noncoplanar magnetic state and large anomalous Hall effects in electron doped kagome magnet Mn$_3$Sn

abstract: Owing to the geometrical frustration, Mn$_3 $Sn exhibits a 120$^{\circ}$ in-plane triangular antiferromagnetic (AFM) order with a large anomalous Hall effect (AHE). Here, we present a combined theoretical and experimental study to demonstrate that the in-plane AFM structure in Mn$_3 $Sn can be significantly modified to a tunable noncoplanar magnetic state by suitable electron doping. With the help of Density Functional Theory calculations we show that the presence of higher-order exchange interactions in the system leads to the stabilization of the noncoplanar magnetic ground state, which is further established by neutron diffraction study in the Fe-doped Mn$_3 $Sn sample. Interestingly, we find a large scalar spin chirality (SSC) induced topological AHE that can be significantly tuned with the degree of non-coplanarity. We carry out 60~T magnetic and Hall resistivity measurements to demonstrate the contribution of SSC to the observed AHE. We also illustrate a simultaneous manipulation of dual order in the system, where the AHE arising from the in-plane 120$^{\circ}$ triangular AFM order can switch its sign without affecting the AHE generated by the SSC. The present study opens up a new direction to explore novel quantum phenomena associated with the coexistence of multiple orders.


title: A Classification Model Utilizing Facial Landmark Tracking to Determine Sentence Types for American Sign Language Recognition

abstract: The deaf and hard of hearing community relies on American Sign Language (ASL) as their primary mode of communication, but communication with others who do not know ASL can be difficult, especially during emergencies where no interpreter is available. As an effort to alleviate this problem, research in computer vision based real time ASL interpreting models is ongoing. However, most of these models are hand shape (gesture) based and lack the integration of facial cues, which are crucial in ASL to convey tone and distinguish sentence types. Thus, the integration of facial cues in computer vision based ASL interpreting models has the potential to improve performance and reliability. In this paper, we introduce a simple, computationally efficient facial expression based classification model that can be used to improve ASL interpreting models. This model utilizes the relative angles of facial landmarks with principal component analysis and a Random Forest Classification tree model to classify frames taken from videos of ASL users signing a complete sentence. The model classifies the frames as statements or assertions. The model was able to achieve an accuracy of 86.5%.


title: HIGlow: Conditional Normalizing Flows for High-Fidelity HI Map Modeling

abstract: Extracting the maximum amount of cosmological and astrophysical information from upcoming large-scale surveys remains a challenge. This includes evaluating the exact likelihood, parameter inference and generating new diverse synthetic examples of the incoming high-dimensional data sets. In this work, we propose the use of normalizing flows as a generative model of the neutral hydrogen (HI) maps from the CAMELS project. Normalizing flows have been very successful at parameter inference and generating new, realistic examples. Our model utilizes the spatial structure of the HI maps in order to faithfully follow the statistics of the data, allowing for high-fidelity sample generation and efficient parameter inference.


title: Sound people speak to Star people. A sound experts perspective on astronomy sonification projects

abstract: The Audible Universe project aims at making dialogue between two scientific domains investigating two distinct research objects, briefly said, Stars and Sound. It has been instantiated within a collaborative workshop that started to mutually acculturate both communities, by sharing and transmitting respective knowledge, skills and practices. One main outcome of this exchange was a global view on the astronomical data sonification paradigm that allowed to observe either the diversity of tools, uses and users (including visually-impaired people), but also the current limitations and potential ways of improvement. From this perspective, the current paper presents basic elements gathered and contextualised by sound experts in their respective fields (sound perception / cognition, sound design, psychoacoustics, experimental psychology), in order to anchor sonification for astronomy in a more well-informed, methodological and creative process.


title: The Effects of Gas Angular Momentum on the Formation of Magnetically Arrested Disks and the Launching of Powerful Jets

abstract: In this letter, we investigate Bondi-like accretion flows with zero or low specific angular momentum by performing 3D general relativistic magnetohydrodynamic simulations. In order to check if relativistic jets can be launched magnetically from such flows, we insert a large-scale poloidal magnetic field into the accretion flow and consider a rapidly spinning black hole. We demonstrate that under such conditions the accretion flow needs to initially have specific angular momentum above a certain threshold to eventually reach and robustly sustain the magnetically arrested disk state. If the flow can reach such a state, it can launch very powerful jets at $\gtrsim 100\%$ energy efficiency. Interestingly, we also find that even when the accretion flow has initial specific angular momentum below the threshold, it can still launch episodic jets with an average energy efficiency of $\sim 10\%$. However, the accretion flow has nontypical behaviors such as having different rotation directions at different inclinations and exhibiting persistent outflows along the midplane even in the inner disk region. Our results give plausible explanations as to why jets can be produced from various astrophysical systems that likely lack large gas specific angular momenta, such as Sgr A*, wind-fed X-ray binaries, tidal disruption events, and long-duration gamma-ray bursts.


title: Semantic Communications for Wireless Sensing: RIS-aided Encoding and Self-supervised Decoding

abstract: Semantic communications can reduce the resource consumption by transmitting task-related semantic information extracted from source messages. However, when the source messages are utilized for various tasks, e.g., wireless sensing data for localization and activities detection, semantic communication technique is difficult to be implemented because of the increased processing complexity. In this paper, we propose the inverse semantic communications as a new paradigm. Instead of extracting semantic information from messages, we aim to encode the task-related source messages into a hyper-source message for data transmission or storage. Following this paradigm, we design an inverse semantic-aware wireless sensing framework with three algorithms for data sampling, reconfigurable intelligent surface (RIS)-aided encoding, and self-supervised decoding, respectively. Specifically, on the one hand, we propose a novel RIS hardware design for encoding several signal spectrums into one MetaSpectrum. To select the task-related signal spectrums for achieving efficient encoding, a semantic hash sampling method is introduced. On the other hand, we propose a self-supervised learning method for decoding the MetaSpectrums to obtain the original signal spectrums. Using the sensing data collected from real-world, we show that our framework can reduce the data volume by 95% compared to that before encoding, without affecting the accomplishment of sensing tasks. Moreover, compared with the typically used uniform sampling scheme, the proposed semantic hash sampling scheme can achieve 67% lower mean squared error in recovering the sensing parameters. In addition, experiment results demonstrate that the amplitude response matrix of the RIS enables the encryption of the sensing data.


abstract: This paper deals with the Stochastic Capacitated Arc Routing Problem (SCARP), obtained by randomizing quantities on the arcs in the CARP. Optimization problems for the SCARP are characterized by decisions that are made without knowing their full consequences. For real-life problems, it is important to create solutions insensitive to variations of the quantities to collect because of the randomness of these quantities. Efficient robust solutions are required to avoid unprofitable costly moves of vehicles to the depot node. Different criteria are proposed to model the SCARP and advanced concepts of a genetic algorithm optimizing both cost and robustness are provided. The method is benchmarked on the well-known instances proposed by DeArmon, Eglese and Belenguer. The results prove it is possible to obtain robust solutions without any significant enlargement of the solution cost. This allows treating more realistic problems including industrial goals and constraints linked to variations in the quantities to be collected.


title: The Weyl Transform of a measure

abstract: (1) Suppose $\mu$ is a smooth measure on a hypersurface of positive Gaussian curvature in $\R^{2n}$. If $n\ge 2$, then $W(\mu)$, the Weyl transform of $\mu$, is a compact operator, and if $p>n\ge 6$ then $W(\mu)$ belongs to the $p$-Schatten class. (2) There exist Schatten class operators with linearly dependent quantum translates.


title: Early deconfinement of asymptotically conformal color-superconducting quark matter in neutron stars

abstract: We present a relativistic density functional approach to color superconducting quark matter that mimics quark confinement by a fast growth of the quasiparticle selfenergy in the confining region. The approach is shown to be equivalent to a chiral model of quark matter with medium dependent couplings. While the (pseudo)scalar sector of the model is fitted to the vacuum phenomenology of quantum chromodynamics, the strength of interaction in the vector and diquark channels is varied in order to provide the best agreement with the observational constraints on the mass-radius relation and tidal deformability of neutron stars modelled with our approach. In order to recover the conformal behavior of quark matter at asymptotically high densities we introduce a medium dependence of the vector and diquark couplings motivated by the nonperturbative gluon exchange. Our analysis signals that the onset of deconfinement to color superconducting quark matter is likely to occur in neutron stars with masses below 1.0 $M_\odot$.


title: Fast Calibration for Computer Models with Massive Physical Observations

abstract: Computer model calibration is a crucial step in building a reliable computer model. In the face of massive physical observations, a fast estimation for the calibration parameters is urgently needed. To alleviate the computational burden, we design a two-step algorithm to estimate the calibration parameters by employing the subsampling techniques. Compared with the current state-of-the-art calibration methods, the complexity of the proposed algorithm is greatly reduced without sacrificing too much accuracy. We prove the consistency and asymptotic normality of the proposed estimator. The form of the variance of the proposed estimation is also presented, which provides a natural way to quantify the uncertainty of the calibration parameters. The obtained results of two numerical simulations and two real-case studies demonstrate the advantages of the proposed method.


title: Wild-Places: A Large-Scale Dataset for Lidar Place Recognition in Unstructured Natural Environments

abstract: Many existing datasets for lidar place recognition are solely representative of structured urban environments, and have recently been saturated in performance by deep learning based approaches. Natural and unstructured environments present many additional challenges for the tasks of long-term localisation but these environments are not represented in currently available datasets. To address this we introduce Wild-Places, a challenging large-scale dataset for lidar place recognition in unstructured, natural environments. Wild-Places contains eight lidar sequences collected with a handheld sensor payload over the course of fourteen months, containing a total of 63K undistorted lidar submaps along with accurate 6DoF ground truth. Our dataset contains multiple revisits both within and between sequences, allowing for both intra-sequence (i.e. loop closure detection) and inter-sequence (i.e. re-localisation) place recognition. We also benchmark several state-of-the-art approaches to demonstrate the challenges that this dataset introduces, particularly the case of long-term place recognition due to natural environments changing over time. Our dataset and code will be available at https://csiro-robotics.github.io/Wild-Places.


title: Safety Analysis of Autonomous Driving Systems Based on Model Learning

abstract: We present a practical verification method for safety analysis of the autonomous driving system (ADS). The main idea is to build a surrogate model that quantitatively depicts the behaviour of an ADS in the specified traffic scenario. The safety properties proved in the resulting surrogate model apply to the original ADS with a probabilistic guarantee. Furthermore, we explore the safe and the unsafe parameter space of the traffic scenario for driving hazards. We demonstrate the utility of the proposed approach by evaluating safety properties on the state-of-the-art ADS in literature, with a variety of simulated traffic scenarios.


title: A note on the category of c-spaces

abstract: We prove that the category of c-spaces with continuous maps is not cartesian closed. As a corollary the category of locally finitary compact spaces with continuous maps is also not cartesian closed.


title: Fast-iTPN: Integrally Pre-Trained Transformer Pyramid Network with Token Migration

abstract: We propose integrally pre-trained transformer pyramid network (iTPN), towards jointly optimizing the network backbone and the neck, so that transfer gap between representation models and downstream tasks is minimal. iTPN is born with two elaborated designs: 1) The first pre-trained feature pyramid upon vision transformer (ViT). 2) Multi-stage supervision to the feature pyramid using masked feature modeling (MFM). iTPN is updated to Fast-iTPN, reducing computational memory overhead and accelerating inference through two flexible designs. 1) Token migration: dropping redundant tokens of the backbone while replenishing them in the feature pyramid without attention operations. 2) Token gathering: reducing computation cost caused by global attention by introducing few gathering tokens. The base/large-level Fast-iTPN achieve 88.75%/89.5% top-1 accuracy on ImageNet-1K. With 1x training schedule using DINO, the base/large-level Fast-iTPN achieves 58.4%/58.8% box AP on COCO object detection, and a 57.5%/58.7% mIoU on ADE20K semantic segmentation using MaskDINO. Fast-iTPN can accelerate the inference procedure by up to 70%, with negligible performance loss, demonstrating the potential to be a powerful backbone for downstream vision tasks. The code is available at: github.com/sunsmarterjie/iTPN.


title: Hysteretic wavelength selection in isometric, unsupported radial wrinkling

abstract: In [Pal et al., arXiv:2206.03552], the authors discuss how an unsupported flat annulus contracted at its inner boundary by a factor $\Delta$, buckles into a radial wrinkling pattern that is fully isometric and tension-free. What selects the wavelength in such a pure-bending configuration, in the absence of any competing sources of work? In this paper, with the support of numerical simulations, we argue that competition between stretching and bending energies at local, mesoscopic scales leads to the selection of a wavelength scale $\lambda^*$ sensitive to both the width $w$ and thickness $t$ of the sheet: $\lambda^* \sim w^{2/3} t^{1/3} \Delta^{-1/6}$. This scale $\lambda^*$ corresponds to an arrest criterion for wrinkle coarsening starting from any wavelength $\lambda \lesssim \lambda^*$, which can be interpreted in terms of both size and energetic barriers to further coarsening. However, the sheet can support coarser wavelengths: $\lambda \gtrsim \lambda^*$, since there is no penalty to their existence. Since this wavelength selection mechanism depends on the value of $\lambda$ itself, it is hysteretic.


title: RoentGen: Vision-Language Foundation Model for Chest X-ray Generation

abstract: Multimodal models trained on large natural image-text pair datasets have exhibited astounding abilities in generating high-quality images. Medical imaging data is fundamentally different to natural images, and the language used to succinctly capture relevant details in medical data uses a different, narrow but semantically rich, domain-specific vocabulary. Not surprisingly, multi-modal models trained on natural image-text pairs do not tend to generalize well to the medical domain. Developing generative imaging models faithfully representing medical concepts while providing compositional diversity could mitigate the existing paucity of high-quality, annotated medical imaging datasets. In this work, we develop a strategy to overcome the large natural-medical distributional shift by adapting a pre-trained latent diffusion model on a corpus of publicly available chest x-rays (CXR) and their corresponding radiology (text) reports. We investigate the model's ability to generate high-fidelity, diverse synthetic CXR conditioned on text prompts. We assess the model outputs quantitatively using image quality metrics, and evaluate image quality and text-image alignment by human domain experts. We present evidence that the resulting model (RoentGen) is able to create visually convincing, diverse synthetic CXR images, and that the output can be controlled to a new extent by using free-form text prompts including radiology-specific language. Fine-tuning this model on a fixed training set and using it as a data augmentation method, we measure a 5% improvement of a classifier trained jointly on synthetic and real images, and a 3% improvement when trained on a larger but purely synthetic training set. Finally, we observe that this fine-tuning distills in-domain knowledge in the text-encoder and can improve its representation capabilities of certain diseases like pneumothorax by 25%.


title: Differentially Private Fair Division

abstract: Fairness and privacy are two important concerns in social decision-making processes such as resource allocation. We study privacy in the fair allocation of indivisible resources using the well-established framework of differential privacy. We present algorithms for approximate envy-freeness and proportionality when two instances are considered to be adjacent if they differ only on the utility of a single agent for a single item. On the other hand, we provide strong negative results for both fairness criteria when the adjacency notion allows the entire utility function of a single agent to change.


title: Texts as Images in Prompt Tuning for Multi-Label Image Recognition

abstract: Prompt tuning has been employed as an efficient way to adapt large vision-language pre-trained models (e.g. CLIP) to various downstream tasks in data-limited or label-limited settings. Nonetheless, visual data (e.g., images) is by default prerequisite for learning prompts in existing methods. In this work, we advocate that the effectiveness of image-text contrastive learning in aligning the two modalities (for training CLIP) further makes it feasible to treat texts as images for prompt tuning and introduce TaI prompting. In contrast to the visual data, text descriptions are easy to collect, and their class labels can be directly derived. Particularly, we apply TaI prompting to multi-label image recognition, where sentences in the wild serve as alternatives to images for prompt tuning. Moreover, with TaI, double-grained prompt tuning (TaI-DPT) is further presented to extract both coarse-grained and fine-grained embeddings for enhancing the multi-label recognition performance. Experimental results show that our proposed TaI-DPT outperforms zero-shot CLIP by a large margin on multiple benchmarks, e.g., MS-COCO, VOC2007, and NUS-WIDE, while it can be combined with existing methods of prompting from images to improve recognition performance further. Code is released at https://github.com/guozix/TaI-DPT.


title: Masked Autoencoding for Scalable and Generalizable Decision Making

abstract: We are interested in learning scalable agents for reinforcement learning that can learn from large-scale, diverse sequential data similar to current large vision and language models. To this end, this paper presents masked decision prediction (MaskDP), a simple and scalable self-supervised pretraining method for reinforcement learning (RL) and behavioral cloning (BC). In our MaskDP approach, we employ a masked autoencoder (MAE) to state-action trajectories, wherein we randomly mask state and action tokens and reconstruct the missing data. By doing so, the model is required to infer masked-out states and actions and extract information about dynamics. We find that masking different proportions of the input sequence significantly helps with learning a better model that generalizes well to multiple downstream tasks. In our empirical study, we find that a MaskDP model gains the capability of zero-shot transfer to new BC tasks, such as single and multiple goal reaching, and it can zero-shot infer skills from a few example transitions. In addition, MaskDP transfers well to offline RL and shows promising scaling behavior w.r.t. to model size. It is amenable to data-efficient finetuning, achieving competitive results with prior methods based on autoregressive pretraining.


title: Homotopy Types of Suspended $4$-manifolds

abstract: Given a closed, smooth, connected, orientable $4$-manifold $M$, whose integral homology groups can have $2$-torsion, we determine the homotopy decomposition of the double suspension $\Sigma^2M$ as wedge sums of some elementary $\mathbf{A}_3^3$-complexes, which are $2$-connected finite complexes of dimension at most $6$. Furthermore, we utilize the Postnikov square (or equivalently Pontryagin square) to find sufficient conditions for the homotopy decompositions of $\Sigma^2M$ to desuspend to that of $\Sigma M$.


title: Spectral theorem for dummies: A pedagogical discussion on quantum probability and random variable theory

abstract: John von Neumann's spectral theorem for self-adjoint operators is a cornerstone of quantum mechanics. Among other things, it also provides a connection between expectation values of self-adjoint operators and expected values of real-valued random variables. This paper presents a plain-spoken formulation of this theorem in terms of Dirac's bra and ket notation, which is based on physical intuition and provides techniques that are important for performing actual calculations. The goal is to engage students in a constructive discussion about similarities and differences in the use of random variables in classical and quantum mechanics. Special emphasis is given on operators that are simple functions of noncommuting self-adjoint operators. The presentation is self-contained and includes detailed calculations for the most relevant results.