title: Floquet engineering of strongly-driven excitons in monolayer tungsten disulfide

abstract: Interactions of quantum materials with strong-laser fields can induce exotic nonequilibrium electronic states. Monolayer transition-metal dichalcogenides, a new class of direct-gap semiconductors with prominent quantum confinement, offer exceptional opportunities toward Floquet engineering of quasiparticle electron-hole states, or excitons. Strong-field driving has a potential to achieve enhanced control of electronic band structure, thus a possibility to open a new realm of exciton light-matter interactions. However, experimental implementation of strongly-driven excitons has so far remained out of reach. Here, we use mid-infrared laser pulses below the optical bandgap to excite monolayer tungsten disulfide up to a field strength of 0.3 V/nm, and demonstrate strong-field light dressing of excitons in the excess of a hundred millielectronvolt. Our high-sensitivity transient absorption spectroscopy further reveals formation of a virtual absorption feature below the 1s-exciton resonance, which is assigned to a light-dressed sideband from the dark 2p-exciton state. Quantum-mechanical simulations substantiate the experimental results and enable us to retrieve real-space movies of the exciton dynamics. This study advances our understanding of the exciton dynamics in the strong-field regime, and showcases the possibility of harnessing ultrafast, strong-field phenomena in device applications of two-dimensional materials.


title: A Damped Newton Method Achieves Global $O\left(\frac{1}{k^2}\right)$ and Local Quadratic Convergence Rate

abstract: In this paper, we present the first stepsize schedule for Newton method resulting in fast global and local convergence guarantees. In particular, a) we prove an $O\left( \frac 1 {k^2} \right)$ global rate, which matches the state-of-the-art global rate of cubically regularized Newton method of Polyak and Nesterov (2006) and of regularized Newton method of Mishchenko (2021) and Doikov and Nesterov (2021), b) we prove a local quadratic rate, which matches the best-known local rate of second-order methods, and c) our stepsize formula is simple, explicit, and does not require solving any subproblem. Our convergence proofs hold under affine-invariance assumptions closely related to the notion of self-concordance. Finally, our method has competitive performance when compared to existing baselines, which share the same fast global convergence guarantees.


title: Definably semisimple groups interpretable in $p$-adically closed fields

abstract: Let $K$ be a $p$-adically closed field and $G$ a group interpretable in $K$. We show that if $G$ is definably semisimple (i.e. $G$ has no definable infinite normal abelian subgroups) then there exists a finite normal subgroup $H$ such that $G/H$ is definably isomorphic to a $K$-linear group. The result remains true in models of $\mathrm{Th}(\mathbb{Q}_p^{an})$.


title: TaTa: A Multilingual Table-to-Text Dataset for African Languages

abstract: Existing data-to-text generation datasets are mostly limited to English. To address this lack of data, we create Table-to-Text in African languages (TaTa), the first large multilingual table-to-text dataset with a focus on African languages. We created TaTa by transcribing figures and accompanying text in bilingual reports by the Demographic and Health Surveys Program, followed by professional translation to make the dataset fully parallel. TaTa includes 8,700 examples in nine languages including four African languages (Hausa, Igbo, Swahili, and Yor\`ub\'a) and a zero-shot test language (Russian). We additionally release screenshots of the original figures for future research on multilingual multi-modal approaches. Through an in-depth human evaluation, we show that TaTa is challenging for current models and that less than half the outputs from an mT5-XXL-based model are understandable and attributable to the source data. We further demonstrate that existing metrics perform poorly for TaTa and introduce learned metrics that achieve a high correlation with human judgments. We release all data and annotations at https://github.com/google-research/url-nlp.


title: The Quantum Socket and DemuXYZ-Based Gates with Superconducting Qubits

abstract: Building large-scale superconducting quantum computers requires two complimentary elements: scalable wiring techniques and multiplex architectures. In our previous work [B\'ejanin et al., Phys. Rev. Applied 6, 044010 (2016)], we have introduced and characterized a truly vertical interconnect named the quantum socket. In this paper, we exercise the quantum socket using high-coherence flux-tunable Xmon transmon qubits. In particular, we test potential qubit heating and one-qubit gate performance. We observe no heating effects and time-stable gate fidelities in excess of 99.9%. We then propose and experimentally characterize a demultiplexed gate technique based on flux pulses and a common continuous drive signal: DemuXYZ. We discuss DemuXYZ's working principle, show its operation, and perform quantum process tomography on a selection of one-qubit gates to confirm proper operation. We obtain fidelities around 93% likely limited by flux-pulse imperfections. We finally discuss future solutions for wiring integration as well as improvements to the DemuXYZ technique.


title: Asymptotic symmetry and group invariance for randomization

abstract: Symmetry is a cornerstone of much of mathematics, and many probability distributions possess symmetries characterized by their invariance to a collection of group actions. Thus, many mathematical and statistical methods rely on such symmetry holding and ostensibly fail if symmetry is broken. This work considers under what conditions a sequence of probability measures asymptotically gains such symmetry or invariance to a collection of group actions. Considering the many symmetries of the Gaussian distribution, this work effectively proposes a non-parametric type of central limit theorem. That is, a Lipschitz function of a high dimensional random vector will be asymptotically invariant to the actions of certain compact topological groups. Applications of this include a partial law of the iterated logarithm for uniformly random points in an $\ell_p^n$-ball and an asymptotic equivalence between classical parametric statistical tests and their randomization counterparts even when invariance assumptions are violated.


title: Limit theorems for random Dirichlet series

abstract: We prove a functional limit theorem in a space of analytic functions for the random Dirichlet series $D(\alpha;z)=\sum_{n\geq 2}(\log n)^{\alpha}(\eta_n+{\rm i} \theta_n)/n^z$, properly scaled and normalized, where $(\eta_n,\theta_n)_{n\in\mathbb{N}}$ is a sequence of independent copies of a centered $\mathbb{R}^2$-valued random vector $(\eta,\theta)$ with a finite second moment and $\alpha>-1/2$ is a fixed real parameter. As a consequence, we show that the point processes of complex and real zeros of $D(\alpha;z)$ converge vaguely, thereby obtaining a universality result. In the real case, that is, when $\mathbb{P}\{\theta=0\}=1$, we also prove a law of the iterated logarithm for $D(\alpha;z)$, properly normalized, as $z\to (1/2)+$.


title: Scalable van der Waals epitaxy of tunable moir\'e heterostructures

abstract: The unique physics found in moir\'e superlattices of twisted or lattice-mismatched atomic layers hold great promise for future quantum technologies. However, twisted configurations are typically thermodynamically unfavorable, making the accurate twist angle control in direct growth implausible. While rotationally aligned moir\'e superlattices based on lattice-mismatched layers such as WSe2/WS2 can be synthesized, they lack the critical tunability of the moir\'e period and the moir\'e formation mechanisms are not well-understood. Here, we report the scalable, thermodynamically driven van der Waals epitaxy of stable moir\'es with tunable period from 10 to 45 nanometers, based on lattice mismatch engineering in two WSSe layers with adjustable chalcogens ratios. Contrarily to conventional epitaxy, where lattice mismatch induced stress hinders high-quality growth, we reveal the key role of bulk stress in moir\'e formation, as well as its unique interplay with edge stress in shaping the moir\'e growth modes. Moreover, the synthesized superlattices display tunable interlayer, and moir\'e intralayer excitons. Our studies unveil the unique epitaxial science of moir\'e synthesis and lay the foundations for moir\'e-based technologies.


title: A Machine Learning Tutorial for Operational Meteorology, Part II: Neural Networks and Deep Learning

abstract: Over the past decade the use of machine learning in meteorology has grown rapidly. Specifically neural networks and deep learning have been used at an unprecedented rate. In order to fill the dearth of resources covering neural networks with a meteorological lens, this paper discusses machine learning methods in a plain language format that is targeted for the operational meteorological community. This is the second paper in a pair that aim to serve as a machine learning resource for meteorologists. While the first paper focused on traditional machine learning methods (e.g., random forest), here a broad spectrum of neural networks and deep learning methods are discussed. Specifically this paper covers perceptrons, artificial neural networks, convolutional neural networks and U-networks. Like the part 1 paper, this manuscript discusses the terms associated with neural networks and their training. Then the manuscript provides some intuition behind every method and concludes by showing each method used in a meteorological example of diagnosing thunderstorms from satellite images (e.g., lightning flashes). This paper is accompanied with an open-source code repository to allow readers to explore neural networks using either the dataset provided (which is used in the paper) or as a template for alternate datasets.


title: On the role of transverse detonation waves in the re-establishment of attenuated detonations in methane-oxygen

abstract: The problem of detonation attenuation in stoichiometric methane-oxygen and its re-establishment following its interaction with obstacles was investigated using high resolution numerical simulation. The main focus was on the role of the transverse detonation on the re-establishment of the detonation wave. We applied an efficient thermochemically derived four-step global combustion model using an Euler simulation framework to investigate the critical regimes present. While past attempts at using one- or two- step models have failed to capture transverse detonations, for this scenario, our simulations have demonstrated that the four-step combustion model is able to capture this feature. We suggest that to correctly model detonation re-initiation in characteristically unstable mixtures, an applied combustion model should contain at least an adequate description to permit the correct ignition and state variable response when changes in temperature and pressure occur. Our simulations reveal that there is a relationship between the critical outcomes possible and the mixture cell size, and while pockets of unburned gas may exist when a detonation re-initiates, it is not the direct rapid consumption of these pockets that gives rise to transverse detonations. Instead, the transverse detonations are initiated through pressure amplification of reaction zones at burned/unburned gas interfaces whose combustion rates have been enhanced through Richmyer-Meshkov instabilities associated with the passing of transverse shock waves, or by spontaneous ignition of hot spots, which can form into detonations through the Zel'dovich gradient mechanism. In both situations, non-uniform ignition delay times are found to play a role. Finally, we found that the transverse detonations are in fact Chapman-Jouguet detonations, but whose presence contributes to overdriving the re-initiated detonation along the Mach stem.


title: Improving Motion Forecasting for Autonomous Driving with the Cycle Consistency Loss

abstract: Robust motion forecasting of the dynamic scene is a critical component of an autonomous vehicle. It is a challenging problem due to the heterogeneity in the scene and the inherent uncertainties in the problem. To improve the accuracy of motion forecasting, in this work, we identify a new consistency constraint in this task, that is an agent's future trajectory should be coherent with its history observations and visa versa. To leverage this property, we propose a novel cycle consistency training scheme and define a novel cycle loss to encourage this consistency. In particular, we reverse the predicted future trajectory backward in time and feed it back into the prediction model to predict the history and compute the loss as an additional cycle loss term. Through our experiments on the Argoverse dataset, we demonstrate that cycle loss can improve the performance of competitive motion forecasting models.


title: A 5G Enabled Adaptive Computing Workflow for Greener Power Grid

abstract: 5G wireless technology can deliver higher data speeds, ultra low latency, more reliability, massive network capacity, increased availability, and a more uniform user experience to users. It brings additional power to help address the challenges brought by renewable integration and decarbonization. In this paper, a 5G enabled adaptive computing workflow has been presented that consists of various computing resources, such as 5G equipment, edge computing, cluster, Graphics processing unit (GPU) and cloud computing, with two examples showing technical feasibility for edge-grid-cloud interaction for power system real-time monitoring, security assessment, and forecasting. Benefiting from the high speed data transport and massive connection capability of 5G, the workflow shows its potential to seamlessly integrate various applications at distributed and/or centralized locations to build more complex and powerful functions, with better flexibility.


title: A Close Look into the Calibration of Pre-trained Language Models

abstract: Pre-trained language models (PLMs) may fail in giving reliable estimates of their predictive uncertainty. We take a close look into this problem, aiming to answer two questions: (1) Do PLMs learn to become calibrated in the training process? (2) How effective are existing calibration methods? For the first question, we conduct fine-grained control experiments to study the dynamic change in PLMs' calibration performance in training. We consider six factors as control variables, including dataset difficulty, available training samples, training steps, the number of tunable parameters, model scale, and pretraining. We observe a consistent change in calibration performance across six factors. We find that PLMs don't learn to become calibrated in training, evidenced by the continual increase in confidence, no matter whether the predictions are correct or not. We highlight that our finding somewhat contradicts two established conclusions: (a) Larger PLMs are more calibrated; (b) Pretraining improves model calibration. Next, we study the effectiveness of existing calibration methods in mitigating the overconfidence issue. Besides unlearnable calibration methods (e.g., label smoothing), we adapt and extend two recently proposed learnable methods that directly collect data to train models to have reasonable confidence estimations. Experimental results show that learnable methods significantly reduce PLMs' confidence in wrong predictions. The code is available at \url{https://github.com/lifan-yuan/PLMCalibration}.


title: Multi-scale physical properties of NGC 6334 as revealed by local relative orientations between magnetic fields, density gradients, velocity gradients, and gravity

abstract: We present ALMA dust polarization and molecular line observations toward 4 clumps (I(N), I, IV, and V) in the massive star-forming region NGC 6334. In conjunction with large-scale dust polarization and molecular line data from JCMT, Planck, and NANTEN2, we make a synergistic analysis of relative orientations between magnetic fields ($\theta_{\mathrm{B}}$), column density gradients ($\theta_{\mathrm{NG}}$), local gravity ($\theta_{\mathrm{LG}}$), and velocity gradients ($\theta_{\mathrm{VG}}$) to investigate the multi-scale (from $\sim$30 pc to 0.003 pc) physical properties in NGC 6334. We find that the relative orientation between $\theta_{\mathrm{B}}$ and $\theta_{\mathrm{NG}}$ changes from statistically more perpendicular to parallel as column density ($N_{\mathrm{H_2}}$) increases, which is a signature of trans-to-sub-Alfv\'{e}nic turbulence at complex/cloud scales as revealed by previous numerical studies. Because $\theta_{\mathrm{NG}}$ and $\theta_{\mathrm{LG}}$ are preferentially aligned within the NGC 6334 cloud, we suggest that the more parallel alignment between $\theta_{\mathrm{B}}$ and $\theta_{\mathrm{NG}}$ at higher $N_{\mathrm{H_2}}$ is because the magnetic field line is dragged by gravity. At even higher $N_{\mathrm{H_2}}$, the angle between $\theta_{\mathrm{B}}$ and $\theta_{\mathrm{NG}}$ or $\theta_{\mathrm{LG}}$ transits back to having no preferred orientation or statistically slightly more perpendicular, suggesting that the magnetic field structure is impacted by star formation activities. A statistically more perpendicular alignment is found between $\theta_{\mathrm{B}}$ and $\theta_{\mathrm{VG}}$ throughout our studied $N_{\mathrm{H_2}}$ range, which indicates a trans-to-sub-Alfv\'{e}nic state at small scales as well. The normalised mass-to-flux ratio derived from the polarization-intensity gradient (KTH) method increases with $N_{\mathrm{H_2}}$.


title: Do LSTMs See Gender? Probing the Ability of LSTMs to Learn Abstract Syntactic Rules

abstract: LSTMs trained on next-word prediction can accurately perform linguistic tasks that require tracking long-distance syntactic dependencies. Notably, model accuracy approaches human performance on number agreement tasks (Gulordava et al., 2018). However, we do not have a mechanistic understanding of how LSTMs perform such linguistic tasks. Do LSTMs learn abstract grammatical rules, or do they rely on simple heuristics? Here, we test gender agreement in French which requires tracking both hierarchical syntactic structures and the inherent gender of lexical units. Our model is able to reliably predict long-distance gender agreement in two subject-predicate contexts: noun-adjective and noun-passive-verb agreement. The model showed more inaccuracies on plural noun phrases with gender attractors compared to singular cases, suggesting a reliance on clues from gendered articles for agreement. Overall, our study highlights key ways in which LSTMs deviate from human behaviour and questions whether LSTMs genuinely learn abstract syntactic rules and categories. We propose using gender agreement as a useful probe to investigate the underlying mechanisms, internal representations, and linguistic capabilities of LSTM language models.


title: Developing Reprogrammable Metasurfaces with Compressed Pre-curved Beams: Theory and Applications

abstract: This paper presents a mechanically bistable mechanism of the compressed pre-curved beam. A governing equation is proposed which can be used to predict and explain the bistability of the compressed pre-curved beam. FE simulations and experimental tests are performed to validate the analytical solution. The beams unique tunable and asymmetrical potential energy landscape is demonstrated which enables the compressed pre-curved beam to switch its stable position without the need of applying an external force to it. Based on that, a coupled beam element is designed and used as a building block to develop reprogrammable metasurfaces that can be programmed to exhibit different configurations.


title: A Sum-Rules Analysis of Next-to-Leading-Order (NLO) QCD Perturbative Contributions to a $J^{PC}=0^{+-}$, $du\bar{d}\bar{u}$ Tetraquark Correlator

abstract: We calculated next-to-leading-order (NLO) QCD perturbative contributions to a $J^{PC}=0^{+-}$, $d u\bar d\bar u$ tetraquark (diquark-antidiquark) correlator in the chiral limit of massless $u$ and $d$ quarks. At NLO, there are four quark self-energy diagrams and six gluon-exchange diagrams. Nonlocal divergences were cancelled using diagrammatic renormalization. Dimensionally regularized integrals were numerically computed using pySecDec. The combination of pySecDec with diagrammatic renormalization establishes a valuable new methodology for NLO calculations of QCD correlation functions. Compared to leading-order (LO) perturbation theory, we found that NLO perturbation theory is significant. To quantify the impact of NLO perturbation theory on physical predictions, we computed NLO perturbative contributions to QCD Laplace, Gaussian, and finite-energy sum rules. Using QCD sum rules, we determined upper and lower bounds on the $0^{+-}$, $d u\bar d\bar u$ tetraquark ground-state mass, $M$: at NLO in perturbation theory, we found $2.2~\text{GeV}\lesssim M\leq 4.2~\text{GeV}$ whereas, at LO, we found $2.4~\text{GeV}\lesssim M\leq 4.6~\text{GeV}$. This mass range suggests the possibility of mixing between $0^{+-}$, light-quark (i.e., $u$ and $d$ quarks) hybrid and $d u\bar d\bar u$ tetraquark states. Taking into account uncertainties in QCD parameters, we found no evidence for a $0^{+-}$, $d u\bar d\bar u$ tetraquark under 1.9 GeV.


title: Precise near-infrared photometry, accounting for precipitable water vapour at SPECULOOS Southern Observatory

abstract: The variability induced by precipitable water vapour (PWV) can heavily affect the accuracy of time-series photometric measurements gathered from the ground, especially in the near-infrared. We present here a novel method of modelling and mitigating this variability, as well as open-sourcing the developed tool -- Umbrella. In this study, we evaluate the extent to which the photometry in three common bandpasses (r', i', z'), and SPECULOOS' primary bandpass (I+z'), are photometrically affected by PWV variability. In this selection of bandpasses, the I+z' bandpass was found to be most sensitive to PWV variability, followed by z', i', and r'. The correction was evaluated on global light curves of nearby late M- and L-type stars observed by SPECULOOS' Southern Observatory (SSO) with the I+z' bandpass, using PWV measurements from the LHATPRO and local temperature/humidity sensors. A median reduction in RMS of 1.1% was observed for variability shorter than the expected transit duration for SSO's targets. On timescales longer than the expected transit duration, where long-term variability may be induced, a median reduction in RMS of 53.8% was observed for the same method of correction.


title: Large scale traffic forecasting with gradient boosting, Traffic4cast 2022 challenge

abstract: Accurate traffic forecasting is of the utmost importance for optimal travel planning and for efficient city mobility. IARAI (The Institute of Advanced Research in Artificial Intelligence) organizes Traffic4cast, a yearly traffic prediction competition based on real-life data [https://www.iarai.ac.at/traffic4cast/], aiming to leverage artificial intelligence advances for producing accurate traffic estimates. We present our solution to the IARAI Traffic4cast 2022 competition, in which the goal is to develop algorithms for predicting road graph edge congestion classes and supersegment-level travel times. In contrast to the previous years, this year's competition focuses on modelling graph edge level behaviour, rather than more coarse aggregated grid-based traffic movies. Due to this, we leverage a method familiar from tabular data modelling -- gradient-boosted decision tree ensembles. We reduce the dimensionality of the input data representing traffic counters with the help of the classic PCA method and feed it as input to a LightGBM model. This simple, fast, and scalable technique allowed us to win second place in the core competition. The source code and references to trained model files and submissions are available at https://github.com/skandium/t4c22 .


title: Continuous collective strong coupling between atoms and a high finesse optical cavity

abstract: We demonstrate continuous loading of strontium atoms into a high finesse ring cavity and observe continuous strong collective coupling in the form of a vacuum Rabi splitting between the atoms and the cavity on the 7.5 kHz transition $^1{\rm S}_0$ to $^3{\rm P}_1$. The atoms are loaded into the cavity from a 3D narrow linewidth molasses, thus avoiding large magnetic field gradients and associated broadening of transition frequencies. The ring cavity allows us to realize a deterministic conveyor belt to transport atoms away from the loading region where the laser cooling beams lead to broadening of the strontium clock transition. We trap up to $10^6$ atoms in an intracavity 813 nm lattice in the Lamb-Dicke regime, and transport the atoms along the cavity axis. This work opens the path to the creation of a continuous wave superradiant laser with millihertz linewidth enabling searches for new physics and the use of high-precision optical frequency references outside of low vibration laboratory environments.


title: Backscattering and Line Broadening in Orion

abstract: Examination of emission lines in high-velocity resolution optical spectra of the Orion Nebula confirms that the velocity component on the red wing of the main ionization front emission line is due to backscattering in the Photon Dominated Region. This scattered light component has a weak wavelength dependence that is consistent with either general interstellar medium particles or particles in the foreground of the Orion Nebula Cluster. An anomalous line-broadening component that has been known for 60+ years is characterized in unprecedented detail. Although this extra broadening may be due to turbulence along the line-of-sight of our spectra, we explore the possibility that it is due to \alf\ waves in conditions where the ratio of magnetic and thermal energies are about equal and constant throughout the ionized gas.


title: On Sylvester-type constructions of Hadamard matrices and their modifications

abstract: Using the ideas of concatenation construction of codes over the $q$-ary alphabet, we modify the known generalized Sylvester-type construction of the Hadamard matrices. The new construction is based on two collections of the Hadamard matrices. In particular this construction involves $m$ Hadamard matrices of order $k$ and $k$ Hadamard matrices of order $m$. These matrices are not necessary different. As a result we obtain a Hadamard matrix of order $km$. The new construction gives many possibilities for construction of the new Hadamard matrices with different ranks and dimension of kernel.


title: Complex topological features of reservoirs shape learning performances in bio-inspired recurrent neural networks

abstract: Recurrent networks are a special class of artificial neural systems that use their internal states to perform computing tasks for machine learning. One of its state-of-the-art developments, i.e. reservoir computing (RC), uses the internal structure -- usually a static network with random structure -- to map an input signal into a nonlinear dynamical system defined in a higher dimensional space. Reservoirs are characterized by nonlinear interactions among their units and their ability to store information through recurrent loops, allowing to train artificial systems to learn task-specific dynamics. However, it is fundamentally unknown how the random topology of the reservoir affects the learning performance. Here, we fill this gap by considering a battery of synthetic networks -- characterized by different topological features -- and 45 empirical connectomes -- sampled from brain regions of organisms belonging to 8 different species -- to build the reservoir and testing the learning performance against a prediction task with a variety of complex input signals. We find nontrivial correlations between RC performances and both the number of nodes and rank of the covariance matrix of activation states, with performance depending on the nature -- stochastic or deterministic -- of input signals. Remarkably, the modularity and the link density of the reservoir are found to affect RC performances: these results cannot be predicted by models only accounting for simple topological features of the reservoir. Overall, our findings highlight that the complex topological features characterizing biophysical computing systems such as connectomes can be used to design efficient bio-inspired artificial neural networks.


title: Constrained Efficient Global Optimization of Expensive Black-box Functions

abstract: We study the problem of constrained efficient global optimization, where both the objective and constraints are expensive black-box functions that can be learned with Gaussian processes. We propose CONFIG (CONstrained efFIcient Global Optimization), a simple and effective algorithm to solve it. Under certain regularity assumptions, we show that our algorithm enjoys the same cumulative regret bound as that in the unconstrained case and similar cumulative constraint violation upper bounds. For commonly used Matern and Squared Exponential kernels, our bounds are sublinear and allow us to derive a convergence rate to the optimal solution of the original constrained problem. In addition, our method naturally provides a scheme to declare infeasibility when the original black-box optimization problem is infeasible. Numerical experiments on sampled instances from the Gaussian process, artificial numerical problems, and a black-box building controller tuning problem all demonstrate the competitive performance of our algorithm. Compared to the other state-of-the-art methods, our algorithm significantly improves the theoretical guarantees, while achieving competitive empirical performance.


title: Can the potential benefit of individualizing treatment be assessed using trial summary statistics alone?

abstract: Individualizing treatment assignment can improve outcomes for diseases with patient-to-patient variability in comparative treatment effects. When a clinical trial demonstrates that some patients improve on treatment while others do not, it is tempting to assume that treatment effect heterogeneity exists. However, if variability in response is mainly driven by factors other than treatment, investigating the extent to which covariate data can predict differential treatment response is a potential waste of resources. Motivated by recent meta-analyses assessing the potential of individualizing treatment for major depressive disorder using only summary statistics, we provide a method that uses summary statistics widely available in published clinical trial results to bound the benefit of optimally assigning treatment to each patient. We also offer alternate bounds for settings in which trial results are stratified by another covariate. We demonstrate our approach using summary statistics from a depression treatment trial. Our methods are implemented in the rct2otrbounds R package, which is available at https://github.com/ngalanter/rct2otrbounds .


title: Agent-Controller Representations: Principled Offline RL with Rich Exogenous Information

abstract: Learning to control an agent from data collected offline in a rich pixel-based visual observation space is vital for real-world applications of reinforcement learning (RL). A major challenge in this setting is the presence of input information that is hard to model and irrelevant to controlling the agent. This problem has been approached by the theoretical RL community through the lens of exogenous information, i.e, any control-irrelevant information contained in observations. For example, a robot navigating in busy streets needs to ignore irrelevant information, such as other people walking in the background, textures of objects, or birds in the sky. In this paper, we focus on the setting with visually detailed exogenous information, and introduce new offline RL benchmarks offering the ability to study this problem. We find that contemporary representation learning techniques can fail on datasets where the noise is a complex and time dependent process, which is prevalent in practical applications. To address these, we propose to use multi-step inverse models, which have seen a great deal of interest in the RL theory community, to learn Agent-Controller Representations for Offline-RL (ACRO). Despite being simple and requiring no reward, we show theoretically and empirically that the representation created by this objective greatly outperforms baselines.


title: Equation of State of a Strongly Interacting many-Boson System from an Effective Interaction

abstract: A contact potential describing an effective interaction between atomic $^4$He reproducing the results obtained with the HFDHE2 potential by Aziz et al. is employed to study the resulting equation of state by means of Quantum Monte Carlo calculations. \cblack The energy per particle and the pair distribution functions were investigated as a function of the ultraviolet cutoff $\Lambda$. The results suggest that not only the mean field properties of the system, such as the energy and the saturation density, are correctly reproduced, but also very microscopic quantities such as the pair distribution function are seen to converge towards the exact results when extrapolating for $\Lambda\rightarrow\infty$.


title: Decorrelating ReSTIR Samplers via MCMC Mutations

abstract: Monte Carlo rendering algorithms often utilize correlations between pixels to improve efficiency and enhance image quality. For real-time applications in particular, repeated reservoir resampling offers a powerful framework to reuse samples both spatially in an image and temporally across multiple frames. While such techniques achieve equal-error up to 100 times faster for real-time direct lighting and global illumination, they are still far from optimal. For instance, unchecked spatiotemporal resampling often introduces noticeable correlation artifacts, while reservoirs holding more than one sample suffer from impoverishment in the form of duplicate samples. We demonstrate how interleaving Markov Chain Monte Carlo (MCMC) mutations with reservoir resampling helps alleviate these issues, especially in scenes with glossy materials and difficult-to-sample lighting. Moreover, our approach does not introduce any bias, and in practice we find considerable improvement in image quality with just a single mutation per reservoir sample in each frame.


title: Instantaneous mapping of liquid crystal orientation using a polychromatic polarizing microscope

abstract: Polarizing microscopy brought about many advancements in the science of liquid crystals and other soft materials, including those of biological origin. Recent developments in optics and computer-based analysis enabled a new generation of quantitative polarizing microscopy which produces spatial maps of the optic axis. Unfortunately, most of the available approaches require a long acquisition time of multiple images which are then analyzed to produce the map. We describe a polychromatic polarizing microscope, which allows one to map the patterns of the optical axis in a single-shot exposure, thus enabling a fast temporal resolution. We present a comparative analysis of the new microscope with alternative techniques such as a conventional polarizing optical microscope and MicroImager of Hinds Instruments.


title: Improving Fairness in Image Classification via Sketching

abstract: Fairness is a fundamental requirement for trustworthy and human-centered Artificial Intelligence (AI) system. However, deep neural networks (DNNs) tend to make unfair predictions when the training data are collected from different sub-populations with different attributes (i.e. color, sex, age), leading to biased DNN predictions. We notice that such a troubling phenomenon is often caused by data itself, which means that bias information is encoded to the DNN along with the useful information (i.e. class information, semantic information). Therefore, we propose to use sketching to handle this phenomenon. Without losing the utility of data, we explore the image-to-sketching methods that can maintain useful semantic information for the target classification while filtering out the useless bias information. In addition, we design a fair loss to further improve the model fairness. We evaluate our method through extensive experiments on both general scene dataset and medical scene dataset. Our results show that the desired image-to-sketching method improves model fairness and achieves satisfactory results among state-of-the-art.


title: SIS Epidemic Spreading under Multi-layer Population Dispersal in Patchy Environments

abstract: We study SIS epidemic spreading models under population dispersal on multi-layer networks. We consider a patchy environment in which each patch comprises individuals belonging to different classes. Individuals disperse to other patches on a multi-layer network in which each layer corresponds to a class. The dispersal on each layer is modeled by a Continuous Time Markov Chain (CTMC). At each time, individuals disperse according to their CTMC and subsequently interact with the local individuals in the patch according to an SIS model. We establish the existence of various equilibria under different parameter regimes and establish their (almost) global asymptotic stability using Lyapunov techniques. We also derive simple conditions that highlight the influence of the multi-layer network on the stability of these equilibria. For this model, we study optimal intervention strategies using a convex optimization framework. Finally, we numerically illustrate the influence of the multi-layer network structure and the effectiveness of the optimal intervention strategies.


title: What is my math transformer doing? -- Three results on interpretability and generalization

abstract: This paper investigates the failure cases and out-of-distribution behavior of transformers trained on matrix inversion and eigenvalue decomposition. I show that incorrect model predictions still retain deep mathematical properties of the solution (e.g. correct eigenvalues, unit norm of eigenvectors), and that almost all model failures can be attributed to, and predicted from, properties of the problem or solution. This demonstrates that, when in doubt, math transformers do not hallucinate absurd solutions (as was sometimes proposed) but remain ``roughly right''. I also show that the careful choice of a training dataset can accelerate training, while allowing the model to generalize out of its training distribution, invalidating the idea that transformers ``merely interpolate'' from memorized examples.


title: Using Emotion Embeddings to Transfer Knowledge Between Emotions, Languages, and Annotation Formats

abstract: The need for emotional inference from text continues to diversify as more and more disciplines integrate emotions into their theories and applications. These needs include inferring different emotion types, handling multiple languages, and different annotation formats. A shared model between different configurations would enable the sharing of knowledge and a decrease in training costs, and would simplify the process of deploying emotion recognition models in novel environments. In this work, we study how we can build a single model that can transition between these different configurations by leveraging multilingual models and Demux, a transformer-based model whose input includes the emotions of interest, enabling us to dynamically change the emotions predicted by the model. Demux also produces emotion embeddings, and performing operations on them allows us to transition to clusters of emotions by pooling the embeddings of each cluster. We show that Demux can simultaneously transfer knowledge in a zero-shot manner to a new language, to a novel annotation format and to unseen emotions. Code is available at https://github.com/gchochla/Demux-MEmo .


title: Infusing known operators in convolutional neural networks for lateral strain imaging in ultrasound elastography

abstract: Convolutional Neural Networks (CNN) have been employed for displacement estimation in ultrasound elastography (USE). High-quality axial strains (derivative of the axial displacement in the axial direction) can be estimated by the proposed networks. In contrast to axial strain, lateral strain, which is highly required in Poisson's ratio imaging and elasticity reconstruction, has a poor quality. The main causes include low sampling frequency, limited motion, and lack of phase information in the lateral direction. Recently, physically inspired constraint in unsupervised regularized elastography (PICTURE) has been proposed. This method took into account the range of the feasible lateral strain defined by the rules of physics of motion and employed a regularization strategy to improve the lateral strains. Despite the substantial improvement, the regularization was only applied during the training; hence it did not guarantee during the test that the lateral strain is within the feasible range. Furthermore, only the feasible range was employed, other constraints such as incompressibility were not investigated. In this paper, we address these two issues and propose kPICTURE in which two iterative algorithms were infused into the network architecture in the form of known operators to ensure the lateral strain is within the feasible range and impose incompressibility during the test phase.


title: Density Matrix Renormalization Group for Transcorrelated Hamiltonians: Ground and Excited States in \emph{ab initio} Systems

abstract: We present the theory of a density matrix renormalization group (DMRG) algorithm which can solve for both the ground and excited states of non-Hermitian transcorrelated Hamiltonians, and show applications in \emph{ab initio} molecular systems. Transcorrelation (TC) accelerates the basis set convergence rate by including known physics (such as, but not limited to, the electron-electron cusp) in the Jastrow factor used for the similarity transformation. It also improves the accuracy of approximate methods such as coupled cluster singles and doubles (CCSD) as shown by some recent studies. However, the non-Hermiticity of the TC Hamiltonians poses challenges for variational methods like DMRG. Imaginary-time evolution on the matrix product state (MPS) in the DMRG framework has been proposed to circumvent this problem; but this is currently limited to treating the ground state, and has lower efficiency than the time-independent DMRG (TI-DMRG), due to the need to eliminate Trotter errors. In this work, we show that with minimal changes to the existing TI-DMRG algorithm, namely replacing the original Davidson solver with the general Davidson solver to solve the non-Hermitian effective Hamiltonians at each site for a few low-lying right eigenstates, and following the rest of the original DMRG recipe, one can find the ground and excited states with improved efficiency compared to the original DMRG when extrapolating to the infinite bond dimension limit in the same basis set. Accelerated basis set convergence rate is also observed, as expected, within the TC framework.


title: Joint Audio/Text Training for Transformer Rescorer of Streaming Speech Recognition

abstract: Recently, there has been an increasing interest in two-pass streaming end-to-end speech recognition (ASR) that incorporates a 2nd-pass rescoring model on top of the conventional 1st-pass streaming ASR model to improve recognition accuracy while keeping latency low. One of the latest 2nd-pass rescoring model, Transformer Rescorer, takes the n-best initial outputs and audio embeddings from the 1st-pass model, and then choose the best output by re-scoring the n-best initial outputs. However, training this Transformer Rescorer requires expensive paired audio-text training data because the model uses audio embeddings as input. In this work, we present our Joint Audio/Text training method for Transformer Rescorer, to leverage unpaired text-only data which is relatively cheaper than paired audio-text data. We evaluate Transformer Rescorer with our Joint Audio/Text training on Librispeech dataset as well as our large-scale in-house dataset and show that our training method can improve word error rate (WER) significantly compared to standard Transformer Rescorer without requiring any extra model parameters or latency.


title: Homodyned K-distribution: parameter estimation and uncertainty quantification using Bayesian neural networks

abstract: Quantitative ultrasound (QUS) allows estimating the intrinsic tissue properties. Speckle statistics are the QUS parameters that describe the first order statistics of ultrasound (US) envelope data. The parameters of Homodyned K-distribution (HK-distribution) are the speckle statistics that can model the envelope data in diverse scattering conditions. However, they require a large amount of data to be estimated reliably. Consequently, finding out the intrinsic uncertainty of the estimated parameters can help us to have a better understanding of the estimated parameters. In this paper, we propose a Bayesian Neural Network (BNN) to estimate the parameters of HK-distribution and quantify the uncertainty of the estimator.


title: Xtreme Margin: A Tunable Loss Function for Binary Classification Problems

abstract: Loss functions drive the optimization of machine learning algorithms. The choice of a loss function can have a significant impact on the training of a model, and how the model learns the data. Binary classification is one of the major pillars of machine learning problems, used in medical imaging to failure detection applications. The most commonly used surrogate loss functions for binary classification include the binary cross-entropy and the hinge loss functions, which form the focus of our study. In this paper, we provide an overview of a novel loss function, the Xtreme Margin loss function. Unlike the binary cross-entropy and the hinge loss functions, this loss function provides researchers and practitioners flexibility with their training process, from maximizing precision and AUC score to maximizing conditional accuracy for a particular class, through tunable hyperparameters $\lambda_1$ and $\lambda_2$, i.e., changing their values will alter the training of a model.


title: Learning to Navigate Wikipedia by Taking Random Walks

abstract: A fundamental ability of an intelligent web-based agent is seeking out and acquiring new information. Internet search engines reliably find the correct vicinity but the top results may be a few links away from the desired target. A complementary approach is navigation via hyperlinks, employing a policy that comprehends local content and selects a link that moves it closer to the target. In this paper, we show that behavioral cloning of randomly sampled trajectories is sufficient to learn an effective link selection policy. We demonstrate the approach on a graph version of Wikipedia with 38M nodes and 387M edges. The model is able to efficiently navigate between nodes 5 and 20 steps apart 96% and 92% of the time, respectively. We then use the resulting embeddings and policy in downstream fact verification and question answering tasks where, in combination with basic TF-IDF search and ranking methods, they are competitive results to the state-of-the-art methods.


title: Combining n-MOS Charge Sensing with p-MOS Silicon Hole Double Quantum Dots in a CMOS platform

abstract: Holes in silicon quantum dots are receiving significant attention due to their potential as fast, tunable, and scalable qubits in semiconductor quantum circuits. Despite this, challenges remain in this material system including difficulties using charge sensing to determine the number of holes in a quantum dot, and in controlling the coupling between adjacent quantum dots. In this work, we address these problems by fabricating an ambipolar complementary metal-oxide-semiconductor (CMOS) device using multilayer palladium gates. The device consists of an electron charge sensor adjacent to a hole double quantum dot. We demonstrate control of the spin state via electric dipole spin resonance (EDSR). We achieve smooth control of the inter-dot coupling rate over two orders of magnitude and use the charge sensor to perform spin-to-charge conversion to measure the hole singlet-triplet relaxation time of 11 {\mu}s for a known hole occupation. These results provide a path towards improving the quality and controllability of hole spin-qubits.


title: Noise and Thermodynamic Uncertainty Relation in "Underwater" Molecular Junctions

abstract: We determine the zero-frequency charge current noise in a metal-molecule-metal junction embedded in a thermal environment, e.g., a solvent, dominated by sequential charge transmission described by a classical master equation, and study its dependence of specific model parameters, i.e., the environmental reorganization energy and relaxation behavior. Interestingly, the classical current noise term has the same structure as its quantum analog which reflects a charge correlation due to the bridging molecule. We further determine the thermodynamic uncertainty relation (TUR) which defines a bound on the relationship between the average charge current, its fluctuation and the entropy production in an electrochemical junction in the Marcus regime. In a second part, we use the same methodology to calculate the current noise and the TUR for a protoype photovoltaic cell in order to predict its upper bound for the efficiency of energy conversion into useful work.


title: Extreme eigenvalues and the emerging outlier in rank-one non-Hermitian deformations of the Gaussian Unitary Ensemble

abstract: Complex eigenvalues of random matrices $J=\text{GUE }+ i\gamma \diag (1, 0, \ldots, 0)$ provide the simplest model for studying resonances in wave scattering from a quantum chaotic system via a single open channel. It is known that in the limit of large matrix dimensions $N\gg 1$ the eigenvalue density of $J$ undergoes an abrupt restructuring at $\gamma = 1$, the critical threshold beyond which a single eigenvalue outlier (``broad resonance'') appears. We provide a detailed description of this restructuring transition, including the scaling with $N$ of the width of the critical region about the outlier threshold $\gamma=1$ and the associated scaling for the real parts (``resonance positions'') and imaginary parts (``resonance widths'') of the eigenvalues which are farthest away from the real axis. In the critical regime we determine the density of such extreme eigenvalues, and show how the outlier gradually separates itself from the rest of the extreme eigenvalues. Finally, we describe the fluctuations in the height of the eigenvalue outlier for large but finite $N$ in terms of the associated large deviation function.


title: The Numerical Stability of Hyperbolic Representation Learning

abstract: Given the exponential growth of the volume of the ball w.r.t. its radius, the hyperbolic space is capable of embedding trees with arbitrarily small distortion and hence has received wide attention for representing hierarchical datasets. However, this exponential growth property comes at a price of numerical instability such that training hyperbolic learning models will sometimes lead to catastrophic NaN problems, encountering unrepresentable values in floating point arithmetic. In this work, we carefully analyze the limitation of two popular models for the hyperbolic space, namely, the Poincar\'e ball and the Lorentz model. We first show that, under the 64 bit arithmetic system, the Poincar\'e ball has a relatively larger capacity than the Lorentz model for correctly representing points. Then, we theoretically validate the superiority of the Lorentz model over the Poincar\'e ball from the perspective of optimization. Given the numerical limitations of both models, we identify one Euclidean parametrization of the hyperbolic space which can alleviate these limitations. We further extend this Euclidean parametrization to hyperbolic hyperplanes and exhibits its ability in improving the performance of hyperbolic SVM.


title: Quantum cosmological gravitational waves?

abstract: General relativity and its cosmological solution predicts the existence of tensor modes of perturbations evolving on top of our Friedman-Lema\^itre-Robertson-Walker expanding Universe. Being gauge invariant and not necessarily coupled to other quantum sources, they can be seen as representing pure gravity. Unambiguously showing they are indeed to be quantised would thus provide an unquestionable proof of the quantum nature of gravitation. This review will present a summary of the various theoretical issues that could lead to this conclusion.


title: Measurements of $K^0_{\textrm{S}}$, $\Lambda$ and $\bar{\Lambda}$ production in 120 GeV/$c$ p + C interactions

abstract: This paper presents multiplicity measurements of $K^0_{\textrm{S}}$, $\Lambda$, and $\bar{\Lambda}$ produced in 120 GeV/$c$ proton-carbon interactions. The measurements were made using data collected at the NA61/SHINE experiment during two different periods. Decays of these neutral hadrons impact the measured $\pi^+$, $\pi^-$, $p$ and $\bar{p}$ multiplicities in the 120 GeV/$c$ proton-carbon reaction, which are crucial inputs for long-baseline neutrino experiment predictions of neutrino beam flux. The double-differential multiplicities presented here will be used to more precisely measure charged-hadron multiplicities in this reaction, and to re-weight neutral hadron production in neutrino beam Monte Carlo simulations.


title: FL Games: A Federated Learning Framework for Distribution Shifts

abstract: Federated learning aims to train predictive models for data that is distributed across clients, under the orchestration of a server. However, participating clients typically each hold data from a different distribution, which can yield to catastrophic generalization on data from a different client, which represents a new domain. In this work, we argue that in order to generalize better across non-i.i.d. clients, it is imperative to only learn correlations that are stable and invariant across domains. We propose FL GAMES, a game-theoretic framework for federated learning that learns causal features that are invariant across clients. While training to achieve the Nash equilibrium, the traditional best response strategy suffers from high-frequency oscillations. We demonstrate that FL GAMES effectively resolves this challenge and exhibits smooth performance curves. Further, FL GAMES scales well in the number of clients, requires significantly fewer communication rounds, and is agnostic to device heterogeneity. Through empirical evaluation, we demonstrate that FL GAMES achieves high out-of-distribution performance on various benchmarks.


title: Hybrid CNN -Interpreter: Interpret local and global contexts for CNN-based Models

abstract: Convolutional neural network (CNN) models have seen advanced improvements in performance in various domains, but lack of interpretability is a major barrier to assurance and regulation during operation for acceptance and deployment of AI-assisted applications. There have been many works on input interpretability focusing on analyzing the input-output relations, but the internal logic of models has not been clarified in the current mainstream interpretability methods. In this study, we propose a novel hybrid CNN-interpreter through: (1) An original forward propagation mechanism to examine the layer-specific prediction results for local interpretability. (2) A new global interpretability that indicates the feature correlation and filter importance effects. By combining the local and global interpretabilities, hybrid CNN-interpreter enables us to have a solid understanding and monitoring of model context during the whole learning process with detailed and consistent representations. Finally, the proposed interpretabilities have been demonstrated to adapt to various CNN-based model structures.


title: A Proof Without Words: Triangles in the Triangular Grid

abstract: This proof without words demonstrates that there are $\binom{n+2}{4}$ equilateral triangles in the regular $n$-vertices-per-side triangular grid by describing a map from four-element subsets of $\{1,2, \dots, n+2\}$ into the set of equilateral triangles in this grid. Specifically, we illustrate the triangle that corresponds to the subset $\{4,5,8,11\}$ under this bijection when $n = 10$.


title: On a reformulation of the commutator subgroup

abstract: For semigroup $S$, a commutative congruence $\sigma_{orient}$ on $S$ and a subsemigroup Orientable($S$) of $S$ were introduced in "Two cancellative commutative congruences and group diagrams", Semigroup Forum (2011) 82: 338-353. Here we demonstrate that when the semigroup is in fact a group $G$, then Orientable($G$) is the commutator subgroup $[G,G]$ and $ G / \sigma_{orient}$ is the abelian quotient group $G / [G,G]$.


title: Adaptive Compression for Communication-Efficient Distributed Training

abstract: We propose Adaptive Compressed Gradient Descent (AdaCGD) - a novel optimization algorithm for communication-efficient training of supervised machine learning models with adaptive compression level. Our approach is inspired by the recently proposed three point compressor (3PC) framework of Richtarik et al. (2022), which includes error feedback (EF21), lazily aggregated gradient (LAG), and their combination as special cases, and offers the current state-of-the-art rates for these methods under weak assumptions. While the above mechanisms offer a fixed compression level, or adapt between two extremes only, our proposal is to perform a much finer adaptation. In particular, we allow the user to choose any number of arbitrarily chosen contractive compression mechanisms, such as Top-K sparsification with a user-defined selection of sparsification levels K, or quantization with a user-defined selection of quantization levels, or their combination. AdaCGD chooses the appropriate compressor and compression level adaptively during the optimization process. Besides i) proposing a theoretically-grounded multi-adaptive communication compression mechanism, we further ii) extend the 3PC framework to bidirectional compression, i.e., we allow the server to compress as well, and iii) provide sharp convergence bounds in the strongly convex, convex and nonconvex settings. The convex regime results are new even for several key special cases of our general mechanism, including 3PC and EF21. In all regimes, our rates are superior compared to all existing adaptive compression methods.


title: Machine Learning Enabled Force Sensing of a Smart Skin for Robotics

abstract: Artificial skin with the sense of touch can support robots to interact with the surrounding environment efficiently and accomplish complex tasks. Traditional multi-layered artificial skins require complex manufacturing processes which can result in high cost as well as limitations on the material and size of the skin. In this paper, we demonstrate a machine learning based approach to predict positions of point loads using the most direct response as input signal: strain distribution. Starting with the simplest problem, predicting the position of a single point load acting on a flat surface, an ML model is developed, trained, and tested. Accurate predictions are obtained from the ML model, parameters that affect the accuracy are discussed, and validation tests are performed. After that, the ML model is modified to solve multi-objective prediction problems: predicting positions and magnitudes of multiple point loads. In the end, the ML model is upgraded to a 2-step model to predict the position of a point load acting on a deformable surface. The demonstrated approach enables a normal untreated surface to feel a touch no matter what the surface is made of or how large or small the size of the surface is. Therefore, we believe this ML-based load position prediction approach could be a promising tool for applications such as flexible touch screens, smart skin for robots, and micro touch sensors.


title: Mechanical Design Principles of Avian Eggshells for Survivability

abstract: Biological materials exhibit complex structure-property relationships which are only beginning to be elucidated. Understanding the underlying physical mechanisms of the structure-property relationships is the key to designing bioinspired materials. The eggshell is an excellent example because many design trade-offs are well balanced by its seemingly simple but highly evolved structures. The first design trade-off: to break an eggshell, the internal breaking load needed is much lower than the external breaking load. The reason is that the dome-shaped structure leads to a special stress distribution which inhibits the propagation of the first crack. The second design trade-off: the eggshell is tough during the incubation but weakened at the time of hatching. The membrane of the eggshell significantly improves the toughness by bridging the primary crack and creating more secondary cracks. Moreover, the moisture content-controlled property of the membrane makes the toughness of the eggshell tunable. The third design trade-off: the eggshell must be thick enough to withstand the external forces, but the supply of the building material calcium is limited. The proposed three-index model indicates that the driving force in the evolution of eggshell thickness could be the balance between the protection and nutrient consumption to maximize survivability. The general methodologies presented here hold great potential for the development of eggshell-inspired structural materials that can be used in sports safety applications and the packaging industry.


title: Edge Grasp Network: A Graph-Based SE(3)-invariant Approach to Grasp Detection

abstract: Given point cloud input, the problem of 6-DoF grasp pose detection is to identify a set of hand poses in SE(3) from which an object can be successfully grasped. This important problem has many practical applications. Here we propose a novel method and neural network model that enables better grasp success rates relative to what is available in the literature. The method takes standard point cloud data as input and works well with single-view point clouds observed from arbitrary viewing directions.


title: AI Assistants: A Framework for Semi-Automated Data Wrangling

abstract: Data wrangling tasks such as obtaining and linking data from various sources, transforming data formats, and correcting erroneous records, can constitute up to 80% of typical data engineering work. Despite the rise of machine learning and artificial intelligence, data wrangling remains a tedious and manual task. We introduce AI assistants, a class of semi-automatic interactive tools to streamline data wrangling. An AI assistant guides the analyst through a specific data wrangling task by recommending a suitable data transformation that respects the constraints obtained through interaction with the analyst. We formally define the structure of AI assistants and describe how existing tools that treat data cleaning as an optimization problem fit the definition. We implement AI assistants for four common data wrangling tasks and make AI assistants easily accessible to data analysts in an open-source notebook environment for data science, by leveraging the common structure they follow. We evaluate our AI assistants both quantitatively and qualitatively through three example scenarios. We show that the unified and interactive design makes it easy to perform tasks that would be difficult to do manually or with a fully automatic tool.


title: Barycenters and a law of large numbers in Gromov hyperbolic spaces

abstract: We investigate barycenters of probability measures on Gromov hyperbolic spaces, toward development of convex optimization in this class of metric spaces. We establish a contraction property (the Wasserstein distance between probability measures provides an upper bound of the distance between their barycenters), a deterministic approximation of barycenters of uniform distributions on finite points, and a kind of law of large numbers. These generalize the corresponding results on CAT(0)-spaces, up to additional terms depending on the hyperbolicity constant.


title: SEIL: Simulation-augmented Equivariant Imitation Learning

abstract: In robotic manipulation, acquiring samples is extremely expensive because it often requires interacting with the real world. Traditional image-level data augmentation has shown the potential to improve sample efficiency in various machine learning tasks. However, image-level data augmentation is insufficient for an imitation learning agent to learn good manipulation policies in a reasonable amount of demonstrations. We propose Simulation-augmented Equivariant Imitation Learning (SEIL), a method that combines a novel data augmentation strategy of supplementing expert trajectories with simulated transitions and an equivariant model that exploits the $\mathrm{O}(2)$ symmetry in robotic manipulation. Experimental evaluations demonstrate that our method can learn non-trivial manipulation tasks within ten demonstrations and outperforms the baselines with a significant margin.


title: The ALMA2030 Wideband Sensitivity Upgrade

abstract: The Wideband Sensitivity Upgrade (WSU) is the top priority initiative for the ALMA2030 Development Roadmap. The WSU will initially double, and eventually quadruple, ALMA's system bandwidth and will deliver improved sensitivity by upgrading the receivers, digital electronics and correlator. The WSU will afford significant improvements for every future ALMA observation, whether it is for continuum or spectral line science. The continuum imaging speed will increase by a factor of 3 for the 2x bandwidth upgrade, plus any gains from improved receiver temperatures. The spectral line imaging speed will improve by a factor of 2-3. The improvements provided by the WSU will be most dramatic for high spectral resolution observations, where the instantaneous bandwidth correlated at 0.1-0.2 km/s resolution will increase by 1-2 orders of magnitude in most receiver bands. The improved sensitivity and spectral tuning grasp will open new avenues of exploration and enable more efficient observations. The impact will span the vast array of topics that embodies ALMA's motto "In Search of our Cosmic Origins". The WSU will greatly expand the chemical inventory of protoplanetary disks, which will have profound implications for how and when planets form. Observations of the interstellar medium will measure a variety of molecular species to build large samples of clouds, cores and protostars. The WSU will also enable efficient surveys of galaxies at high redshift. The first elements of the WSU will be available later this decade, including a wideband Band 2 receiver, a wideband upgrade to Band 6, new digitizers and digital transmission system, and a new correlator. Other upgrades are under study, including the newly developed ACA spectrometer and upgrades to Bands 9 and 10. The gains enabled by the WSU will further enhance ALMA as the world leading facility for millimeter/submillimeter astronomy. [Abridged]

categories: astro-ph.IM astro-ph.CO astro-ph.EP astro-ph.GA astro-ph.SR


title: Exponential time-decay for a one dimensional wave equation with coefficients of bounded variation

abstract: We consider the initial-value problem for a one-dimensional wave equation with coefficients that are positive, constant outside of an interval, and have bounded variation (BV). Under the assumption of compact support of the initial data, we prove that the local energy decays exponentially fast in time, and provide the explicit constant to which the solution converges. The key ingredient of the proof is a high frequency resolvent estimate for an associated Helmholtz operator with a BV potential.


title: New developments in fission studies within the time-dependent density functional theory framework

abstract: We have extended significantly the microscopic description of the fission process by examining a larger set of observables. We extract neutron and proton numbers of fission fragments, their spins and fission fragment relative orbital angular momentum and their correlations, investigate neutrons emitted at or shortly after scission, excitation energy sharing mechanism, total kinetic energy of fission fragments, and the entanglement entropy. I will present a short overview of our simulations obtained with two independent nuclear energy density functionals.


title: Frequency Cam: Imaging Periodic Signals in Real-Time

abstract: Due to their high temporal resolution and large dynamic range event cameras are uniquely suited for the analysis of time-periodic signals in an image. In this work we present an efficient and fully asynchronous event camera algorithm for detecting the fundamental frequency at which image pixels flicker. The algorithm employs a second-order digital infinite impulse response (IIR) filter to perform an approximate per-pixel brightness reconstruction and is more robust to high-frequency noise than the baseline method we compare to. We further demonstrate that using the falling edge of the signal leads to more accurate period estimates than the rising edge, and that for certain signals interpolating the zero-level crossings can further increase accuracy. Our experiments find that the outstanding capabilities of the camera in detecting frequencies up to 64kHz for a single pixel do not carry over to full sensor imaging as readout bandwidth limitations become a serious obstacle. This suggests that a hardware implementation closer to the sensor will allow for greatly improved frequency imaging. We discuss the important design parameters for fullsensor frequency imaging and present Frequency Cam, an open-source implementation as a ROS node that can run on a single core of a laptop CPU at more than 50 million events per second. It produces results that are qualitatively very similar to those obtained from the closed source vibration analysis module in Prophesee's Metavision Toolkit. The code for Frequency Cam and a demonstration video can be found at https://github.com/berndpfrommer/frequency_cam


title: Accelerated Motion Correction with Deep Generative Diffusion Models

abstract: Magnetic Resonance Imaging (MRI) is a powerful medical imaging modality, but unfortunately suffers from long scan times which, aside from increasing operational costs, can lead to image artifacts due to patient motion. Motion during the acquisition leads to inconsistencies in measured data that manifest as blurring and ghosting if unaccounted for in the image reconstruction process. Various deep learning based reconstruction techniques have been proposed which decrease scan time by reducing the number of measurements needed for a high fidelity reconstructed image. Additionally, deep learning has been used to correct motion using end-to-end techniques. This, however, increases susceptibility to distribution shifts at test time (sampling pattern, motion level). In this work we propose a framework for jointly reconstructing highly sub-sampled MRI data while estimating patient motion using diffusion based generative models. Our method does not make specific assumptions on the sampling trajectory or motion pattern at training time and thus can be flexibly applied to various types of measurement models and patient motion. We demonstrate our framework on retrospectively accelerated 2D brain MRI corrupted by rigid motion.


title: Hadamard products of symbolic powers and Hadamard fat grids

abstract: In this paper we address the question if, for points $P, Q \in \mathbb{P}^{2}$, $I(P)^{m} \star I(Q)^{n}=I(P \star Q)^{m+n-1}$ and we obtain different results according to the number of zero coordinates in $P$ and $Q$. Successively, we use our results to define the so called Hadamard fat grids, which are the result of the Hadamard product of two sets of collinear points with given multiplicities. The most important invariants of Hadamard fat grids, as minimal resolution, Waldschmidt constant and resurgence, are then computed.


title: CCS Explorer: Relevance Prediction, Extractive Summarization, and Named Entity Recognition from Clinical Cohort Studies

abstract: Clinical Cohort Studies (CCS), such as randomized clinical trials, are a great source of documented clinical research. Ideally, a clinical expert inspects these articles for exploratory analysis ranging from drug discovery for evaluating the efficacy of existing drugs in tackling emerging diseases to the first test of newly developed drugs. However, more than 100 articles are published daily on a single prevalent disease like COVID-19 in PubMed. As a result, it can take days for a physician to find articles and extract relevant information. Can we develop a system to sift through the long list of these articles faster and document the crucial takeaways from each of these articles? In this work, we propose CCS Explorer, an end-to-end system for relevance prediction of sentences, extractive summarization, and patient, outcome, and intervention entity detection from CCS. CCS Explorer is packaged in a web-based graphical user interface where the user can provide any disease name. CCS Explorer then extracts and aggregates all relevant information from articles on PubMed based on the results of an automatically generated query produced on the back-end. For each task, CCS Explorer fine-tunes pre-trained language representation models based on transformers with additional layers. The models are evaluated using two publicly available datasets. CCS Explorer obtains a recall of 80.2%, AUC-ROC of 0.843, and an accuracy of 88.3% on sentence relevance prediction using BioBERT and achieves an average Micro F1-Score of 77.8% on Patient, Intervention, Outcome detection (PIO) using PubMedBERT. Thus, CCS Explorer can reliably extract relevant information to summarize articles, saving time by $\sim \text{660}\times$.


title: Time dispersion in quantum electrodynamics

abstract: If we use the path integral approach, we can write quantum electrodynamics (QED) in a way that is manifestly relativistic. However the path integrals are confined to paths that are on mass-shell. What happens if we extend QED by computing the path integrals over all paths in energy momentum space, not only those on mass-shell? We use the requirement of covariance to do this in an unambiguous way. This gives a QED where the time/energy components appear in a way that is manifestly parallel to the space/momentum components: we have dispersion in time, entanglement in time, full equivalence of the Heisenberg uncertainty principle (HUP) in time to the HUP in space, and so on. Entanglement in time has the welcome side effect of eliminating the ultraviolet divergences. We recover standard QED in the long time limit. We predict effects at scales of attoseconds. With recent developments in attosecond physics and in quantum computing, these effects should be detectable. Since the predictions are unambiguous and testable the approach is falsifiable. Falsification would sharpen our understanding of the role of time in QED. Confirmation would have significant implications for attosecond physics, quantum computing and communications, and quantum grav


title: Spatio-temporal lasing dynamics in a Lima\c{c}on-shaped microcavity

abstract: Lima\c{c}on-shaped microdisk lasers are promising on-chip light sources with low lasing threshold and unidirectional output. We conduct an experimental study on the lasing dynamics of Lima\c{c}on-shaped semiconductor microcavities. The edge emission exhibits intensity fluctuations over a wide range of spatial and temporal scales. They result from multiple dynamic processes with different origins and occurring on different spatiotemporal scales. The dominant process is an alternate oscillation between two output beams with a period as short as a few nanoseconds.


title: Bayesian Structural Identification using Gaussian Process Discrepancy Models

abstract: Bayesian model updating based on Gaussian Process (GP) models has received attention in recent years, which incorporates kernel-based GPs to provide enhanced fidelity response predictions. Although most kernel functions provide high fitting accuracy in the training data set, their out-of-sample predictions can be highly inaccurate. This paper investigates this problem by reformulating the problem on a consistent probabilistic foundation, reviewing common choices of kernel covariance functions, and proposing a new Bayesian model selection for kernel function selection, aiming to create a balance between fitting accuracy, generalizability, and model parsimony. Computational aspects are addressed via Laplace approximation and sampling techniques, providing detailed algorithms and strategies. Numerical and experimental examples are included to demonstrate the accuracy and robustness of the proposed framework. As a result, an exponential-trigonometric covariance function is characterized and justified based on the Bayesian model selection approach and observations of the sample autocorrelation function of the response discrepancies.


title: Near-Infrared and Optical Observations of Type Ic SN 2021krf: Luminous Late-time Emission and Dust Formation

abstract: We present near-infrared (NIR) and optical observations of the Type Ic supernova (SN Ic) SN 2021krf obtained between days 13 and 259 at several ground-based telescopes. The NIR spectrum at day 68 exhibits a rising $K$-band continuum flux density longward of $\sim$ 2.0 $\mu$m, and a late-time optical spectrum at day 259 shows strong [O I] 6300 and 6364 \r{A} emission-line asymmetry, both indicating the presence of dust, likely formed in the SN ejecta. We estimate a carbon-grain dust mass of $\sim$ 2 $\times$ 10$^{-5}$ M$_{\odot}$ and a dust temperature of $\sim$ 900 - 1200 K associated with this rising continuum and suggest the dust has formed in SN ejecta. Utilizing the one-dimensional multigroup radiation hydrodynamics code STELLA, we present two degenerate progenitor solutions for SN 2021krf, characterized by C-O star masses of 3.93 and 5.74 M$_{\odot}$, but with the same best-fit $^{56}$Ni mass of 0.11 M$_{\odot}$ for early times (0-70 days). At late times (70-300 days), optical light curves of SN 2021krf decline substantially more slowly than that expected from $^{56}$Co radioactive decay. Lack of H and He lines in the late-time SN spectrum suggests the absence of significant interaction of the ejecta with the circumstellar medium. We reproduce the entire bolometric light curve with a combination of radioactive decay and an additional powering source in the form of a central engine of a millisecond pulsar with a magnetic field smaller than that of a typical magnetar.


title: A Primary Frequency Control Strategy for Variable-Speed Pumped-Storage Plant in Power Generation Based on Adaptive Model Predictive Control

abstract: Variable-speed pumped-storage (VSPS) has great potential in helping solve the frequency control problem caused by low inertia, owing to its remarkable flexibility beyond conventional fixed-speed one, to make better use of which, a primary frequency control strategy based on adaptive model predictive control (AMPC) is proposed in this paper for VSPS plant in power generation.


title: GMF: General Multimodal Fusion Framework for Correspondence Outlier Rejection

abstract: Rejecting correspondence outliers enables to boost the correspondence quality, which is a critical step in achieving high point cloud registration accuracy. The current state-of-the-art correspondence outlier rejection methods only utilize the structure features of the correspondences. However, texture information is critical to reject the correspondence outliers in our human vision system. In this paper, we propose General Multimodal Fusion (GMF) to learn to reject the correspondence outliers by leveraging both the structure and texture information. Specifically, two cross-attention-based fusion layers are proposed to fuse the texture information from paired images and structure information from point correspondences. Moreover, we propose a convolutional position encoding layer to enhance the difference between Tokens and enable the encoding feature pay attention to neighbor information. Our position encoding layer will make the cross-attention operation integrate both local and global information. Experiments on multiple datasets(3DMatch, 3DLoMatch, KITTI) and recent state-of-the-art models (3DRegNet, DGR, PointDSC) prove that our GMF achieves wide generalization ability and consistently improves the point cloud registration accuracy. Furthermore, several ablation studies demonstrate the robustness of the proposed GMF on different loss functions, lighting conditions and noises.The code is available at https://github.com/XiaoshuiHuang/GMF.


title: Invited Paper: Fault-tolerant and Expressive Cross-Chain Swaps

abstract: Cross-chain swaps enable exchange of different assets that reside on different blockchains. Several protocols have been proposed for atomic cross-chain swaps. However, those protocols are not fault-tolerant, in the sense that if any party deviates, no asset transfer can happen. In this paper, we propose two alternative protocols for structuring composable and robust cross-chain swaps. Participants can propose multiple swaps simultaneously and then complete a subset of those swaps according to their needs. Their needs are expressed as predicates which capture acceptable payoff of each participant. Our proposed protocols are thus more expressive due to the introduction of predicates. The proposed protocols are fault-tolerant since, even if some participants deviate, those predicates can still be satisfied, and conforming parties can complete an acceptable set of swaps.


title: Long-time behavior of solutions of superlinear systems of differential equations

abstract: This paper establishes the precise asymptotic behavior, as time $t$ tends to infinity, for nontrivial, decaying solutions of genuinely nonlinear systems of ordinary differential equations. The lowest order term in these systems, when the spatial variables are small, is not linear, but rather positively homogeneous of a degree greater than one. We prove that the solution behaves like $\xi t^{-p}$, as $t\to\infty$, for a nonzero vector $\xi$ and an explicit number $p>0$.


title: On the intermediate Jacobian of M5-branes

abstract: We study Euclidean M5-branes wrapping vertical divisors in elliptic Calabi-Yau fourfold compactifications of M/F-theory that admit a Sen limit. We construct these Calabi-Yau fourfolds as elliptic fibrations over coordinate flip O3/O7 orientifolds of toric hypersurface Calabi-Yau threefolds. We devise a method to analyze the Hodge structure (and hence the dimension of the intermediate Jacobian) of vertical divisors in these fourfolds, using only the data available from a type IIB compactification on the O3/O7 Calabi-Yau orientifold. Our method utilizes simple combinatorial formulae (that we prove) for the equivariant Hodge numbers of the Calabi-Yau orientifolds and their prime toric divisors, along with a formula for the Euler characteristic of vertical divisors in the corresponding elliptic Calabi-Yau fourfold. Our formula for the Euler characteristic includes a conjectured correction term that accounts for the contributions of pointlike terminal $\mathbb{Z}_2$ singularities corresponding to perturbative O3-planes. We check our conjecture in a number of explicit examples and find perfect agreement with the results of direct computations.


title: Induction and restriction of two variable Hecke algebras

abstract: The purpose of this paper is to study induction and restriction of two-variable Hecke algebras. First, we provide the explicit form of the Mackey decomposition formula. And then, we elucidate how (anti-)involutions interact with induction product and restriction.


title: Non-analyticity in Holographic Complexity near Critical points

abstract: The region near a critical point is studied using holographic models of second-order phase transitions. In a previous paper, we argued that the quantum circuit complexity of the vacuum ($C_0$) is the largest at the critical point. When deforming away from the critical point by a term $\int d^d x \, \tau \, O_\Delta$ the complexity $C(\tau)$ has a piece non-analytic in $\tau$, namely $C_0 -C(\tau) \sim |\tau-\tau_c|^{\nu(d-1)} + \mathrm{analytic} $. Here, as usual, $\nu=\frac{1}{d-\Delta}$ and $\xi$ is the correlation length $\xi\sim |\tau-\tau_c|^{-\nu}$ and there are possible logarithmic corrections to this expression. That was derived using numerical results for the Bose-Hubbard model and general scaling considerations. In this paper, we show that the same is valid in the case of holographic complexity providing evidence that the results are universal, and at the same time providing evidence for holographic computations of complexity.


title: Rarest-First with Probabilistic-Mode-Suppression

abstract: Recent studies suggested that the BitTorrent's rarest-first protocol, owing to its work-conserving nature, can become unstable in the presence of non-persistent users. Consequently, for any provably stable protocol, many peers, at some point, would have to be endogenously forced to hold off their file-download activity. In this work, we propose a tunable piece-selection policy that minimizes this (undesirable) requisite by combining the (work-conserving but not stabilizing) rarest-first protocol with only an appropriate share of the (non-work conserving and stabilizing) mode-suppression protocol. We refer to this policy as ``Rarest-First with Probabilistic Mode-Suppression'' or simply RFwPMS. We study RFwPMS using a stochastic abstraction of the BitTorrent network that is general enough to capture a multiple swarm setting of non-persistent users -- each swarm having its own altruistic preferences that may or may not overlap with those of other swarms. Using Lyapunov drift analysis, we show that for all kinds of inter-swarm behaviors and all arrival-rate configurations, RFwPMS is stable. Then, using the Kingman's moment bound technique, we further show that the expected steady-state sojourn time of RFwPMS is independent of the arrival-rate in the single-swarm case (under a mild additional assumption). Finally, our simulation-based performance evaluation confirms our theoretical findings and shows that the steady-state expected sojourn time is linear in the file-size (compared to our loose estimate of a polynomial with degree 6). Overall, an improved performance is observed in comparison to previously proposed stabilizing schemes like mode-suppression (MS).


title: Transfer Learning with Physics-Informed Neural Networks for Efficient Simulation of Branched Flows

abstract: Physics-Informed Neural Networks (PINNs) offer a promising approach to solving differential equations and, more generally, to applying deep learning to problems in the physical sciences. We adopt a recently developed transfer learning approach for PINNs and introduce a multi-head model to efficiently obtain accurate solutions to nonlinear systems of ordinary differential equations with random potentials. In particular, we apply the method to simulate stochastic branched flows, a universal phenomenon in random wave dynamics. Finally, we compare the results achieved by feed forward and GAN-based PINNs on two physically relevant transfer learning tasks and show that our methods provide significant computational speedups in comparison to standard PINNs trained from scratch.


title: An embedding theorem for subshifts over amenable groups with the comparison property

abstract: We obtain the following embedding theorem for symbolic dynamical systems. Let $G$ be a countable amenable group with the comparison property. Let $X$ be a strongly aperiodic subshift over $G$. Let $Y$ be a strongly irreducible shift of finite type over $G$ which has no global period, meaning that the shift action is faithful on $Y$. If the topological entropy of $X$ is strictly less than that of $Y$, and $Y$ contains at least one factor of $X$, then $X$ embeds into $Y$. This result partially extends the classical result of Krieger when $G = \mathbb{Z}$ and the results of Lightwood when $G = \mathbb{Z}^d$ for $d \geq 2$. The proof relies on recent developments in the theory of tilings and quasi-tilings of amenable groups.


title: Distributed Graph Neural Network Training: A Survey

abstract: Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to large graphs. As a remedy, distributed computing becomes a promising solution of training large-scale GNNs, since it is able to provide abundant computing resources. However, the dependency of graph structure increases the difficulty of achieving high-efficiency distributed GNN training, which suffers from the massive communication and workload imbalance. In recent years, many efforts have been made on distributed GNN training, and an array of training algorithms and systems have been proposed. Yet, there is a lack of systematic review on the optimization techniques for the distributed execution of GNN training. In this survey, we analyze three major challenges in distributed GNN training that are massive feature communication, the loss of model accuracy and workload imbalance. Then we introduce a new taxonomy for the optimization techniques in distributed GNN training that address the above challenges. The new taxonomy classifies existing techniques into four categories that are GNN data partition, GNN batch generation, GNN execution model, and GNN communication protocol. We carefully discuss the techniques in each category. In the end, we summarize existing distributed GNN systems for multi-GPUs, GPU-clusters and CPU-clusters, respectively, and give a discussion about the future direction on distributed GNN training.


title: Tensor Regularized Total Least Squares Methods with Applications to Image and Video Deblurring

abstract: Total least squares (TLS) is an effective method for solving linear equations with the situations, when noise is not just in observation matrices but also in mapping matrices. Moreover, the Tikhonov regularization is widely used in plenty of ill-posed problems. In this paper, we extend the regularized total least squares (RTLS) method from the matrix form due to Golub, Hansen and O'Leary, to the tensor form proposing the tensor regularized total least squares (TR-TLS) method for solving ill-conditioned tensor systems of equations. Properties and algorithms about the solution of the TR-TLS problem, which might be similar to those of the RTLS, are also presented and proved. Based on this method, some applications in image and video deblurring are explored. Numerical examples illustrate the TR-TLS, compared with the existing methods.


title: Pixel-Wise Contrastive Distillation

abstract: We present a simple but effective pixel-level self-supervised distillation framework friendly to dense prediction tasks. Our method, called Pixel-Wise Contrastive Distillation (PCD), distills knowledge by attracting the corresponding pixels from student's and teacher's output feature maps. PCD includes a novel design called SpatialAdaptor which ``reshapes'' a part of the teacher network while preserving the distribution of its output features. Our ablation experiments suggest that this reshaping behavior enables more informative pixel-to-pixel distillation. Moreover, we utilize a plug-in multi-head self-attention module that explicitly relates the pixels of student's feature maps to enhance the effective receptive field, leading to a more competitive student. PCD \textbf{outperforms} previous self-supervised distillation methods on various dense prediction tasks. A backbone of \mbox{ResNet-18-FPN} distilled by PCD achieves $37.4$ AP$^\text{bbox}$ and $34.0$ AP$^\text{mask}$ on COCO dataset using the detector of \mbox{Mask R-CNN}. We hope our study will inspire future research on how to pre-train a small model friendly to dense prediction tasks in a self-supervised fashion.


title: TITAN: Bringing The Deep Image Prior to Implicit Representations

abstract: We study the interpolation capabilities of implicit neural representations (INRs) of images. In principle, INRs promise a number of advantages, such as continuous derivatives and arbitrary sampling, being freed from the restrictions of a raster grid. However, empirically, INRs have been observed to poorly interpolate between the pixels of the fit image; in other words, they do not inherently possess a suitable prior for natural images. In this paper, we propose to address and improve INRs' interpolation capabilities by explicitly integrating image prior information into the INR architecture via deep decoder, a specific implementation of the deep image prior (DIP). Our method, which we call TITAN, leverages a residual connection from the input which enables integrating the principles of the grid-based DIP into the grid-free INR. Through super-resolution and computed tomography experiments, we demonstrate that our method significantly improves upon classic INRs, thanks to the induced natural image bias. We also find that by constraining the weights to be sparse, image quality and sharpness are enhanced, increasing the Lipschitz constant.


title: Giga-Year Dynamical Evolution of Particles Around Mars

abstract: Particles of various sizes can exist around Mars. The orbits of large particles are mainly governed by Martian gravity, while those of small particles could be significantly affected by non-gravitational forces. Many of the previous studies of particle dynamics around Mars have focused on relatively small particles (radius of $r_{\rm p} \lesssim 100 \, \mu m$) for $\lesssim 10^{4}$ years. In this paper, using direct numerical orbital integration and analytical approaches, we consider Martian gravity, Martian $J_{2}$, the solar radiation pressure (SRP) and the Poynting-Robertson (PR) force to study the giga-year dynamical evolution of particles orbiting near the Martian equatorial plane with radius ranging from micrometer to meter. We also newly study the effect of the planetary shadow upon the particle dynamics. Our results show that small particles ($r_{\rm p} \lesssim 10 \, \mu m$) initially at $\lesssim 8$ Martian radii (below the orbit of today's Deimos) are quickly removed by the SRP due to eccentricity increase, resulting in a collision with Mars at the pericenter distnace. The orbits of larger particles ($r_{\rm p} > 10 \, \mu m$) slowly decay due to the PR forces (timescale of $> 10^{4}$ years). The planetary shadow reduces the sunlit area in the orbit and thus the efficiency of the PR drag force is reduced. However, we show that, even including the planetary shadow, particles up to $\sim 10$ cm in radius, initially at $\lesssim 8$ Martian radii, eventually spiral onto the Martian surface within $\sim 10^{9}$ years. Smaller particles require less time to reach Mars, and vice versa. Our results would be important to better understand and constrain the nature of the remaining particle around Mars in a context of giant impact hypothesis for the formation of Phobos and Deimos.


title: Review on Monitoring, Operation and Maintenance of Smart Offshore Wind Farms

abstract: In recent years, with the development of wind energy, the number and scale of wind farms are developing rapidly. Since offshore wind farm has the advantages of stable wind speed, clean, renewable, non-polluting and no occupation of cultivated land, which has gradually become a new trend of wind power industry all over the world. The operation and maintenance mode of offshore wind power is developing in the direction of digitization and intelligence. It is of great significance to carry out the research on the monitoring, operation and maintenance of offshore wind farm, which will be of benefits to reduce the operation and maintenance cost, improve the power generation efficiency, improve the stability of offshore wind farm system and build smart offshore wind farm. This paper will mainly analyze and summarize the monitoring, operation and maintenance of offshore wind farm, especially from the following points: monitoring of "offshore wind power engineering & biological & environment", the monitoring of power equipment and the operation & maintenance of smart offshore wind farms. Finally, the future research challenges about monitoring, operation and maintenance of smart offshore wind farm are proposed, and the future research directions in this field are prospected.


title: SDMuse: Stochastic Differential Music Editing and Generation via Hybrid Representation

abstract: While deep generative models have empowered music generation, it remains a challenging and under-explored problem to edit an existing musical piece at fine granularity. In this paper, we propose SDMuse, a unified Stochastic Differential Music editing and generation framework, which can not only compose a whole musical piece from scratch, but also modify existing musical pieces in many ways, such as combination, continuation, inpainting, and style transferring. The proposed SDMuse follows a two-stage pipeline to achieve music generation and editing on top of a hybrid representation including pianoroll and MIDI-event. In particular, SDMuse first generates/edits pianoroll by iteratively denoising through a stochastic differential equation (SDE) based on a diffusion model generative prior, and then refines the generated pianoroll and predicts MIDI-event tokens auto-regressively. We evaluate the generated music of our method on ailabs1k7 pop music dataset in terms of quality and controllability on various music editing and generation tasks. Experimental results demonstrate the effectiveness of our proposed stochastic differential music editing and generation process, as well as the hybrid representations.


title: Quickest Change Detection with Leave-one-out Density Estimation

abstract: The problem of quickest change detection in a sequence of independent observations is considered. The pre-change distribution is assumed to be known, while the post-change distribution is completely unknown. A window-limited leave-one-out (LOO) CuSum test is developed, which does not assume any knowledge of the post-change distribution, and does not require any post-change training samples. It is shown that, with certain convergence conditions on the density estimator, the LOO-CuSum test is first-order asymptotically optimal, as the false alarm rate goes to zero. The analysis is validated through numerical results, where the LOO-CuSum test is compared with baseline tests that have distributional knowledge.