title: Optimizing Precision and Power by Machine Learning in Randomized Trials, with an Application to COVID-19

abstract: The rapid finding of effective therapeutics requires the efficient use of available resources in clinical trials. The use of covariate adjustment can yield statistical estimates with improved precision, resulting in a reduction in the number of participants required to draw futility or efficacy conclusions. We focus on time-to-event and ordinal outcomes. A key question for covariate adjustment in randomized studies is how to fit a model relating the outcome and the baseline covariates to maximize precision. We present a novel theoretical result establishing conditions for asymptotic normality of a variety of covariate-adjusted estimators that rely on machine learning (e.g., l1-regularization, Random Forests, XGBoost, and Multivariate Adaptive Regression Splines), under the assumption that outcome data is missing completely at random. We further present a consistent estimator of the asymptotic variance. Importantly, the conditions do not require the machine learning methods to converge to the true outcome distribution conditional on baseline variables, as long as they converge to some (possibly incorrect) limit. We conducted a simulation study to evaluate the performance of the aforementioned prediction methods in COVID-19 trials using longitudinal data from over 1,500 patients hospitalized with COVID-19 at Weill Cornell Medicine New York Presbyterian Hospital. We found that using l1-regularization led to estimators and corresponding hypothesis tests that control type 1 error and are more precise than an unadjusted estimator across all sample sizes tested. We also show that when covariates are not prognostic of the outcome, l1-regularization remains as precise as the unadjusted estimator, even at small sample sizes (n = 100). We give an R package adjrct that performs model-robust covariate adjustment for ordinal and time-to-event outcomes.


title: Stability of planar rarefaction waves for scalar viscous conservation law under periodic perturbations

abstract: The large time behavior of the solutions to a multi-dimensional viscous conservation law is considered in this paper. It is shown that the solution time-asymptotically tends to the planar rarefaction wave if the initial perturbations are multi-dimensional periodic. The time-decay rate is also obtained. Moreover, a Gagliardo-Nirenberg type inequality is established in the domain $ \mathbb R \times \mathbb T^{n-1} (n\geq2) $, where $\mathbb T^{n-1}$ is the $ n-1 $-dimensional torus.


title: A new integrable model of long wave-short wave interaction and linear stability spectra

abstract: We consider the propagation of short waves which generate waves of much longer (infinite) wave-length. Model equations of such long wave-short wave resonant interaction, including integrable ones, are well-known and have received much attention because of their appearance in various physical contexts, particularly fluid dynamics and plasma physics. Here we introduce a new long wave-short wave integrable model which generalises those first proposed by Yajima-Oikawa and by Newell. By means of its associated Lax pair, we carry out the linear stability analysis of its continuous wave solutions by introducing the stability spectrum as an algebraic curve in the complex plane. This is done starting from the construction of the eigenfunctions of the linearised long wave-short wave model equations. The geometrical features of this spectrum are related to the stability/instability properties of the solution under scrutiny. Stability spectra for the plane wave solutions are fully classified in the parameter space together with types of modulational instabilities.

categories: nlin.SI math-ph math.AP math.MP physics.flu-dyn


title: Controlling spatial coherence with an optical complex medium

abstract: Control over optical spatial coherence is a key requirement in diverse applications including imaging, optical trapping, and communications. Current approaches to controlling spatial coherence are constrained by speed or limited to a single pair of optical fields. Here, we propose a method to achieve single-shot control of the spatial coherence between an arbitrary number of fields. Our method employs a multi-port linear optical device, which we realize by shaping the wavefront of the input light fields and transmitting them through a complex medium. To demonstrate the capabilities of our method, we experimentally realize a 3x3-port system and use it to generate three output beams with desired mutual correlations.


title: Quantum Machine Learning for Finance

abstract: Quantum computers are expected to surpass the computational capabilities of classical computers during this decade, and achieve disruptive impact on numerous industry sectors, particularly finance. In fact, finance is estimated to be the first industry sector to benefit from Quantum Computing not only in the medium and long terms, but even in the short term. This review paper presents the state of the art of quantum algorithms for financial applications, with particular focus to those use cases that can be solved via Machine Learning.


title: From Atomic Semimetal to Topological Nontrivial Insulator

abstract: Topological band insulators and (semi-) metals can arise out of atomic insulators when the hopping strength between electrons increases. Such topological phases are separated from the atomic insulator by a bulk gap closing. In this work, we show that in many (magnetic) space groups, the crystals with certain Wyckoff positions and orbitals being occupied must be semimetal or metals in the atomic limit, e.g. the hopping strength between electrons is infinite weak but not vanishing, which then are termed atomic (semi-)metals (ASMs). We derive a sufficient condition for realizing ASMs in spinless and spinful systems. Remarkably, we find that increasing the hopping strength between electrons may transform an ASM into an insulator with both symmetries and electron fillings of crystal are preserved. The induced insulators inevitably are topologically non-trivial and at least are obstructed atomic insulators (OAIs) that are labeled as trivial insulator in topological quantum chemistry website. Particularly, using silicon as an example, we show ASM criterion can discover the OAIs missed by the recently proposed criterion of filling enforced OAI. Our work not only establishes an efficient way to identify and design non-trivial insulators but also predicts that the group-IV elemental semiconductors are ideal candidate materials for OAI.


title: Energy Attack: On Transferring Adversarial Examples

abstract: In this work we propose Energy Attack, a transfer-based black-box $L_\infty$-adversarial attack. The attack is parameter-free and does not require gradient approximation. In particular, we first obtain white-box adversarial perturbations of a surrogate model and divide these perturbations into small patches. Then we extract the unit component vectors and eigenvalues of these patches with principal component analysis (PCA). Base on the eigenvalues, we can model the energy distribution of adversarial perturbations. We then perform black-box attacks by sampling from the perturbation patches according to their energy distribution, and tiling the sampled patches to form a full-size adversarial perturbation. This can be done without the available access to victim models. Extensive experiments well demonstrate that the proposed Energy Attack achieves state-of-the-art performance in black-box attacks on various models and several datasets. Moreover, the extracted distribution is able to transfer among different model architectures and different datasets, and is therefore intrinsic to vision architectures.


title: On the use of Wasserstein metric in topological clustering of distributional data

abstract: This paper deals with a clustering algorithm for histogram data based on a Self-Organizing Map (SOM) learning. It combines a dimension reduction by SOM and the clustering of the data in a reduced space. Related to the kind of data, a suitable dissimilarity measure between distributions is introduced: the $L_2$ Wasserstein distance. Moreover, the number of clusters is not fixed in advance but it is automatically found according to a local data density estimation in the original space. Applications on synthetic and real data sets corroborate the proposed strategy.


title: The $u$-plane integral, mock modularity and enumerative geometry

abstract: We revisit the low-energy effective $U(1)$ action of topologically twisted $\mathcal N=2$ SYM theory with gauge group of rank one on a generic oriented smooth 4-manifold $X$ with nontrivial fundamental group. After including a specific new set of $\mathcal Q$-exact operators to the known action, we express the integrand of the path integral of the low-energy $U(1)$ theory as an anti-holomorphic derivative. This allows us to use the theory of mock modular forms and indefinite theta functions for the explicit evaluation of correlation functions of the theory, including but not restricted to those that physically reproduce Donaldson invariants, thus facilitating the computations compared to previously used methods. As an explicit check of our results, we compute the path integral for the product ruled surfaces $X=\Sigma_g \times \mathbb{CP}^1$ for the reduction on either factor and compare the results with existing literature. In the case of reduction on the Riemann surface $\Sigma_g$, via an equivalent topological A-model on $\mathbb{CP}^1$, we will be able to express the generating function of genus zero Gromov-Witten invariants of the moduli space of flat rank one connections over $\Sigma_g$ in terms of an indefinite theta function, whence we would be able to make concrete numerical predictions of these enumerative invariants in terms of modular data, thereby allowing us to derive results in enumerative geometry from number theory.


title: On endomorphisms of the de Rham cohomology functor

abstract: We compute the moduli of endomorphisms of the de Rham and crystalline cohomology functors, viewed as a cohomology theory on smooth schemes over truncated Witt vectors. As applications of our result, we deduce Drinfeld's refinement of the classical Deligne--Illusie decomposition result for de Rham cohomology of varieties in characteristic $p>0$ that are liftable to $W_2$, and prove further functorial improvements.


title: DAE-PINN: A Physics-Informed Neural Network Model for Simulating Differential-Algebraic Equations with Application to Power Networks

abstract: Deep learning-based surrogate modeling is becoming a promising approach for learning and simulating dynamical systems. Deep-learning methods, however, find very challenging learning stiff dynamics. In this paper, we develop DAE-PINN, the first effective deep-learning framework for learning and simulating the solution trajectories of nonlinear differential-algebraic equations (DAE), which present a form of infinite stiffness and describe, for example, the dynamics of power networks. Our DAE-PINN bases its effectiveness on the synergy between implicit Runge-Kutta time-stepping schemes (designed specifically for solving DAEs) and physics-informed neural networks (PINN) (deep neural networks that we train to satisfy the dynamics of the underlying problem). Furthermore, our framework (i) enforces the neural network to satisfy the DAEs as (approximate) hard constraints using a penalty-based method and (ii) enables simulating DAEs for long-time horizons. We showcase the effectiveness and accuracy of DAE-PINN by learning and simulating the solution trajectories of a three-bus power network.


title: Lopsided galactic bars

abstract: Most of the observed and simulated galactic bars are symmetric in the face-on view. However, there are indeed cases of bars that are off-center with respect to the disk or have an asymmetric shape. The only well-known example showing both these features is the Large Magellanic Cloud. We report on the identification of several lopsided galactic bars in the Illustris TNG100 simulation found among a sample of elongated bar-like galaxies studied in the past. The bars show a clear asymmetry in the face-on view, which is in the shape of a footprint. We measured the evolution of the different parameters of the bars' shape and asymmetry as a function of time and find that the asymmetry is preserved for a few Gyr. It can grow together with a bar or appear later, after bar formation. We considered two scenarios leading to the formation of lopsided bars using controlled simulations. In the first, a Milky Way-like galaxy interacts with a massive companion placed on a radial orbit in the plane of the disk and perpendicular to the orientation of the bar at the time of the first passage. In the second, the galaxy initially has an off-center disk and the growth of the bar and its asymmetry is more similar to the one found in IllustrisTNG galaxies, where it is also preceded by the presence of an asymmetric disk. It is thus possible that lopsided bars are born in lopsided disks, although in some cases, the time difference between the occurrence of the asymmetry in the two components is quite large.


title: Social Media Monitoring for IoT Cyber-Threats

abstract: The rapid development of IoT applications and their use in various fields of everyday life has resulted in an escalated number of different possible cyber-threats, and has consequently raised the need of securing IoT devices. Collecting Cyber-Threat Intelligence (e.g., zero-day vulnerabilities or trending exploits) from various online sources and utilizing it to proactively secure IoT systems or prepare mitigation scenarios has proven to be a promising direction. In this work, we focus on social media monitoring and investigate real-time Cyber-Threat Intelligence detection from the Twitter stream. Initially, we compare and extensively evaluate six different machine-learning based classification alternatives trained with vulnerability descriptions and tested with real-world data from the Twitter stream to identify the best-fitting solution. Subsequently, based on our findings, we propose a novel social media monitoring system tailored to the IoT domain; the system allows users to identify recent/trending vulnerabilities and exploits on IoT devices. Finally, to aid research on the field and support the reproducibility of our results we publicly release all annotated datasets created during this process.


title: OPIRL: Sample Efficient Off-Policy Inverse Reinforcement Learning via Distribution Matching

abstract: Inverse Reinforcement Learning (IRL) is attractive in scenarios where reward engineering can be tedious. However, prior IRL algorithms use on-policy transitions, which require intensive sampling from the current policy for stable and optimal performance. This limits IRL applications in the real world, where environment interactions can become highly expensive. To tackle this problem, we present Off-Policy Inverse Reinforcement Learning (OPIRL), which (1) adopts off-policy data distribution instead of on-policy and enables significant reduction of the number of interactions with the environment, (2) learns a stationary reward function that is transferable with high generalization capabilities on changing dynamics, and (3) leverages mode-covering behavior for faster convergence. We demonstrate that our method is considerably more sample efficient and generalizes to novel environments through the experiments. Our method achieves better or comparable results on policy performance baselines with significantly fewer interactions. Furthermore, we empirically show that the recovered reward function generalizes to different tasks where prior arts are prone to fail.


title: A modular construction of unramified $p$-extensions of $\mathbb{Q}(N^{1/p})$

abstract: We show that for primes $N, p \geq 5$ with $N \equiv -1 \bmod p$, the class number of $\mathbb{Q}(N^{1/p})$ is divisible by $p$. Our methods are via congruences between Eisenstein series and cusp forms. In particular, we show that when $N \equiv -1 \bmod p$, there is always a cusp form of weight $2$ and level $\Gamma_0(N^2)$ whose $\ell$-th Fourier coefficient is congruent to $\ell + 1$ modulo a prime above $p$, for all primes $\ell$. We use the Galois representation of such a cusp form to explicitly construct an unramified degree $p$ extension of $\mathbb{Q}(N^{1/p})$.


title: Unravelling the origins of anomalous diffusion: from molecules to migrating storks

abstract: Anomalous diffusion or, more generally, anomalous transport, with nonlinear dependence of the mean-squared displacement on the measurement time, is ubiquitous in nature. It has been observed in processes ranging from microscopic movement of molecules to macroscopic, large-scale paths of migrating birds. Using data from multiple empirical systems, spanning 12 orders of magnitude in length and 8 orders of magnitude in time, we employ a method to detect the individual underlying origins of anomalous diffusion and transport in the data. This method decomposes anomalous transport into three primary effects: long-range correlations ("Joseph effect"), fat-tailed probability density of increments ("Noah effect"), and non-stationarity ("Moses effect"). We show that such a decomposition of real-life data allows to infer nontrivial behavioral predictions, and to resolve open questions in the fields of single particle tracking in living cells and movement ecology.


title: Deep Hough Voting for Robust Global Registration

abstract: Point cloud registration is the task of estimating the rigid transformation that aligns a pair of point cloud fragments. We present an efficient and robust framework for pairwise registration of real-world 3D scans, leveraging Hough voting in the 6D transformation parameter space. First, deep geometric features are extracted from a point cloud pair to compute putative correspondences. We then construct a set of triplets of correspondences to cast votes on the 6D Hough space, representing the transformation parameters in sparse tensors. Next, a fully convolutional refinement module is applied to refine the noisy votes. Finally, we identify the consensus among the correspondences from the Hough space, which we use to predict our final transformation parameters. Our method outperforms state-of-the-art methods on 3DMatch and 3DLoMatch benchmarks while achieving comparable performance on KITTI odometry dataset. We further demonstrate the generalizability of our approach by setting a new state-of-the-art on ICL-NUIM dataset, where we integrate our module into a multi-way registration pipeline.


title: Hidden-charm tetraquarks with strangeness in the chiral quark model

abstract: The hidden-charm tetraquarks with strangeness, $c\bar{c}s\bar{q}$ $(q=u,\,d)$, in $J^P=0^+$, $1^+$ and $2^+$ are systematically investigated in the framework of real- and complex-scaling range of a chiral quark model, whose parameters have been fixed in advance describing hadron, hadron-hadron and multiquark phenomenology. Each tetraquark configuration, compatible with the quantum numbers studied, is taken into account; this includes meson-meson, diquark-antidiquark and K-type arrangements of quarks with all possible color wave functions in four-body sector. Among the different numerical techniques to solve the Schr\"odinger-like 4-body bound state equation, we use a variational method in which the trial wave function is expanded in complex-range Gaussian basis functions, which is characterized by its simplicity and flexibility. This theoretical framework has already been used to study different kinds of multiquark systems, such as the hidden-charm pentaquarks, $P^+_c$, and doubly-charmed tetraquarks, $T^+_{cc}$. The recently reported $Z_{cs}$ states by the BESIII and LHCb collaborations are generally compatible with either compact tetraquark or hadronic molecular resonance configurations in our investigation. Moreover, several additional exotic resonances are found in the mass range between 3.8 GeV and 4.6 GeV.


title: MATE: Multi-view Attention for Table Transformer Efficiency

abstract: This work presents a sparse-attention Transformer architecture for modeling documents that contain large tables. Tables are ubiquitous on the web, and are rich in information. However, more than 20% of relational tables on the web have 20 or more rows (Cafarella et al., 2008), and these large tables present a challenge for current Transformer models, which are typically limited to 512 tokens. Here we propose MATE, a novel Transformer architecture designed to model the structure of web tables. MATE uses sparse attention in a way that allows heads to efficiently attend to either rows or columns in a table. This architecture scales linearly with respect to speed and memory, and can handle documents containing more than 8000 tokens with current accelerators. MATE also has a more appropriate inductive bias for tabular data, and sets a new state-of-the-art for three table reasoning datasets. For HybridQA (Chen et al., 2020b), a dataset that involves large documents containing tables, we improve the best prior result by 19 points.


title: Continuous Event-Line Constraint for Closed-Form Velocity Initialization

abstract: Event cameras trigger events asynchronously and independently upon a sufficient change of the logarithmic brightness level. The neuromorphic sensor has several advantages over standard cameras including low latency, absence of motion blur, and high dynamic range. Event cameras are particularly well suited to sense motion dynamics in agile scenarios. We propose the continuous event-line constraint, which relies on a constant-velocity motion assumption as well as trifocal tensor geometry in order to express a relationship between line observations given by event clusters as well as first-order camera dynamics. Our core result is a closed-form solver for up-to-scale linear camera velocity {with known angular velocity}. Nonlinear optimization is adopted to improve the performance of the algorithm. The feasibility of the approach is demonstrated through a careful analysis on both simulated and real data.


title: Variational Latent-State GPT for Semi-Supervised Task-Oriented Dialog Systems

abstract: Recently, two approaches, fine-tuning large pre-trained language models and variational training, have attracted significant interests, separately, for semi-supervised end-to-end task-oriented dialog (TOD) systems. In this paper, we propose Variational Latent-State GPT model (VLS-GPT), which is the first to combine the strengths of the two approaches. Among many options of models, we propose the generative model and the inference model for variational learning of the end-to-end TOD system, both as auto-regressive language models based on GPT-2, which can be further trained over a mix of labeled and unlabeled dialog data in a semi-supervised manner. Variational training of VLS-GPT is both statistically and computationally more challenging than previous variational learning works for sequential latent variable models, which use turn-level first-order Markovian. The inference model in VLS-GPT is non-Markovian due to the use of the Transformer architecture. In this work, we establish Recursive Monte Carlo Approximation (RMCA) to the variational objective with non-Markovian inference model and prove its unbiasedness. Further, we develop the computational strategy of sampling-then-forward-computation to realize RMCA, which successfully overcomes the memory explosion issue of using GPT in variational learning and speeds up training. Semi-supervised TOD experiments are conducted on two benchmark multi-domain datasets of different languages - MultiWOZ2.1 and CrossWOZ. VLS-GPT is shown to significantly outperform both supervised-only and semi-supervised self-training baselines.


title: Yet another proof of the strong law of large numbers

abstract: We give a short proof of the strong law of large numbers based on duality for random walk


title: Accounting for Variations in Speech Emotion Recognition with Nonparametric Hierarchical Neural Network

abstract: In recent years, deep-learning-based speech emotion recognition models have outperformed classical machine learning models. Previously, neural network designs, such as Multitask Learning, have accounted for variations in emotional expressions due to demographic and contextual factors. However, existing models face a few constraints: 1) they rely on a clear definition of domains (e.g. gender, noise condition, etc.) and the availability of domain labels; 2) they often attempt to learn domain-invariant features while emotion expressions can be domain-specific. In the present study, we propose the Nonparametric Hierarchical Neural Network (NHNN), a lightweight hierarchical neural network model based on Bayesian nonparametric clustering. In comparison to Multitask Learning approaches, the proposed model does not require domain/task labels. In our experiments, the NHNN models generally outperform the models with similar levels of complexity and state-of-the-art models in within-corpus and cross-corpus tests. Through clustering analysis, we show that the NHNN models are able to learn group-specific features and bridge the performance gap between groups.


title: On the asymptotic confirmation of the Faudree-Lehel Conjecture for general graphs

abstract: Given a simple graph $G$, the {\it irregularity strength} of $G$, denoted by $s(G)$, is the least positive integer $k$ such that there is a weight assignment on edges $f: E(G) \to \{1,2,\dots, k\}$ attributing distinct weighted degrees: $\tilde f(v):= \sum_{u: \{u,v\}\in E(G)} f(\{u,v\})$ to all vertices $v\in V(G)$. It is straightforward that $s(G) \geq n/d$ for every $d$-regular graph $G$ on $n$ vertices with $d>1$. In 1987, Faudree and Lehel conjectured in turn that there is an absolute constant $c$ such that $s(G) \leq n/d + c$ for all such graphs. Even though the conjecture has remained open in almost all relevant cases, it is more generally believed that there exists a universal constant $c$ such that $s(G) \leq n/\delta + c$ for every graph $G$ on $n$ vertices with minimum degree $\delta \geq 1$ which does not contain an isolated edge. In this paper we confirm that the generalized Faudree-Lehel Conjecture holds for graphs with $\delta\geq n^\beta$ where $\beta$ is any fixed constant larger than $0.8$. Furthermore, we confirm that the conjecture holds in general asymptotically. That is we prove that for any $\varepsilon\in(0,0.25)$ there exist absolute constants $c_1, c_2$ such that for all graphs $G$ on $n$ vertices with minimum degree %at least $\delta\geq 1$ and without isolated edges, $s(G) \leq \frac{n}{\delta}(1+\frac{c_1}{\delta^{\varepsilon}})+c_2$, thus extending in various aspects and strengthening a recent result of Przyby{\l}o, who showed that $s(G) \leq \frac{n}{d}(1+ \frac{1}{\ln^{\epsilon/19}n})=\frac{n}{d}(1+o(1))$ for $d$-regular graphs with $d\in [\ln^{1+\epsilon} n, n/\ln^{\epsilon}n]$, and improving an earlier general upper bound: $s(G)< 6\frac{n}{\delta}+6$ of Kalkowski, Karo\'nski and Pfender.


title: Estimation of Corporate Greenhouse Gas Emissions via Machine Learning

abstract: As an important step to fulfill the Paris Agreement and achieve net-zero emissions by 2050, the European Commission adopted the most ambitious package of climate impact measures in April 2021 to improve the flow of capital towards sustainable activities. For these and other international measures to be successful, reliable data is key. The ability to see the carbon footprint of companies around the world will be critical for investors to comply with the measures. However, with only a small portion of companies volunteering to disclose their greenhouse gas (GHG) emissions, it is nearly impossible for investors to align their investment strategies with the measures. By training a machine learning model on disclosed GHG emissions, we are able to estimate the emissions of other companies globally who do not disclose their emissions. In this paper, we show that our model provides accurate estimates of corporate GHG emissions to investors such that they are able to align their investments with the regulatory measures and achieve net-zero goals.


title: Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Data

abstract: While multilingual pretrained language models (LMs) fine-tuned on a single language have shown substantial cross-lingual task transfer capabilities, there is still a wide performance gap in semantic parsing tasks when target language supervision is available. In this paper, we propose a novel Translate-and-Fill (TaF) method to produce silver training data for a multilingual semantic parser. This method simplifies the popular Translate-Align-Project (TAP) pipeline and consists of a sequence-to-sequence filler model that constructs a full parse conditioned on an utterance and a view of the same parse. Our filler is trained on English data only but can accurately complete instances in other languages (i.e., translations of the English training utterances), in a zero-shot fashion. Experimental results on three multilingual semantic parsing datasets show that data augmentation with TaF reaches accuracies competitive with similar systems which rely on traditional alignment techniques.


title: Discovery of New Multi-Level Features for Domain Generalization via Knowledge Corruption

abstract: Machine learning models that can generalize to unseen domains are essential when applied in real-world scenarios involving strong domain shifts. We address the challenging domain generalization (DG) problem, where a model trained on a set of source domains is expected to generalize well in unseen domains without any exposure to their data. The main challenge of DG is that the features learned from the source domains are not necessarily present in the unseen target domains, leading to performance deterioration. We assume that learning a richer set of features is crucial to improve the transfer to a wider set of unknown domains. For this reason, we propose COLUMBUS, a method that enforces new feature discovery via a targeted corruption of the most relevant input and multi-level representations of the data. We conduct an extensive empirical evaluation to demonstrate the effectiveness of the proposed approach which achieves new state-of-the-art results by outperforming 18 DG algorithms on multiple DG benchmark datasets in the DomainBed framework.


title: Smoothed Contrastive Learning for Unsupervised Sentence Embedding

abstract: Contrastive learning has been gradually applied to learn high-quality unsupervised sentence embedding. Among the previous un-supervised methods, the latest state-of-the-art method, as far as we know, is unsupervised SimCSE (unsup-SimCSE). Unsup-SimCSE uses the InfoNCE1loss function in the training stage by pulling semantically similar sentences together and pushing apart dis-similar ones.Theoretically, we expect to use larger batches in unsup-SimCSE to get more adequate comparisons among samples and avoid overfitting. However, increasing the batch size does not always lead to improvements, but instead even lead to performance degradation when the batch size exceeds a threshold. Through statistical observation, we find that this is probably due to the introduction of low-confidence negative pairs after in-creasing the batch size. To alleviate this problem, we introduce a simple smoothing strategy upon the InfoNCE loss function, termedGaussian Smoothing InfoNCE (GS-InfoNCE).Specifically, we add random Gaussian noise vectors as negative samples, which act asa smoothing of the negative sample space.Though being simple, the proposed smooth-ing strategy brings substantial improvements to unsup-SimCSE. We evaluate GS-InfoNCEon the standard semantic text similarity (STS)task. GS-InfoNCE outperforms the state-of-the-art unsup-SimCSE by an average Spear-man correlation of 1.38%, 0.72%, 1.17% and0.28% on the base of BERT-base, BERT-large,RoBERTa-base and RoBERTa-large, respectively.


title: Learning Vision-Guided Dynamic Locomotion Over Challenging Terrains

abstract: Legged robots are becoming increasingly powerful and popular in recent years for their potential to bring the mobility of autonomous agents to the next level. This work presents a deep reinforcement learning approach that learns a robust Lidar-based perceptual locomotion policy in a partially observable environment using Proximal Policy Optimisation. Visual perception is critical to actively overcome challenging terrains, and to do so, we propose a novel learning strategy: Dynamic Reward Strategy (DRS), which serves as effective heuristics to learn a versatile gait using a neural network architecture without the need to access the history data. Moreover, in a modified version of the OpenAI gym environment, the proposed work is evaluated with scores over 90% success rate in all tested challenging terrains.


title: Importance sampling based active learning for parametric seismic fragility curve estimation

abstract: The key elements of seismic probabilistic risk assessment studies are the fragility curves which express the probabilities of failure of structures conditional to a seismic intensity measure. A multitude of procedures is currently available to estimate these curves. For modeling-based approaches which may involve complex and expensive numerical models, the main challenge is to optimize the calls to the numerical codes to reduce the estimation costs. Adaptive techniques can be used for this purpose, but in doing so, taking into account the uncertainties of the estimates (via confidence intervals or ellipsoids related to the size of the samples used) is an arduous task because the samples are no longer independent and possibly not identically distributed. The main contribution of this work is to deal with this question in a mathematical and rigorous way. To this end, we propose and implement an active learning methodology based on adaptive importance sampling for parametric estimations of fragility curves. We prove some theoretical properties (consistency and asymptotic normality) for the estimator of interest. Moreover, we give a convergence criterion in order to use asymptotic confidence ellipsoids. Finally, the performances of the methodology are evaluated on analytical and industrial test cases of increasing complexity.


title: A Tale of Two (and More) Altruists

abstract: We introduce a minimalist dynamical model of wealth evolution and wealth sharing among $N$ agents as a platform to compare the relative merits of altruism and individualism. In our model, the wealth of each agent independently evolves by diffusion. For a population of altruists, whenever any agent reaches zero wealth (that is, the agent goes bankrupt), the remaining wealth of the other $N-1$ agents is equally shared among all. The population is collectively defined to be bankrupt when its total wealth falls below a specified small threshold value. For individualists, each time an agent goes bankrupt (s)he is considered to be "dead" and no wealth redistribution occurs. We determine the evolution of wealth in these two societies. Altruism leads to more global median wealth at early times; eventually, however, the longest-lived individualists accumulate most of the wealth and are richer and more long lived than the altruists.


title: Learning Opinion Summarizers by Selecting Informative Reviews

abstract: Opinion summarization has been traditionally approached with unsupervised, weakly-supervised and few-shot learning techniques. In this work, we collect a large dataset of summaries paired with user reviews for over 31,000 products, enabling supervised training. However, the number of reviews per product is large (320 on average), making summarization - and especially training a summarizer - impractical. Moreover, the content of many reviews is not reflected in the human-written summaries, and, thus, the summarizer trained on random review subsets hallucinates. In order to deal with both of these challenges, we formulate the task as jointly learning to select informative subsets of reviews and summarizing the opinions expressed in these subsets. The choice of the review subset is treated as a latent variable, predicted by a small and simple selector. The subset is then fed into a more powerful summarizer. For joint training, we use amortized variational inference and policy gradient methods. Our experiments demonstrate the importance of selecting informative reviews resulting in improved quality of summaries and reduced hallucinations.


title: First measurement of $\rm \Omega_c^0$ production in pp collisions at $\sqrt{s}=13$ TeV with ALICE

abstract: Recent measurements of charm-baryon production in proton--proton (pp) collisions at midrapidity by the ALICE collaboration showed that baryon-to-meson yield ratios are significantly higher than those measured in $\rm e^+e^-$ collisions. The charm baryon-to-meson and charm baryon-to-baryon yield ratios provide unique information on hadronization mechanisms since the contributions from parton distribution function and parton--parton scattering terms cancel in the ratios. In this contribution, the first measurement of $\rm \Omega_{c}^{0}$ production via the hadronic decay channel $\rm \Omega_{c}^{0} \rightarrow \Omega^{-}\pi^{+}$ (and its charge conjugate) in $2<p_{\rm T}<12$ GeV/$c$ performed with the ALICE detector at midrapidity in pp collisions at $\sqrt{s}=$ 13 TeV is presented. The $\rm \Omega_c^0/D^0$ and $\rm \Omega_c^0/\Xi_c^0$ ratios multiplied by the decay branching ratio $\rm BR(\Omega_{c}^{0} \rightarrow \Omega^{-}\pi^+)$, which is not experimentally measured, are compared to MC generators with fragmentation fractions based on $\rm e^+e^-$ measurements and models including hadronization of charm quark via coalescence.


title: Wetting dynamics in an angular channel

abstract: We analyze the dynamics of liquid filling in a thin, slightly inflated rectangular channel driven by capillary forces. We show that although the amount of liquid $m$ in the channel increases in time following the classical Lucas-Washburn law, $m \propto t^{1/2}$, the prefactor is very sensitive to the deformation of the channel because the filling takes place by the growth of two parts, the bulk part (where the cross-section is completely filled by the liquid), and the finger part (where the cross-section is partially filled). We calculate the time dependence of $m$ accounting for the coupling between the two parts and show that the prefactor for the filling can be reduced significantly by a slight deformation of the rectangular channel, e.g., the prefactor is reduced 50% for a strain of 0.1%. This offers an explanation for the large deviation in the value of the prefactor reported previously.


title: Visibility Predictions for Near-Future Satellite Megaconstellations: Latitudes near 50 Degrees will Experience the Worst Light Pollution

abstract: Megaconstellations of thousands to tens of thousands of artificial satellites (satcons) are rapidly being developed and launched. These satcons will have negative consequences for observational astronomy research, and are poised to drastically interfere with naked-eye stargazing worldwide should mitigation efforts be unsuccessful. Here we provide predictions for the optical brightnesses and on-sky distributions of several satcons, including Starlink, OneWeb, Kuiper, and StarNet/GW, for a total of 65,000 satellites on their filed or predicted orbits. We develop a simple model of satellite reflectivity, which is calibrated using published Starlink observations. We use this model to estimate the visible magnitudes and on-sky distributions for these satellites as seen from different places on Earth, in different seasons, and different times of night. For latitudes near 50 degrees North and South, satcon satellites make up a few percent of all visible point sources all night long near the summer solstice, as well as near sunrise and sunset on the equinoxes. Altering the satellites' altitudes only changes the specific impacts of the problem. Without drastic reduction of the reflectivities, or significantly fewer total satellites in orbit, satcons will significantly change the night sky worldwide.


title: Magnonic spin Joule heating and rectification effects

abstract: Nonlinear devices, such as transistors, enable contemporary computing technologies. We theoretically investigate nonlinear effects, bearing a high fundamental scientific and technical relevance, in magnonics with emphasis on superconductor-ferromagnet hybrids. Accounting for finite magnon chemical potential, we theoretically demonstrate magnonic spin-Joule heating, the spin analogue of conventional electronic Joule heating. Besides suggesting a key contribution to magnonic heat transport in a broad range of devices, it provides insights into the thermal physics of non-conserved bosonic excitations. Considering a spin-split superconductor self-consistently, we demonstrate its interface with a ferromagnetic insulator to harbor large tunability of spin and thermal conductances. We further demonstrate hysteretic rectification I-V characteristics in this hybrid, where the hysteresis results from the superconducting state bistability.


title: On iterated interpolation

abstract: Matrices resulting from the discretization of a kernel function, e.g., in the context of integral equations or sampling probability distributions, can frequently be approximated by interpolation. In order to improve the efficiency, a multi-level approach can be employed that involves interpolating the kernel function and its approximations multiple times. This article presents a new approach to analyze the error incurred by these iterated interpolation procedures that is considerably more elegant than its predecessors and allows us to treat not only the kernel function itself, but also its derivatives.


title: A non-commutative analogue of Clausen's view on the id\`{e}le class group

abstract: Clausen predicted that Chevalley's id\`{e}le class group of a number field $F$ appears as the first $K$-group of the category of locally compact $F$-vector spaces. This has turned out to be true, and even generalizes to the higher $K$-groups in a suitable sense. We replace $F$ by a semisimple $\mathbb{Q}$-algebra, and obtain Fr\"{o}hlich's non-commutative id\`{e}le class group in an analogous fashion, modulo the reduced norm one elements. Even in the number field case our proof is simpler than the existing one, and based on the localization theorem for percolating subcategories. Finally, using class field theory as input, we interpret Hilbert's reciprocity law (as well as a noncommutative variant) in terms of our results.


title: PPT: Pre-trained Prompt Tuning for Few-shot Learning

abstract: Prompts for pre-trained language models (PLMs) have shown remarkable performance by bridging the gap between pre-training tasks and various downstream tasks. Among these methods, prompt tuning, which freezes PLMs and only tunes soft prompts, provides an efficient and effective solution for adapting large-scale PLMs to downstream tasks. However, prompt tuning is yet to be fully explored. In our pilot experiments, we find that prompt tuning performs comparably with conventional full-model fine-tuning when downstream data are sufficient, whereas it performs much worse under few-shot learning settings, which may hinder the application of prompt tuning in practice. We attribute this low performance to the manner of initializing soft prompts. Therefore, in this work, we propose to pre-train prompts by adding soft prompts into the pre-training stage to obtain a better initialization. We name this Pre-trained Prompt Tuning framework "PPT". To ensure the generalization of PPT, we formulate similar classification tasks into a unified task form and pre-train soft prompts for this unified task. Extensive experiments show that tuning pre-trained prompts for downstream tasks can reach or even outperform full-model fine-tuning under both full-data and few-shot settings. Our approach is effective and efficient for using large-scale PLMs in practice.


title: A note on the sum of finite multiple harmonic $q$-series on $r\text{-}(r+1)$ indices

abstract: We study the sum of the finite multiple harmonic $q$-series on $r\text{-}(r+1)$ indices at roots of unity with $r=1,2,3$. And we give the equivalent conditions of two conjectures regarding cyclic sums of finite multiple harmonic $q$-series on $1\text{-}2\text{-}3$ indices at roots of unity, posed recently by Kh. Pilehrood, T. Pilehrood and R. Tauraso.


title: Exact solutions, spectrum properties, and hierarchical structures of the multiple temperature model

abstract: Recent developments of ultrafast laser pulse techniques enable us to study the subpicosecond scale dynamics out of thermal equilibrium. Multiple temperature models are frequently used to describe such dynamics where the total system is divided into subsystems each of which is in local thermal equilibrium. Typical examples include the electron-lattice two temperature model and electron-spin-phonon three temperature model. We present the exact analytical solutions of linear multiple temperature model, based on the Fourier series expansion, and discuss their properties for the case of the two and three temperature models. The solutions are linear combinations of "eigenmodes" characterized by the wave vector $\mathbf{q}$ and the well-defined mode lifetime. The eigenmode picture enables us to explore the hierarchical structure of models with respect to space, time and the coupling parameter. We also find diffusion modes unique to the three temperature model which unveils the rich physics in spite of the simplicity of the model. We prove that the eigensystem in this model is non-positive definite, which assures that the mode lifetime is always well-defined. This property clearly characterizes the model.


title: UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformer

abstract: Most recent semantic segmentation methods adopt a U-Net framework with an encoder-decoder architecture. It is still challenging for U-Net with a simple skip connection scheme to model the global multi-scale context: 1) Not each skip connection setting is effective due to the issue of incompatible feature sets of encoder and decoder stage, even some skip connection negatively influence the segmentation performance; 2) The original U-Net is worse than the one without any skip connection on some datasets. Based on our findings, we propose a new segmentation framework, named UCTransNet (with a proposed CTrans module in U-Net), from the channel perspective with attention mechanism. Specifically, the CTrans module is an alternate of the U-Net skip connections, which consists of a sub-module to conduct the multi-scale Channel Cross fusion with Transformer (named CCT) and a sub-module Channel-wise Cross-Attention (named CCA) to guide the fused multi-scale channel-wise information to effectively connect to the decoder features for eliminating the ambiguity. Hence, the proposed connection consisting of the CCT and CCA is able to replace the original skip connection to solve the semantic gaps for an accurate automatic medical image segmentation. The experimental results suggest that our UCTransNet produces more precise segmentation performance and achieves consistent improvements over the state-of-the-art for semantic segmentation across different datasets and conventional architectures involving transformer or U-shaped framework. Code: https://github.com/McGregorWwww/UCTransNet.


title: Photonic integrated chip enabling orbital angular momentum multiplexing for quantum communication

abstract: Light carrying orbital angular momentum constitutes an important resource for both classical and quantum information technologies. Its inherently unbounded nature can be exploited to generate high-dimensional quantum states or for channel multiplexing in classical and quantum communication in order to significantly boost the data capacity and the secret key rate, respectively. While the big potentials of light owning orbital angular momentum have been widely ascertained, its technological deployment is still limited by the difficulties deriving from the fabrication of integrated and scalable photonic devices able to generate and manipulate it. Here, we present a photonic integrated chip able to excite orbital angular momentum modes in an 800 m long ring-core fiber, allowing us to perform parallel quantum key distribution using 2 and 3 different modes simultaneously. The experiment sets the first steps towards quantum orbital angular momentum division multiplexing enabled by a compact and light-weight silicon chip, and further pushes the development of integrated scalable devices supporting orbital angular momentum modes.


title: PARIOT: Anti-Repackaging for IoT Firmware Integrity

abstract: IoT repackaging refers to an attack devoted to tampering with a legitimate firmware package by modifying its content (e.g., injecting some malicious code) and re-distributing it in the wild. In such a scenario, the firmware delivery and update processes play a central role in ensuring firmware integrity. Unfortunately, several existing solutions lack proper integrity verification, exposing firmware to repackaging attacks. If this is not the case, they still require an external trust anchor (e.g., signing keys or secure storage technologies), which could limit their adoption in resource-constrained environments. In addition, state-of-the-art frameworks do not cope with the entire firmware production and delivery process, thereby failing to protect the content generated by the firmware producers through the whole supply chain. To mitigate such a problem, in this paper, we introduce PARIOT, a novel self-protecting scheme for IoT that allows the injection of integrity checks, called anti-tampering (AT) controls, directly into the firmware. The AT controls enable the runtime detection of repackaging attempts without needing external trust anchors or computationally expensive systems. PARIOT can be adopted on top of existing state-of-the-art solutions ensuring the widest compatibility with current IoT ecosystems and update frameworks. Also, we have implemented this scheme into PARIOTIC, a prototype to automatically protect C/C++ IoT firmware. The evaluation phase of 50 real-world firmware samples demonstrated the feasibility of the proposed methodology and its robustness against practical repackaging attacks without altering the firmware behavior or severe overheads.


title: Screw dislocations in cubic chiral magnets

abstract: Helimagnets realize an effective lamellar ordering that supports disclination and dislocation defects. Here, we investigate the micromagnetic structure of screw dislocation lines in cubic chiral magnets using analytical and numerical methods. The far field of these dislocations is universal and classified by an integer strength $\nu$ that characterizes the winding of magnetic moments. We demonstrate that a rich variety of dislocation-core structures can be realized even for the same strength $\nu$. In particular, the magnetization at the core can be either smooth or singular. We present a specific example with $\nu = 1$ for which the core is composed of a chain of singular Bloch points. In general, screw dislocations carry a non-integer but finite skyrmion charge so that they can be efficiently manipulated by spin currents.


title: A Review of Third Way Consistent Theories

abstract: We will give an overview of the "third way consistent" theories. Field equations of such models do not come from the variation of a local action without auxiliary fields, yet their covariant divergences still vanish on-shell. First examples were discovered in three dimensions which were pure massive gravity and Yang-Mills theories. However, recently interacting $p$-form theories with this property in arbitrary dimensions were also constructed. After explaining construction of these theories and some of their general features, we will discuss some open problems and future directions


title: Online Search for a Hyperplane in High-Dimensional Euclidean Space

abstract: We consider the online search problem in which a server starting at the origin of a $d$-dimensional Euclidean space has to find an arbitrary hyperplane. The best-possible competitive ratio and the length of the shortest curve from which each point on the $d$-dimensional unit sphere can be seen are within a constant factor of each other. We show that this length is in $\Omega(d)\cap O(d^{3/2})$.


title: Counting chains in the noncrossing partition lattice via the W-Laplacian

abstract: We give an elementary, case-free, Coxeter-theoretic derivation of the formula $h^nn!/|W|$ for the number of maximal chains in the noncrossing partition lattice $NC(W)$ of a real reflection group $W$. Our proof proceeds by comparing the Deligne-Reading recursion with a parabolic recursion for the characteristic polynomial of the $W$-Laplacian matrix considered in our previous work. We further discuss the consequences of this formula for the geometric group theory of spherical and affine Artin groups.


title: On the order of magnitude of Sudler products II

abstract: We study the asymptotic behavior of Sudler products $P_N(\alpha)= \prod_{r=1}^{N}2|\sin \pi r\alpha|$ for quadratic irrationals $\alpha \in \mathbb{R}$. In particular, we verify the convergence of certain perturbed Sudler products along subsequences, and show that $\liminf_N P_N(\alpha) = 0$ and $\limsup_N P_N(\alpha)/N = \infty$ whenever the maximal digit in the continued fraction expansion of $\alpha$ exceeds $23$. This generalizes results obtained for the period one case $\alpha=[0; \overline{a}]$.


title: Eliciting Truthful Reports with Partial Signals in Repeated Games

abstract: We consider a repeated game where a player self-reports her usage of a service and is charged a payment accordingly by a center. The center observes a partial signal, representing part of the player's true consumption, which is generated from a publicly known distribution. The player can report any value that does not contradict the signal and the center issues a payment based on the reported information. Such problems find application in net metering billing in the electricity market, where a customer's actual consumption of the electricity network is masked and complete verification is impractical. When the underlying true value is relatively constant, we propose a penalty mechanism that elicits truthful self-reports. Namely, besides charging the player the reported value, the mechanism charges a penalty proportional to her inconsistent reports. We show how fear of the uncertainty in the future incentivizes the player to be truthful today. For Bernoulli distributions, we give the complete analysis and optimal strategies given any penalty. Since complete truthfulness is not possible for continuous distributions, we give approximate truthful results by a reduction from Bernoulli distributions. We also extend our mechanism to a multi-player cost sharing setting and give equilibrium results.


title: EvilModel 2.0: Bringing Neural Network Models into Malware Attacks

abstract: Security issues have gradually emerged with the continuous development of artificial intelligence (AI). Earlier work verified the possibility of converting neural network models into stegomalware, embedding malware into a model with limited impact on the model's performance. However, existing methods are not applicable in real-world attack scenarios and do not attract enough attention from the security community due to performance degradation and additional workload. Therefore, we propose an improved stegomalware EvilModel. By analyzing the composition of the neural network model, three new methods for embedding malware into the model are proposed: MSB reservation, fast substitution, and half substitution, which can embed malware that accounts for half of the model's volume without affecting the model's performance. We built 550 EvilModels using ten mainstream neural network models and 19 malware samples. The experiment shows that EvilModel achieved an embedding rate of 48.52\%. A quantitative algorithm is proposed to evaluate the existing embedding methods. We also design a trigger and propose a threat scenario for the targeted attack. The practicality and effectiveness of the proposed methods were demonstrated by experiments and analyses of the embedding capacity, performance impact, and detection evasion.


title: Superconductivity from Repulsive Interactions in Rhombohedral Trilayer Graphene: a Kohn-Luttinger-Like Mechanism

abstract: We study the emergence of superconductivity in rhombohedral trilayer graphene due purely to the long-range Coulomb repulsion. This repulsive-interaction-driven phase in rhombohedral trilayer graphene is significantly different from those found in twisted bilayer and trilayer graphenes. In the latter case, the nontrivial momentum-space geometry of the Bloch wavefunctions leads to an effective attractive electron-electron interaction; this allows for less modulated order parameters and for spin-singlet pairing. In rhombohedral trilayer graphene, we instead find spin-triplet superconductivity with critical temperatures up to 0.15 K. The critical temperatures strongly depend on electron filling and peak where the density of states diverge. The order parameter shows a significant modulation within each valley pocket of the Fermi surface.


title: Goodness-of-Fit Testing for H\"older-Continuous Densities: Sharp Local Minimax Rates

abstract: We consider the goodness-of fit testing problem for H\"older smooth densities over $\mathbb{R}^d$: given $n$ iid observations with unknown density $p$ and given a known density $p_0$, we investigate how large $\rho$ should be to distinguish, with high probability, the case $p=p_0$ from the composite alternative of all H\"older-smooth densities $p$ such that $\|p-p_0\|_t \geq \rho$ where $t \in [1,2]$. The densities are assumed to be defined over $\mathbb{R}^d$ and to have H\"older smoothness parameter $\alpha>0$. In the present work, we solve the case $\alpha \leq 1$ and handle the case $\alpha>1$ using an additional technical restriction on the densities. We identify matching upper and lower bounds on the local minimax rates of testing, given explicitly in terms of $p_0$. We propose novel test statistics which we believe could be of independent interest. We also establish the first definition of an explicit cutoff $u_B$ allowing us to split $\mathbb{R}^d$ into a bulk part (defined as the subset of $\mathbb{R}^d$ where $p_0$ takes only values greater than or equal to $u_B$) and a tail part (defined as the complementary of the bulk), each part involving fundamentally different contributions to the local minimax rates of testing.


title: Clockwork Finance: Automated Analysis of Economic Security in Smart Contracts

abstract: We introduce the Clockwork Finance Framework (CFF), a general purpose, formal verification framework for mechanized reasoning about the economic security properties of composed decentralized-finance (DeFi) smart contracts. CFF features three key properties. It is contract complete, meaning that it can model any smart contract platform and all its contracts--Turing complete or otherwise. It does so with asymptotically constant model overhead. It is also attack-exhaustive by construction, meaning that it can automatically and mechanically extract all possible economic attacks on users' cryptocurrency across modeled contracts. Thanks to these properties, CFF can support multiple goals: economic security analysis of contracts by developers, analysis of DeFi trading risks by users, fees UX, and optimization of arbitrage opportunities by bots or miners. Because CFF offers composability, it can support these goals with reasoning over any desired set of potentially interacting smart contract models. We instantiate CFF as an executable model for Ethereum contracts that incorporates a state-of-the-art deductive verifier. Building on previous work, we introduce extractable value (EV), a new formal notion of economic security in composed DeFi contracts that is both a basis for CFF and of general interest. We construct modular, human-readable, composable CFF models of four popular, deployed DeFi protocols in Ethereum: Uniswap, Uniswap V2, Sushiswap, and MakerDAO, representing a combined 24 billion USD in value as of March 2022. We use these models along with some other common models such as flash loans, airdrops and voting to show experimentally that CFF is practical and can drive useful, data-based EV-based insights from real world transaction activity. Without any explicitly programmed attack strategies, CFF uncovers on average an expected $56 million of EV per month in the recent past.


title: VAINE: Visualization and AI for Natural Experiments

abstract: Natural experiments are observational studies where the assignment of treatment conditions to different populations occurs by chance "in the wild". Researchers from fields such as economics, healthcare, and the social sciences leverage natural experiments to conduct hypothesis testing and causal effect estimation for treatment and outcome variables that would otherwise be costly, infeasible, or unethical. In this paper, we introduce VAINE (Visualization and AI for Natural Experiments), a visual analytics tool for identifying and understanding natural experiments from observational data. We then demonstrate how VAINE can be used to validate causal relationships, estimate average treatment effects, and identify statistical phenomena such as Simpson's paradox through two usage scenarios.


title: Uncertainty Measures in Neural Belief Tracking and the Effects on Dialogue Policy Performance

abstract: The ability to identify and resolve uncertainty is crucial for the robustness of a dialogue system. Indeed, this has been confirmed empirically on systems that utilise Bayesian approaches to dialogue belief tracking. However, such systems consider only confidence estimates and have difficulty scaling to more complex settings. Neural dialogue systems, on the other hand, rarely take uncertainties into account. They are therefore overconfident in their decisions and less robust. Moreover, the performance of the tracking task is often evaluated in isolation, without consideration of its effect on the downstream policy optimisation. We propose the use of different uncertainty measures in neural belief tracking. The effects of these measures on the downstream task of policy optimisation are evaluated by adding selected measures of uncertainty to the feature space of the policy and training policies through interaction with a user simulator. Both human and simulated user results show that incorporating these measures leads to improvements both of the performance and of the robustness of the downstream dialogue policy. This highlights the importance of developing neural dialogue belief trackers that take uncertainty into account.


title: Searching for VHE gamma-ray emission associated with IceCube neutrino alerts using FACT, H.E.S.S., MAGIC, and VERITAS

abstract: The realtime follow-up of neutrino events is a promising approach to search for astrophysical neutrino sources. It has so far provided compelling evidence for a neutrino point source: the flaring gamma-ray blazar TXS 0506+056 observed in coincidence with the high-energy neutrino IceCube-170922A detected by IceCube. The detection of very-high-energy gamma rays (VHE, $\mathrm{E} > 100\,\mathrm{GeV}$) from this source helped establish the coincidence and constrained the modeling of the blazar emission at the time of the IceCube event. The four major imaging atmospheric Cherenkov telescope arrays (IACTs) - FACT, H.E.S.S., MAGIC, and VERITAS - operate an active follow-up program of target-of-opportunity observations of neutrino alerts sent by IceCube. This program has two main components. One are the observations of known gamma-ray sources around which a cluster of candidate neutrino events has been identified by IceCube (Gamma-ray Follow-Up, GFU). Second one is the follow-up of single high-energy neutrino candidate events of potential astrophysical origin such as IceCube-170922A. GFU has been recently upgraded by IceCube in collaboration with the IACT groups. We present here recent results from the IACT follow-up programs of IceCube neutrino alerts and a description of the upgraded IceCube GFU system.


title: NeuralFMU: Towards Structural Integration of FMUs into Neural Networks

abstract: This paper covers two major subjects: First, the presentation of a new open-source library called FMI.jl for integrating FMI into the Julia programming environment by providing the possibility to load, parameterize and simulate FMUs. Further, an extension to this library called FMIFlux.jl is introduced, that allows the integration of FMUs into a neural network topology to obtain a NeuralFMU. This structural combination of an industry typical black-box model and a data-driven machine learning model combines the different advantages of both modeling approaches in one single development environment. This allows for the usage of advanced data driven modeling techniques for physical effects that are difficult to model based on first principles.


title: PhysGNN: A Physics-Driven Graph Neural Network Based Model for Predicting Soft Tissue Deformation in Image-Guided Neurosurgery

abstract: Correctly capturing intraoperative brain shift in image-guided neurosurgical procedures is a critical task for aligning preoperative data with intraoperative geometry for ensuring accurate surgical navigation. While the finite element method (FEM) is a proven technique to effectively approximate soft tissue deformation through biomechanical formulations, their degree of success boils down to a trade-off between accuracy and speed. To circumvent this problem, the most recent works in this domain have proposed leveraging data-driven models obtained by training various machine learning algorithms -- e.g., random forests, artificial neural networks (ANNs) -- with the results of finite element analysis (FEA) to speed up tissue deformation approximations by prediction. These methods, however, do not account for the structure of the finite element (FE) mesh during training that provides information on node connectivities as well as the distance between them, which can aid with approximating tissue deformation based on the proximity of force load points with the rest of the mesh nodes. Therefore, this work proposes a novel framework, PhysGNN, a data-driven model that approximates the solution of the FEM by leveraging graph neural networks (GNNs), which are capable of accounting for the mesh structural information and inductive learning over unstructured grids and complex topological structures. Empirically, we demonstrate that the proposed architecture, PhysGNN, promises accurate and fast soft tissue deformation approximations, and is competitive with the state-of-the-art (SOTA) algorithms while promising enhanced computational feasibility, therefore suitable for neurosurgical settings.


title: Cross DQN: Cross Deep Q Network for Ads Allocation in Feed

abstract: E-commerce platforms usually display a mixed list of ads and organic items in feed. One key problem is to allocate the limited slots in the feed to maximize the overall revenue as well as improve user experience, which requires a good model for user preference. Instead of modeling the influence of individual items on user behaviors, the arrangement signal models the influence of the arrangement of items and may lead to a better allocation strategy. However, most of previous strategies fail to model such a signal and therefore result in suboptimal performance. In addition, the percentage of ads exposed (PAE) is an important indicator in ads allocation. Excessive PAE hurts user experience while too low PAE reduces platform revenue. Therefore, how to constrain the PAE within a certain range while keeping personalized recommendation under the PAE constraint is a challenge. In this paper, we propose Cross Deep Q Network (Cross DQN) to extract the crucial arrangement signal by crossing the embeddings of different items and modeling the crossed sequence by multi-channel attention. Besides, we propose an auxiliary loss for batch-level constraint on PAE to tackle the above-mentioned challenge. Our model results in higher revenue and better user experience than state-of-the-art baselines in offline experiments. Moreover, our model demonstrates a significant improvement in the online A/B test and has been fully deployed on Meituan feed to serve more than 300 millions of customers.


title: Applications of Reconfigurable Intelligent Surface in Smart High Speed Train Communications

abstract: Reconfigurable intelligent surface (RIS) is one of the most promising technologies for 5G-Adv and 6G. It has the characteristics of low cost, low complexity, and easy deployment, which provides a new opportunity to develop intelligent high-speed railway communications. The typical applications of RIS-assisted smart high-speed railway communications are introduced in detail, including suppressing the Doppler shift effect, solving frequent handoff problems, overcoming high penetration loss problems, and supporting high-precision train positioning. The key technologies of RIS-assisted smart high-speed railway communications are discussed in-depth, including channel measurement and modeling, channel estimation and feedback, beamforming, network architecture, and network deployment. It is believed that the combination of the new intelligent high-speed railway infrastructure and the new electromagnetic infrastructure built by RIS will bring broad industrial prospects to the intelligent high-speed railway in the future.


title: Multi-sensor Joint Adaptive Birth Sampler for Labeled Random Finite Set Tracking

abstract: This paper provides a scalable, multi-sensor measurement adaptive track initiation technique for labeled random finite set filters. A naive construction of the multi-sensor measurement adaptive birth set distribution leads to an exponential number of newborn components in the number of sensors. A truncation criterion is established for a labeled multi-Bernoulli random finite set birth density. The proposed truncation criterion is shown to have a bounded L1 error in the generalized labeled multi-Bernoulli posterior density. This criterion is used to construct a Gibbs sampler that produces a truncated measurement-generated labeled multi-Bernoulli birth distribution with quadratic complexity in the number of sensors. A closed-form solution of the conditional sampling distribution assuming linear Gaussian likelihoods is provided, alongside an approximate solution using Monte Carlo importance sampling. Multiple simulation results are provided to verify the efficacy of the truncation criterion, as well as the reduction in complexity.


title: Assessing Machine Learning Approaches to Address IoT Sensor Drift

abstract: The proliferation of IoT sensors and their deployment in various industries and applications has brought about numerous analysis opportunities in this Big Data era. However, drift of those sensor measurements poses major challenges to automate data analysis and the ability to effectively train and deploy models on a continuous basis. In this paper we study and test several approaches from the literature with regard to their ability to cope with and adapt to sensor drift under realistic conditions. Most of these approaches are recent and thus are representative of the current state-of-the-art. The testing was performed on a publicly available gas sensor dataset exhibiting drift over time. The results show substantial drops in sensing performance due to sensor drift in spite of the approaches. We then discuss several issues identified with current approaches and outline directions for future research to tackle them.


title: Rainbow-link: Beam-Alignment-Free and Grant-Free mmW Multiple Access using True-Time-Delay Array

abstract: The millimeter-wave (mmW) communications is a key enabling technology in 5G to provide ultra-high throughput. Current mmW technologies rely on analog phased arrays to realize beamforming gain and overcome high path loss. However, due to a limited number of simultaneous beams that can be created with analog/hybrid phased antenna arrays, the overheads of beam training and beam scheduling become a bottleneck for emerging networks that need to support a large number of users and low latency applications. This paper introduces rainbow-link, a novel multiple access protocol, that can achieve low latency and massive connectivity by exploiting wide bandwidth at mmW frequencies and novel analog true-time-delay array architecture with frequency dependent beamforming capability. In the proposed design, the network infrastructure is equipped with the true-time-delay array to simultaneously steer different frequency resource blocks towards distinct directions covering the entire cell sector. Users or devices, equipped with a narrowband receiver and either a single antenna or small phased antenna array, connect to the network based on their angular positions by selecting frequency resources within their rainbow beam allocation. Rainbow-link is combined with a contention-based grant-free access to eliminate the explicit beam training and user scheduling. The proposed design and analysis show that rainbow-link grant-free access is a potential candidate for latency-critical use cases within massive connectivity. Our results show that, given less than 1e-5 probability of packet loss, a rainbow-link cell, over 1 GHz bandwidth using 64 element antenna array, attains sub-millisecond user-plane latency and Mbps user rates with an approximate 400m line-of-sight coverage and a density of up to 5 active single antenna users per second per meter square.


title: Multi-dimensional graph fractional Fourier transform and its application

abstract: Many multi-dimensional signals appear in the real world, such as digital images and data that has spatial and temporal dimensions. How to show the spectrum of these multi-dimensional signals correctly is a key challenge in the field of graph signal processing. This paper investigates the novel transform for multi-dimensional signals defined on Cartesian product graph and studies several related properties. Our work includes: (i) defining the multi-dimensional graph fractional Fourier transform (MGFRFT) based on Laplacian matrix and adjacency matrix; (ii) exploring the advantages of MGFRFT in processing multi-dimensional signals in terms of spectrum and computational time; (iii) applying the proposed transform to data compression to highlight the utility and effectiveness of it.


title: Wind Turbine Gearbox Condition Based Monitoring

abstract: The main objective of this paper is finding effective gearbox condition monitoring methods by using continuously recorded monitoring SCADA (Supervisory Control and Data Accusation) data points. Typically for wind turbine gearbox condition monitoring; temperature readings, high frequency sounds and vibrations in addition to lubricant condition monitoring have been used. However, collection of such data, require shutting down equipment for installation of costly sensors and measuring lubricant quality. Meanwhile, operational data usually collected every 10 minutes, comprised of wind speed, power generated, pitch angle and similar performance parameters can be used for monitoring health of wind turbine components such as blades, gearbox and generator. This paper uses gear rotational speed for monitoring health of gearbox teeth; since gearbox teeth deterioration can be measured by monitoring rotor to generator rotation ratios over extended period of time. As nature of wind is turbulent with rapid fluctuations, a wind turbine may operate in variety of modes within relatively short period of time. Monitoring rotational speed ratio over time, requires consistent operational conditions such as wind speed and torques within the gearbox. This paper also introduces the concept of clustering such as Normal Mixture algorithm for dividing operating datasets into consistent subgroups, which are used for long term monitoring.


title: Measuring Uncertainty in Signal Fingerprinting with Gaussian Processes Going Deep

abstract: In indoor positioning, signal fluctuation is highly location-dependent. However, signal uncertainty is one critical yet commonly overlooked dimension of the radio signal to be fingerprinted. This paper reviews the commonly used Gaussian Processes (GP) for probabilistic positioning and points out the pitfall of using GP to model signal fingerprint uncertainty. This paper also proposes Deep Gaussian Processes (DGP) as a more informative alternative to address the issue. How DGP better measures uncertainty in signal fingerprinting is evaluated via simulated and realistically collected datasets.


title: MutualGraphNet: A novel model for motor imagery classification

abstract: Motor imagery classification is of great significance to humans with mobility impairments, and how to extract and utilize the effective features from motor imagery electroencephalogram(EEG) channels has always been the focus of attention. There are many different methods for the motor imagery classification, but the limited understanding on human brain requires more effective methods for extracting the features of EEG data. Graph neural networks(GNNs) have demonstrated its effectiveness in classifying graph structures; and the use of GNN provides new possibilities for brain structure connection feature extraction. In this paper we propose a novel graph neural network based on the mutual information of the raw EEG channels called MutualGraphNet. We use the mutual information as the adjacency matrix combined with the spatial temporal graph convolution network(ST-GCN) could extract the transition rules of the motor imagery electroencephalogram(EEG) channels data more effectively. Experiments are conducted on motor imagery EEG data set and we compare our model with the current state-of-the-art approaches and the results suggest that MutualGraphNet is robust enough to learn the interpretable features and outperforms the current state-of-the-art methods.


title: Characterization of the frequency response of channel-interleaved photonic ADCs based on the optical time-division demultiplexer

abstract: We characterize the frequency response of channel-interleaved photonic analog-to-digital converters (CI-PADCs) theoretically and experimentally. The CI-PADC is composed of a photonic frontend for photonic sampling and an electronic backend for quantization. The photonic frontend includes a photonic sampling pulse generator for directly high-speed sampling and an optical time-division demultiplexer (OTDM) for channel demultiplexing. It is found that the frequency response of the CI-PADC is influenced by both the photonic sampling pulses and the OTDM, of which the combined impact can be characterized through demultiplexed pulse trains. First, the frequency response can be divided into multiple frequency intervals and the range of the frequency interval equals the repetition rate of demultiplexed pulse trains. Second, the analog bandwidth of the CI-PADC is determined by the optical spectral bandwidth of demultiplexed pulse trains which is broadened in the OTDM. Further, the effect of the OTDM is essential for enlarging the analog bandwidth of the CI-PADC employing the photonic sampling pulses with a limited optical spectral bandwidth.


title: Optical Channel Aggregation by Coherent Spectral Superposition with Electro-Optic Modulators

abstract: As the bit rates of routed data streams exceed the throughput of single wavelength-division multiplexing channels, spectral traffic aggregation becomes essential for optical network scaling. Here we propose a scheme for all-optical aggregation of several low bitrate channels to fewer channels with higher spectral efficiency. The method is based on optical vector summation facilitated by coherent spectral superposition. Thereby it does not need any optical nonlinearities and is based on linear signal processing with an electro-optic modulator. Furthermore, optical phase tuning required for vector addition can be easily achieved by a phase tuning of the radio frequency signal driving the modulator. We experimentally demonstrate the aggregation of two 10 Gbaud BPSK signals into one 10 Gbaud QPSK and one 10 Gbaud PAM-4 signal, the aggregation of two 10 Gbaud QPSK signals into 10 Gbaud QAM-16, as well as the aggregation of sinc-shaped Nyquist signals. The presented concept of in-line all-optical aggregation demonstrates considerable improvement in network spectrum utilization and can significantly enhance the operational capacity with reduced complexity. It provides a new way for realizing the flexible optical transmission of advanced modulation format signals, and suits for future dynamically reconfigurable optical networks. Since the method is based on linear signal processing with electro-optic modulator, integration into any integrated photonic platform is straightforward.


title: Detection of Epileptic Seizures on EEG Signals Using ANFIS Classifier, Autoencoders and Fuzzy Entropies

abstract: Epileptic seizures are one of the most crucial neurological disorders, and their early diagnosis will help the clinicians to provide accurate treatment for the patients. The electroencephalogram (EEG) signals are widely used for epileptic seizures detection, which provides specialists with substantial information about the functioning of the brain. In this paper, a novel diagnostic procedure using fuzzy theory and deep learning techniques is introduced. The proposed method is evaluated on the Bonn University dataset with six classification combinations and also on the Freiburg dataset. The tunable-Q wavelet transform (TQWT) is employed to decompose the EEG signals into different sub-bands. In the feature extraction step, 13 different fuzzy entropies are calculated from different sub-bands of TQWT, and their computational complexities are calculated to help researchers choose the best set for various tasks. In the following, an autoencoder (AE) with six layers is employed for dimensionality reduction. Finally, the standard adaptive neuro-fuzzy inference system (ANFIS), and also its variants with grasshopper optimization algorithm (ANFIS-GOA), particle swarm optimization (ANFIS-PSO), and breeding swarm optimization (ANFIS-BS) methods are used for classification. Using our proposed method, ANFIS-BS method has obtained an accuracy of 99.74% in classifying into two classes and an accuracy of 99.46% in ternary classification on the Bonn dataset and 99.28% on the Freiburg dataset, reaching state-of-the-art performances on both of them.


title: Signal Reconstruction from Phase-only Measurements: Uniqueness Condition, Minimal Measurement Number and Beyond

abstract: This paper studies the phase-only reconstruction problem of recovering a complex-valued signal $\textbf{x}$ in $\mathbb{C}^d$ from the phase of $\textbf{Ax}$ where $\textbf{A}$ is a given measurement matrix in $\mathbb{C}^{m\times d}$. The reconstruction, if possible, should be up to a positive scaling factor. By using the rank of discriminant matrices, uniqueness conditions are derived to characterize whether the underlying signal can be uniquely reconstructed. We are also interested in the problem of minimal measurement number. We show that at least $2d$ but no more than $4d-2$ measurements are needed for the reconstruction of all $\textbf{x}\in\mathbb{C}^d$, whereas the minimal measurement number is exactly $2d-1$ if we pursue the recovery of almost all signals. Moreover, when adapted to the phase-only reconstruction of $\textbf{x}\in\mathbb{R}^d$, our uniqueness conditions are more practical and general than existing ones. Our theoretical results can be straightforwardly extended to affine phase-only reconstruction where the phase of $\textbf{Ax}+\textbf{b}$ is observed for some $\textbf{b}\in\mathbb{C}^m$.


title: A fast bow shock location predictor-estimator from 2D and 3D analytical models: Application to Mars and the MAVEN mission

abstract: We present fast algorithms to automatically estimate the statistical position of the bow shock from spacecraft data, using existing analytical two-dimensional (2D) and three-dimensional (3D) models of the shock surface. We derive expressions of the standoff distances in 2D and 3D and of the normal to the bow shock at any given point on it. Two simple bow shock detection algorithms are constructed, one solely based on a geometrical predictor from existing models, the other using this predicted position to further refine it with the help of magnetometer data, an instrument flown on many planetary missions. Both empirical techniques are applicable to any planetary environment with a defined shock structure. Applied to the Martian environment and the NASA/MAVEN mission, the predicted shock position is on average within 0.15 planetary radius $R_p$ of the bow shock crossing. Using the predictor-corrector algorithm, this estimate is further refined to within a few minutes of the true crossing $\approx$0.05 $R_p$). Between 2014 and 2021, we detect 14,929 clear bow shock crossings, predominantly quasi-perpendicular. Thanks to 2D conic and 3D quadratic fits, we investigate the variability of the shock surface with respect to Mars Years (MY), solar longitude (Ls) and solar EUV flux levels. Although asymmetry in $Y$ and $Z$ Mars Solar Orbital coordinates is on average small, we show that for MY32 and MY35, Ls = [135-225$^\circ$] and high solar flux, it can become particularly noticeable, and is superimposed to the usual North-South asymmetry due in part to the presence of crustal magnetic fields.


title: Multi-granularity Textual Adversarial Attack with Behavior Cloning

abstract: Recently, the textual adversarial attack models become increasingly popular due to their successful in estimating the robustness of NLP models. However, existing works have obvious deficiencies. (1) They usually consider only a single granularity of modification strategies (e.g. word-level or sentence-level), which is insufficient to explore the holistic textual space for generation; (2) They need to query victim models hundreds of times to make a successful attack, which is highly inefficient in practice. To address such problems, in this paper we propose MAYA, a Multi-grAnularitY Attack model to effectively generate high-quality adversarial samples with fewer queries to victim models. Furthermore, we propose a reinforcement-learning based method to train a multi-granularity attack agent through behavior cloning with the expert knowledge from our MAYA algorithm to further reduce the query times. Additionally, we also adapt the agent to attack black-box models that only output labels without confidence scores. We conduct comprehensive experiments to evaluate our attack models by attacking BiLSTM, BERT and RoBERTa in two different black-box attack settings and three benchmark datasets. Experimental results show that our models achieve overall better attacking performance and produce more fluent and grammatical adversarial samples compared to baseline models. Besides, our adversarial attack agent significantly reduces the query times in both attack settings. Our codes are released at https://github.com/Yangyi-Chen/MAYA.


title: Worbel: Aggregating Point Labels into Word Clouds

abstract: Point feature labeling is a classical problem in cartography and GIS that has been extensively studied for geospatial point data. At the same time, word clouds are a popular visualization tool to show the most important words in text data which has also been extended to visualize geospatial data (Buchin et al. PacificVis 2016). In this paper, we study a hybrid visualization, which combines aspects of word clouds and point labeling. In the considered setting, the input data consists of a set of points grouped into categories and our aim is to place multiple disjoint and axis-aligned rectangles, each representing a category, such that they cover points of (mostly) the same category under some natural quality constraints. In our visualization, we then place category names inside the computed rectangles to produce a labeling of the covered points which summarizes the predominant categories globally (in a word-cloud-like fashion) while locally avoiding excessive misrepresentation of points (i.e., retaining the precision of point labeling). We show that computing a minimum set of such rectangles is NP-hard. Hence, we turn our attention to developing heuristics and exact SAT models to compute our visualizations. We evaluate our algorithms quantitatively, measuring running time and quality of the produced solutions, on several artificial and real-world data sets. Our experiments show that the heuristics produce solutions of comparable quality to the SAT models while running much faster.


title: Tracking Turbulence Through Financial News During COVID-19

abstract: Grave human toll notwithstanding, the COVID-19 pandemic created uniquely unstable conditions in financial markets. In this work we uncover and discuss relationships involving sentiment in financial publications during the 2020 pandemic-motivated U.S. financial crash. First, we introduce a set of expert annotations of financial sentiment for articles from major American financial news publishers. After an exploratory data analysis, we then describe a CNN-based architecture to address the task of predicting financial sentiment in this anomalous, tumultuous setting. Our best performing model achieves a maximum weighted F1 score of 0.746, establishing a strong performance benchmark. Using predictions from our top performing model, we close by conducting a statistical correlation study with real stock market data, finding interesting and strong relationships between financial news and the S\&P 500 index, trading volume, market volatility, and different single-factor ETFs.


title: Protection of the Rights of Large Families as One of the Key Tasks of the State's Social Policy

abstract: The authors of the article analyze the policy of the Russian government in the field of family support, paying attention to legal programs at the federal and regional levels. The maternity capital program is considered separately, as well as measures aimed at supporting large families.


title: Analyzing cases of significant nondynamic correlation with DFT using the Atomic Populations of Effectively Localized Electrons

abstract: Multireference effects are associated with degeneracies and near-degeneracies of the ground state and are critical to a variety of systems. Most approximate functionals of density functional theory (DFT) fail to properly describe these effects. A number of diagnostics have been proposed that allow to estimate the reliability of a given single-reference solution in this respect. Some of these diagnostics however lack size-consistency, while remaining computationally expensive. In this work we use the DFT method of determining atomic populations of effectively localized electrons (APELE) as a novel diagnostic in this vein. It is compared with several existing diagnostics of nondynamic correlation on select exemplary systems. We show that the APELE method is on average in good agreement with the existing diagnostics, while being both size-consistent and less costly. It becomes particularly informative in cases involving bond stretching or bond breaking. The APELE method is applied next to organic diradicals like the bis-acridine dimer and the p-quinodimethane molecule which possess unusually high nonlinear optical response, and to the reaction of ethylene addition to Ni dithiolene, where our results shed some more light on how the oxidation state of the Ni center may change when going from the initial reactant to the product.


title: Comprehensive analysis of spherical bubble oscillations and shock wave emission in laser-induced cavitation

abstract: The dynamics of spherical laser-induced cavitation bubbles in water is investigated by plasma photography, time-resolved shadowgraphs, and single-shot probe beam scattering enabling to portray the transition from initial nonlinear to late linear oscillations. The frequency of late oscillations yields the bubble's gas content. Simulations with the Gilmore model using plasma size as input and oscillation times as fit parameter provide insights into experimentally not accessible bubble parameters and shock wave emission. The model is extended by a term covering the initial shock-driven acceleration of the bubble wall, an automated method determining shock front position and pressure decay, and an energy balance for the partitioning of absorbed laser energy into vaporization, bubble and shock wave energy, and dissipation through viscosity and condensation. These tools are used for analysing a scattering signal covering 102 oscillation cycles. The bubble was produced by a plasma with 1550 K average temperature and had 36 $\mu$m maximum radius. Predicted bubble wall velocities during expansion agree well with experimental data. Upon first collapse, most energy was stored in the compressed liquid around the bubble and then radiated away acoustically. The collapsed bubble contained more vapour than gas, and its pressure was 13.5 GPa. The pressure of the rebound shock wave initially decayed $\propto r^{-1.8}$, and energy dissipation at the shock front heated liquid near the bubble wall above the superheat limit. The shock-induced temperature rise reduces damping during late bubble oscillations. Bubble dynamics changes significantly for small bubbles with less than 10 $\mu$m radius.


title: Detection of Ionized Calcium in the Atmosphere of the Ultra-Hot Jupiter WASP-76b

abstract: Recent observations of the ultra-hot Jupiter WASP-76b have revealed a diversity of atmospheric species. Here we present new high-resolution transit spectroscopy of WASP-76b with GRACES at the Gemini North Observatory, serving as a baseline for the Large and Long Program "Exploring the Diversity of Exoplanet Atmospheres at High Spectral Resolution" (Exoplanets with Gemini Spectroscopy, or ExoGemS for short). With a broad spectral range of $400 - 1050$ nm, these observations allow us to search for a suite of atomic species. We recover absorption features due to neutral sodium (Na I), and report a new detection of the ionized calcium (Ca II) triplet at ~ $850$ nm in the atmosphere of WASP-76b, complementing a previous detection of the Ca II H & K lines. The triplet has line depths of $0.295 \pm 0.034$% at ~ $849.2$ nm, $0.574 \pm 0.041$% at ~ $854.2$ nm, and $0.454 \pm 0.024$% at ~ $866.2$ nm, corresponding to effective radii close to (but within) the planet's Roche radius. These measured line depths are significantly larger than those predicted by model LTE and NLTE spectra obtained on the basis of a pressure-temperature profile computed assuming radiative equilibrium. The discrepancy suggests that the layers probed by our observations are either significantly hotter than predicted by radiative equilibrium and/or in a hydrodynamic state. Our results shed light on the exotic atmosphere of this ultra-hot world, and will inform future analyses from the ExoGemS survey.


title: IFBiD: Inference-Free Bias Detection

abstract: This paper is the first to explore an automatic way to detect bias in deep convolutional neural networks by simply looking at their weights. Furthermore, it is also a step towards understanding neural networks and how they work. We show that it is indeed possible to know if a model is biased or not simply by looking at its weights, without the model inference for an specific input. We analyze how bias is encoded in the weights of deep networks through a toy example using the Colored MNIST database and we also provide a realistic case study in gender detection from face images using state-of-the-art methods and experimental resources. To do so, we generated two databases with 36K and 48K biased models each. In the MNIST models we were able to detect whether they presented a strong or low bias with more than 99% accuracy, and we were also able to classify between four levels of bias with more than 70% accuracy. For the face models, we achieved 90% accuracy in distinguishing between models biased towards Asian, Black, or Caucasian ethnicity.


title: Frequency shifts in the EPR spectrum of $^{39}$K due to spin-exchange collisions with polarized $^3$He and precise $^3$He polarimetry

abstract: The Zeeman splittings and EPR frequencies of alkali-metal atoms are shifted in the presence of a polarized noble gas. For a spherical geometry, the shift is enhanced over what is expected classically by a dimensionless atomic parameter $\kappa_0$ that is unique to each alkali-metal atom - noble-gas pair. We present a precise measurement of $\kappa_0$ for the $^{39}$K-$^3$He system with a relative accuracy of better than 1\%. A critical component of achieving sub-percent accuracy involved characterizing the shape of our samples using both MRI and CT medical-imaging techniques. The parameter $\kappa_0$ plays an important role in establishing the absolute polarization of $^3$He in a variety of contexts, including polarized targets for electron scattering experiments and MRI of the gas space of the lungs. Our measurement more than doubles the accuracy possible when using $\kappa_0$ for polarimetry purposes. Just as important, the work presented here represents the first {\it direct} measurement of $\kappa_0$ for the $^{39}$K-$^3$He system; previous values for $\kappa_0$ in the $^{39}$K-$^3$He system relied on a chain of measurements that were benchmarked by previous measurements of $\kappa_0$ in the Rb-$^3$He system.