title: Flow-Attention-based Spatio-Temporal Aggregation Network for 3D Mask Detection

abstract: Anti-spoofing detection has become a necessity for face recognition systems due to the security threat posed by spoofing attacks. Despite great success in traditional attacks, most deep-learning-based methods perform poorly in 3D masks, which can highly simulate real faces in appearance and structure, suffering generalizability insufficiency while focusing only on the spatial domain with single frame input. This has been mitigated by the recent introduction of a biomedical technology called rPPG (remote photoplethysmography). However, rPPG-based methods are sensitive to noisy interference and require at least one second (> 25 frames) of observation time, which induces high computational overhead. To address these challenges, we propose a novel 3D mask detection framework, called FASTEN (Flow-Attention-based Spatio-Temporal aggrEgation Network). We tailor the network for focusing more on fine-grained details in large movements, which can eliminate redundant spatio-temporal feature interference and quickly capture splicing traces of 3D masks in fewer frames. Our proposed network contains three key modules: 1) a facial optical flow network to obtain non-RGB inter-frame flow information; 2) flow attention to assign different significance to each frame; 3) spatio-temporal aggregation to aggregate high-level spatial features and temporal transition features. Through extensive experiments, FASTEN only requires five frames of input and outperforms eight competitors for both intra-dataset and cross-dataset evaluations in terms of multiple detection metrics. Moreover, FASTEN has been deployed in real-world mobile devices for practical 3D mask detection.


title: Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models

abstract: Pre-trained Language Models (PLMs) are trained on vast unlabeled data, rich in world knowledge. This fact has sparked the interest of the community in quantifying the amount of factual knowledge present in PLMs, as this explains their performance on downstream tasks, and potentially justifies their use as knowledge bases. In this work, we survey methods and datasets that are used to probe PLMs for factual knowledge. Our contributions are: (1) We propose a categorization scheme for factual probing methods that is based on how their inputs, outputs and the probed PLMs are adapted; (2) We provide an overview of the datasets used for factual probing; (3) We synthesize insights about knowledge retention and prompt optimization in PLMs, analyze obstacles to adopting PLMs as knowledge bases and outline directions for future work.


title: On the average hitting times of weighted Cayley graphs

abstract: In the present paper, we give the exact formula for the average hitting time (HT, as an abbreviation) of random walks from one vertex to any other vertex on the weighted Cayley graph Cay($Z_{2n},\{\pm1\}$). Furthermore, we also give the exact formula for the HT's of random walks on the weighted Cayley graph Cay($Z_N,\{+1,+2\}$).


title: Correctness Witness Validation by Abstract Interpretation

abstract: Witnesses record automated program analysis results and make them exchangeable. To validate correctness witnesses through abstract interpretation, we introduce a novel abstract operation unassume. This operator incorporates witness invariants into the abstract program state. Given suitable invariants, the unassume operation can accelerate fixpoint convergence and yield more precise results. We demonstrate the feasibility of this approach by augmenting an abstract interpreter with unassume operators and evaluating the impact of incorporating witnesses on performance and precision. Using manually crafted witnesses, we can confirm verification results for multi-threaded programs with a reduction in effort ranging from 7% to 47% in CPU time. More intriguingly, we discover that using witnesses from model checkers can guide our analyzer to verify program properties that it could not verify on its own.


title: Adapt Anything: Tailor Any Image Classifiers across Domains And Categories Using Text-to-Image Diffusion Models

abstract: We do not pursue a novel method in this paper, but aim to study if a modern text-to-image diffusion model can tailor any task-adaptive image classifier across domains and categories. Existing domain adaptive image classification works exploit both source and target data for domain alignment so as to transfer the knowledge learned from the labeled source data to the unlabeled target data. However, as the development of the text-to-image diffusion model, we wonder if the high-fidelity synthetic data from the text-to-image generator can serve as a surrogate of the source data in real world. In this way, we do not need to collect and annotate the source data for each domain adaptation task in a one-for-one manner. Instead, we utilize only one off-the-shelf text-to-image model to synthesize images with category labels derived from the corresponding text prompts, and then leverage the surrogate data as a bridge to transfer the knowledge embedded in the task-agnostic text-to-image generator to the task-oriented image classifier via domain adaptation. Such a one-for-all adaptation paradigm allows us to adapt anything in the world using only one text-to-image generator as well as the corresponding unlabeled target data. Extensive experiments validate the feasibility of the proposed idea, which even surpasses the state-of-the-art domain adaptation works using the source data collected and annotated in real world.


title: Large-scale magnetic field maps using structured kernel interpolation for Gaussian process regression

abstract: We present a mapping algorithm to compute large-scale magnetic field maps in indoor environments with approximate Gaussian process (GP) regression. Mapping the spatial variations in the ambient magnetic field can be used for localization algorithms in indoor areas. To compute such a map, GP regression is a suitable tool because it provides predictions of the magnetic field at new locations along with uncertainty quantification. Because full GP regression has a complexity that grows cubically with the number of data points, approximations for GPs have been extensively studied. In this paper, we build on the structured kernel interpolation (SKI) framework, speeding up inference by exploiting efficient Krylov subspace methods. More specifically, we incorporate SKI with derivatives (D-SKI) into the scalar potential model for magnetic field modeling and compute both predictive mean and covariance with a complexity that is linear in the data points. In our simulations, we show that our method achieves better accuracy than current state-of-the-art methods on magnetic field maps with a growing mapping area. In our large-scale experiments, we construct magnetic field maps from up to 40000 three-dimensional magnetic field measurements in less than two minutes on a standard laptop.


title: Microwave-free wide-field magnetometry using nitrogen-vacancy centers

abstract: A wide-field magnetometer utilizing nitrogen-vacancy (NV) centers in diamond that does not require microwaves is demonstrated. It is designed for applications where microwaves need to be avoided, such as magnetic imaging of biological or conductive samples. The system exploits a magnetically sensitive feature of NV centers near the ground state level anticrossing (GSLAC). An applied test field from a wire was mapped over an imaging area of $\approx 500 \times 470\,{\mu}\text{m}^2$. Analysis of the GSLAC lineshape allows to extract vector information of the applied field. The device allows micrometer-scale magnetic imaging at a spatial resolution dominated by the thickness of the NV layer (here $50\,{\mu}\text{m}$). For a pixel size of $4\,{\mu}\text{m} \times 3.8\,{\mu}\text{m}$ the estimated sensitivity is $4.8\,{\mu}\text{T}/\sqrt{\text{Hz}}$. Two modalities for visualizing the magnetic fields, static and temporal, are presented along with a discussion of technical limitations and future extensions of the method.


title: Topologically Nontrivial Three-Body Contact Interaction in One Dimension

abstract: It is known that three-body contact interactions in one-dimensional $n(\geq3)$-body problems of nonidentical particles can be topologically nontrivial: they are all classified by unitary irreducible representations of the pure twin group $PT_{n}$. It was, however, unknown how such interactions are described in the Hamiltonian formalism. In this paper, we study topologically nontrivial three-body contact interactions from the viewpoint of the path integral. Focusing on spinless particles, we construct an $n(n-1)(n-2)/3!$-parameter family of $n$-body Hamiltonians that corresponds to one particular one-dimensional unitary representation of $PT_{n}$. These Hamiltonians are written in terms of background Abelian gauge fields that describe infinitely-thin magnetic fluxes in the $n$-body configuration space.


title: Mapping the magnetic field using a magnetometer array with noisy input Gaussian process regression

abstract: Ferromagnetic materials in indoor environments give rise to disturbances in the ambient magnetic field. Maps of these magnetic disturbances can be used for indoor localisation. A Gaussian process can be used to learn the spatially varying magnitude of the magnetic field using magnetometer measurements and information about the position of the magnetometer. The position of the magnetometer, however, is frequently only approximately known. This negatively affects the quality of the magnetic field map. In this paper, we investigate how an array of magnetometers can be used to improve the quality of the magnetic field map. The position of the array is approximately known, but the relative locations of the magnetometers on the array are known. We include this information in a novel method to make a map of the ambient magnetic field. We study the properties of our method in simulation and show that our method improves the map quality. We also demonstrate the efficacy of our method with experimental data for the mapping of the magnetic field using an array of 30 magnetometers.


title: Accelerating the analysis of optical quantum systems using the Koopman operator

abstract: The prediction of photon echoes is a crucial technique for gaining an understanding of optical quantum systems. However, it requires a large number of simulations with varying parameters and/or input pulses, which renders numerical studies expensive. This article investigates how we can use data-driven surrogate models based on the Koopman operator to accelerate this process while maintaining accuracy over a large number of time steps. To this end, we employ a bilinear Koopman model using extended dynamic mode decomposition and simulate the optical Bloch equations for an ensemble of inhomogeneously broadened two-level systems. Such systems are well suited to describe the excitation of excitonic resonances in semiconductor nanostructures, for example, ensembles of semiconductor quantum dots. We perform a detailed study on the required number of system simulations such that the resulting data-driven Koopman model is sufficiently accurate for a wide range of parameter settings. We analyze the L2 error and the relative error of the photon echo peak and investigate how the control positions relate to the stabilization. After proper training, our methods can predict the quantum ensemble's dynamics accurately and numerically efficiently.


title: WSDMS: Debunk Fake News via Weakly Supervised Detection of Misinforming Sentences with Contextualized Social Wisdom

abstract: In recent years, we witness the explosion of false and unconfirmed information (i.e., rumors) that went viral on social media and shocked the public. Rumors can trigger versatile, mostly controversial stance expressions among social media users. Rumor verification and stance detection are different yet relevant tasks. Fake news debunking primarily focuses on determining the truthfulness of news articles, which oversimplifies the issue as fake news often combines elements of both truth and falsehood. Thus, it becomes crucial to identify specific instances of misinformation within the articles. In this research, we investigate a novel task in the field of fake news debunking, which involves detecting sentence-level misinformation. One of the major challenges in this task is the absence of a training dataset with sentence-level annotations regarding veracity. Inspired by the Multiple Instance Learning (MIL) approach, we propose a model called Weakly Supervised Detection of Misinforming Sentences (WSDMS). This model only requires bag-level labels for training but is capable of inferring both sentence-level misinformation and article-level veracity, aided by relevant social media conversations that are attentively contextualized with news sentences. We evaluate WSDMS on three real-world benchmarks and demonstrate that it outperforms existing state-of-the-art baselines in debunking fake news at both the sentence and article levels.


title: An optimally fast objective-function-free minimization algorithm using random subspaces

abstract: An algorithm for unconstrained non-convex optimization is described, which does not evaluate the objective function and in which minimization is carried out, at each iteration, within a randomly selected subspace. It is shown that this random approximation technique does not affect the method's convergence nor its evaluation complexity for the search of an $\epsilon$-approximate first-order critical point, which is $\mathcal{O}(\epsilon^{-(p+1)/p})$, where $p$ is the order of derivatives used. A variant of the algorithm using approximate Hessian matrices is also analyzed and shown to require at most $\mathcal{O}(\epsilon^{-2})$ evaluations. Preliminary numerical tests show that the random-subspace technique can significantly improve performance on some problems, albeit, unsurprisingly, not for all.


title: Hybrid Minimax-MCTS and Difficulty Adjustment for General Game Playing

abstract: Board games are a great source of entertainment for all ages, as they create a competitive and engaging environment, as well as stimulating learning and strategic thinking. It is common for digital versions of board games, as any other type of digital games, to offer the option to select the difficulty of the game. This is usually done by customizing the search parameters of the AI algorithm. However, this approach cannot be extended to General Game Playing agents, as different games might require different parametrization for each difficulty level. In this paper, we present a general approach to implement an artificial intelligence opponent with difficulty levels for zero-sum games, together with a propose of a Minimax-MCTS hybrid algorithm, which combines the minimax search process with GGP aspects of MCTS. This approach was tested in our mobile application LoBoGames, an extensible board games platform, that is intended to have an broad catalog of games, with an emphasis on accessibility: the platform is friendly to visually-impaired users, and is compatible with more than 92\% of Android devices. The tests in this work indicate that both the hybrid Minimax-MCTS and the new difficulty adjustment system are promising GGP approaches that could be expanded in future work.


title: Tailoring Personality Traits in Large Language Models via Unsupervisedly-Built Personalized Lexicons

abstract: Personality plays a pivotal role in shaping human expression patterns, thus regulating the personality of large language models (LLMs) holds significant potential in enhancing the user experience of LLMs. Previous methods either relied on fine-tuning LLMs on specific corpora or necessitated manually crafted prompts to elicit specific personalities from LLMs. However, the former approach is inefficient and costly, while the latter cannot precisely manipulate personality traits at a fine-grained level. To address the above challenges, we have employed a novel Unsupervisedly-Built Personalized Lexicons (UBPL) in a pluggable manner during the decoding phase of LLMs to manipulate their personality traits. UBPL is a lexicon built through an unsupervised approach from a situational judgment test dataset (SJTs4LLM). Users can utilize UBPL to adjust the probability vectors of predicted words in the decoding phase of LLMs, thus influencing the personality expression of LLMs. Extensive experimentation demonstrates the remarkable effectiveness and pluggability of our method for fine-grained manipulation of LLM's personality.


title: The two-body strong decays of the fully-charm tetraquark states

abstract: We study the hadronic coupling constants in the two-body strong decays of the fully-charm tetraquark states with the $J^{PC}=0^{++}$, $1^{+-}$ and $2^{++}$ via the QCD sum rules based on rigorous quark-hadron duality. Then we obtain the hadronic coupling constants and partial decay widths therefore total decay widths, which support assigning the $X(6552)$ as the first radial excitation of the scalar tetraquark state. And other predictions can be used to diagnose exotic states in the future.


title: Learning to Explain: A Model-Agnostic Framework for Explaining Black Box Models

abstract: We present Learning to Explain (LTX), a model-agnostic framework designed for providing post-hoc explanations for vision models. The LTX framework introduces an "explainer" model that generates explanation maps, highlighting the crucial regions that justify the predictions made by the model being explained. To train the explainer, we employ a two-stage process consisting of initial pretraining followed by per-instance finetuning. During both stages of training, we utilize a unique configuration where we compare the explained model's prediction for a masked input with its original prediction for the unmasked input. This approach enables the use of a novel counterfactual objective, which aims to anticipate the model's output using masked versions of the input image. Importantly, the LTX framework is not restricted to a specific model architecture and can provide explanations for both Transformer-based and convolutional models. Through our evaluations, we demonstrate that LTX significantly outperforms the current state-of-the-art in explainability across various metrics.


title: (non)-matching and (non)-periodicity for $(N,\alpha)$-expansions

abstract: Recently a new class of continued fraction algorithms, the $(N,\alpha$)-expansions, was introduced for each $N\in\mathbb{N}$, $N\geq 2$ and $\alpha \in (0,\sqrt{N}-1]$. Each of these continued fraction algorithms has only finitely many possible digits. These $(N,\alpha)$-expansions `behave' very different from many other (classical) continued fraction algorithms. In this paper we will show that when all digits in the digit set are co-prime with $N$, which occurs in specified intervals of the parameter space, something extraordinary happens. Rational numbers and certain quadratic irrationals will not have a periodic expansion. Furthermore, there are no matching intervals in these regions. This contrasts sharply with the regular continued fraction and more classical parameterised continued fraction algorithms, for which often matching is shown to hold for almost every parameter. On the other hand, for $\alpha$ small enough, all rationals have an eventually periodic expansion with period 1. This happens for all $\alpha$ when $N=2$. We also find infinitely many matching intervals for $N=2$, as well as rationals that are not contained in any matching interval.


title: Muon-induced background in a next-generation dark matter experiment based on liquid xenon

abstract: Muon-induced neutrons can lead to potentially irreducible backgrounds in rare event search experiments. We have investigated the implication of laboratory depth on the muon-induced background in a future dark matter experiment capable of reaching the so-called neutrino floor. Our simulation study focused on a xenon-based detector with 70 tonnes of active mass, surrounded by additional veto systems plus a water shield. Two locations at the Boulby Underground Laboratory (UK) were analysed as examples: an experimental cavern in salt at a depth of 2850 m w. e. (similar to the location of the existing laboratory), and a deeper laboratory located in polyhalite rock at a depth of 3575 m w. e. Our results show that no cosmogenic background events are likely to survive standard analysis cuts for 10 years of operation at either location. The largest background component we identified comes from beta-delayed neutron emission from $^{17}$N which is produced from $^{19}$F in the fluoropolymer components of the experiment. Our results confirm that a dark matter search with sensitivity to the neutrino floor is viable (from the point of view of cosmogenic backgrounds) in underground laboratories at these levels of rock overburden. This work was conducted in 2019-21 in the context of a feasibility study to investigate the possibility of developing the Boulby Underground Laboratory to host a next-generation dark matter experiment; however, our findings are also relevant for other underground laboratories.


title: Adaptive Uncertainty Estimation via High-Dimensional Testing on Latent Representations

abstract: Uncertainty estimation aims to evaluate the confidence of a trained deep neural network. However, existing uncertainty estimation approaches rely on low-dimensional distributional assumptions and thus suffer from the high dimensionality of latent features. Existing approaches tend to focus on uncertainty on discrete classification probabilities, which leads to poor generalizability to uncertainty estimation for other tasks. Moreover, most of the literature requires seeing the out-of-distribution (OOD) data in the training for better estimation of uncertainty, which limits the uncertainty estimation performance in practice because the OOD data are typically unseen. To overcome these limitations, we propose a new framework using data-adaptive high-dimensional hypothesis testing for uncertainty estimation, which leverages the statistical properties of the feature representations. Our method directly operates on latent representations and thus does not require retraining the feature encoder under a modified objective. The test statistic relaxes the feature distribution assumptions to high dimensionality, and it is more discriminative to uncertainties in the latent representations. We demonstrate that encoding features with Bayesian neural networks can enhance testing performance and lead to more accurate uncertainty estimation. We further introduce a family-wise testing procedure to determine the optimal threshold of OOD detection, which minimizes the false discovery rate (FDR). Extensive experiments validate the satisfactory performance of our framework on uncertainty estimation and task-specific prediction over a variety of competitors. The experiments on the OOD detection task also show satisfactory performance of our method when the OOD data are unseen in the training. Codes are available at https://github.com/HKU-MedAI/bnn_uncertainty.


title: Multi-Task Wavelength-Multiplexed Reservoir Computing Using a Silicon Microring Resonator

abstract: Among the promising advantages of photonic computing over conventional computing architectures is the potential to increase computing efficiency through massive parallelism by using the many degrees of freedom provided by photonics. Here, we numerically demonstrate the simultaneous use of time and frequency (equivalently wavelength) multiplexing to solve three independent tasks at the same time on the same photonic circuit. In particular, we consider a microring-based time-delay reservoir computing (TDRC) scheme that simultaneously solves three tasks: Time-series prediction, classification, and wireless channel equalization. The scheme relies on time-division multiplexing to avoid the necessity of multiple physical nonlinear nodes, while the tasks are parallelized using wavelength division multiplexing (WDM). The input data modulated on each optical channel is mapped to a higher dimensional space by the nonlinear dynamics of the silicon microring cavity. The carrier wavelength and input power assigned to each optical channel have a high influence on the performance of its respective task. When all tasks operate under the same wavelength/power conditions, our results show that the computing nature of each task is the deciding factor of the level of performance achievable. However, it is possible to achieve good performance for all tasks simultaneously by optimizing the parameters of each optical channel. The variety of applications covered by the tasks shows the versatility of the proposed photonic TDRC scheme. Overall, this work provides insight into the potential of WDM-based schemes for improving the computing capabilities of reservoir computing schemes.


title: Polarization-entangled photons from a whispering gallery resonator

abstract: Crystalline Whispering Gallery Mode Resonators (WGMRs) have been shown to facilitate versatile sources of quantum states that can efficiently interact with atomic systems. These features make WGMRs an efficient platform for quantum information processing. Here, we experimentally show that it is possible to generate polarization entanglement from WGMRs by using an interferometric scheme. Our scheme gives us the flexibility to control the phase of the generated entangled state by changing the relative phase of the interferometer. The S value of the Clauser-Horne-Shimony-Holt's inequality in the system is $2.45 \pm 0.07$, which violates the inequality by more than 6 standard deviations.


title: $\mathbb{VD}$-$\mathbb{GR}$: Boosting $\mathbb{V}$isual $\mathbb{D}$ialog with Cascaded Spatial-Temporal Multi-Modal $\mathbb{GR}$aphs

abstract: We propose $\mathbb{VD}$-$\mathbb{GR}$ - a novel visual dialog model that combines pre-trained language models (LMs) with graph neural networks (GNNs). Prior works mainly focused on one class of models at the expense of the other, thus missing out on the opportunity of combining their respective benefits. At the core of $\mathbb{VD}$-$\mathbb{GR}$ is a novel integration mechanism that alternates between spatial-temporal multi-modal GNNs and BERT layers, and that covers three distinct contributions: First, we use multi-modal GNNs to process the features of each modality (image, question, and dialog history) and exploit their local structures before performing BERT global attention. Second, we propose hub-nodes that link to all other nodes within one modality graph, allowing the model to propagate information from one GNN (modality) to the other in a cascaded manner. Third, we augment the BERT hidden states with fine-grained multi-modal GNN features before passing them to the next $\mathbb{VD}$-$\mathbb{GR}$ layer. Evaluations on VisDial v1.0, VisDial v0.9, VisDialConv, and VisPro show that $\mathbb{VD}$-$\mathbb{GR}$ achieves new state-of-the-art results across all four datasets.


title: Intrinsic Piezoelectric Anisotropy of Tetragonal ABO3 Perovskites: A High-Throughput Study

abstract: A comprehensive understand of the intrinsic piezoelectric anisotropy stemming from diverse chemical and physical factors is a key step for the rational design of highly anisotropic materials. We performed high-throughput calculations on tetragonal ABO3 perovskites to investigate the piezoelectricity and the interplay between lattice, displacement, polarization and elasticity. Among the 123 types of perovskites, the structural tetragonality is naturally divided into two categories: normal tetragonal (c/a ratio < 1.1) and super-tetragonal (c/a ratio > 1.17), exhibiting distinct ferroelectric, elastic, and piezoelectric properties. Charge analysis revealed the mechanisms underlying polarization saturation and piezoelectricity suppression in the super-tetragonal region, which also produces an inherent contradiction between high d33 and large piezoelectric anisotropy ratio |d33/d31|. The polarization axis and elastic softness direction jointly determine the maximum longitudinal piezoelectric response d33 direction. The validity and deficiencies of the widely utilized |d33/d31| ratio for representing piezoelectric anisotropy were reevaluated.


title: Over-the-air Federated Policy Gradient

abstract: In recent years, over-the-air aggregation has been widely considered in large-scale distributed learning, optimization, and sensing. In this paper, we propose the over-the-air federated policy gradient algorithm, where all agents simultaneously broadcast an analog signal carrying local information to a common wireless channel, and a central controller uses the received aggregated waveform to update the policy parameters. We investigate the effect of noise and channel distortion on the convergence of the proposed algorithm, and establish the complexities of communication and sampling for finding an $\epsilon$-approximate stationary point. Finally, we present some simulation results to show the effectiveness of the algorithm.


title: Undecay

abstract: Unstable particles decay sooner or later, so they are not described by asymptotic one-particle states and they should not be included as independent states in unitarity relations such as the optical theorem. The same applies to any countable collection of unstable particles. We show that the behaviour of unparticle stuff, that is, a continuous collection of particles with different masses and common decay channels, is pretty different: it has a non-vanishing probability of surviving for ever and the corresponding asymptotic states must be taken into account to comply with unitarity. We also discuss compressed spectra and the transition from the discrete to the continuous case.


title: Constraining the slow-diffusion zone size and electron injection spectral index for the Geminga pulsar halo

abstract: Measuring the electron diffusion coefficient is the most straightforward task in the study of gamma-ray pulsar halos. The updated measurements of the spatial morphology and spectrum of the Geminga halo by the High-Altitude Water Cherenkov (HAWC) experiment enable us to constrain parameters beyond the diffusion coefficient, including the size of the slow-diffusion zone and the electron injection spectrum from the pulsar wind nebulae (PWNe). Based on the two-zone diffusion model, we find that the slow-diffusion zone size ($r_*$) around Geminga is within the range of $30-70$~pc. The lower boundary of this range is determined by the goodness of fit of the model to the one-dimensional morphology of the Geminga halo. The upper limit is derived from fitting the gamma-ray spectrum of the Geminga halo, along with the expectations for the power-law index of the injection spectrum based on simulations and PWNe observations, i.e., $p\gtrsim1$. With $r_*$ set at its lower limit of $30$~pc, we obtain the maximum $p$ permitted by the HAWC spectrum measurement, with an upper limit of $2.17$ at a $3\sigma$ significance. Moreover, we find that when $r_*=30$~pc and $p=2.17$, the predicted positron spectrum generated by Geminga at Earth coincides with the AMS-02 measurement in the $50-500$~GeV range.


title: Encoding impredicative hierarchy of type universes with variables

abstract: Logical frameworks can be used to translate proofs from a proof system to another one. For this purpose, we should be able to encode the theory of the proof system in the logical framework. The Lambda Pi calculus modulo theory is one of these logical frameworks. Powerful theories such as pure type systems with an infinite hierarchy of universes have been encoded, leading to partial encodings of proof systems such as Coq, Matita or Agda. In order to fully represent systems such as Coq and Lean, we introduce a representation of an infinite universe hierarchy with an impredicative universe and universe variables where universe equivalence is equality, and implement it as a terminating and confluent rewrite system.


title: Intense anomalous high harmonics in graphene quantum dots caused by disorder or vacancies

abstract: This article aims to study the linear and nonlinear optical response of inversion symmetric graphene quantum dots (GQDs) in the presence of on-site disorder or vacancies. The presence of disorder or vacancy breaks the special inversion symmetry leading to the emergence of intense Hall-type anomalous harmonics. This phenomenon is attributed to the intrinsic time-reversal symmetry-breaking in quantum dots with a pseudo-relativistic Hamiltonian, even in the absence of an external magnetic field. We demonstrate that the effects induced by disorder or vacancy have a distinct impact on the optical response of GQDs. In the linear response, we observe significant Hall conductivity. In the presence of an intense laser field, we observe the radiation of strong anomalous odd and even-order harmonics already for relatively small levels of disorder or mono-vacancy. The both disorder and vacancy lift the degeneracy of states, thereby creating new channels for interband transitions and enhancing the emission of near-cutoff high-harmonic signals.


title: Beyond IID weights: sparse and low-rank deep Neural Networks are also Gaussian Processes

abstract: The infinitely wide neural network has been proven a useful and manageable mathematical model that enables the understanding of many phenomena appearing in deep learning. One example is the convergence of random deep networks to Gaussian processes that allows a rigorous analysis of the way the choice of activation function and network weights impacts the training dynamics. In this paper, we extend the seminal proof of Matthews et al. (2018) to a larger class of initial weight distributions (which we call PSEUDO-IID), including the established cases of IID and orthogonal weights, as well as the emerging low-rank and structured sparse settings celebrated for their computational speed-up benefits. We show that fully-connected and convolutional networks initialized with PSEUDO-IID distributions are all effectively equivalent up to their variance. Using our results, one can identify the Edge-of-Chaos for a broader class of neural networks and tune them at criticality in order to enhance their training. Moreover, they enable the posterior distribution of Bayesian Neural Networks to be tractable across these various initialization schemes.


title: Breakdown of Temporal Coherence in Photon Condensates

abstract: The temporal coherence of an ideal Bose gas increases as the system approaches the Bose-Einstein condensation threshold from below, with coherence time diverging at the critical point. However, counter-examples have been observed for condensates of photons formed in an externally pumped, dye-filled microcavity, wherein the coherence time decreases rapidly for increasing particle number above threshold. This paper establishes intermode correlations as the central explanation for the experimentally observed dramatic decrease in the coherence time beyond critical pump power.


title: On the vanishing of Ext modules over a local unique factorization domain with an isolated singularity

abstract: This paper provides a method to get a noetherian equicharacteristic local UFD with an isolated singularity from a given noetherian complete equicharacteristic local ring, preserving certain properties. This is applied to invesitgate the (non)vanishing of Ext modules. It is proved that there exist a Gorenstein local UFD $A$ having an isolated singularity such that $\operatorname{Ext}_A^{\gg0}(M,N)=0$ does not imply $\operatorname{Ext}_A^{\gg0}(N,M)=0$, a Gorenstein local UFD $B$ having an isolated singularity such that $\operatorname{Tor}_{>0}^B(M,N)=0$ does not imply $\operatorname{depth}(M\otimes_B N)=\operatorname{depth} M+\operatorname{depth} N-\operatorname{depth} B$, and a Cohen-Macaulay local UFD $C$ having an isolated singularity such that $\operatorname{Ext}_C^{>0}(M,C)=0$ does not imply the total reflexivity of $M$.


title: Balancing central and marginal rejection when combining independent significance tests

abstract: A common approach to evaluating the significance of a collection of $p$-values combines them with a pooling function, in particular when the original data are not available. These pooled $p$-values convert a sample of $p$-values into a single number which behaves like a univariate $p$-value. To clarify discussion of these functions, a telescoping series of alternative hypotheses are introduced that communicate the strength and prevalence of non-null evidence in the $p$-values before general pooling formulae are discussed. A pattern noticed in the UMP pooled $p$-value for a particular alternative motivates the definition and discussion of central and marginal rejection levels at $\alpha$. It is proven that central rejection is always greater than or equal to marginal rejection, motivating a quotient to measure the balance between the two for pooled $p$-values. A combining function based on the $\chi^2_{\kappa}$ quantile transformation is proposed to control this quotient and shown to be robust to mis-specified parameters relative to the UMP. Different powers for different parameter settings motivate a map of plausible alternatives based on where this pooled $p$-value is minimized.


title: Pilot-Based Uplink Power Control in Single-UE Massive MIMO Systems With 1-Bit ADCs

abstract: We propose uplink power control (PC) methods for massive multiple-input multiple-output systems with 1-bit analog-to-digital converters, which are specifically tailored to address the non-monotonic data detection performance with respect to the transmit power of the user equipment (UE). Considering a single UE, we design a multi-amplitude pilot sequence to capture the aforementioned non-monotonicity, which is utilized at the base station to derive UE transmit power adjustments via single-shot or differential power control (DPC) techniques. Both methods enable closed-loop uplink PC using different feedback approaches. The single-shot method employs one-time multi-bit feedback, while the DPC method relies on continuous adjustments with 1-bit feedback. Numerical results demonstrate the superiority of the proposed schemes over conventional closed-loop uplink PC techniques.


title: Parcel loss prediction in last-mile delivery: deep and non-deep approaches with insights from Explainable AI

abstract: Within the domain of e-commerce retail, an important objective is the reduction of parcel loss during the last-mile delivery phase. The ever-increasing availability of data, including product, customer, and order information, has made it possible for the application of machine learning in parcel loss prediction. However, a significant challenge arises from the inherent imbalance in the data, i.e., only a very low percentage of parcels are lost. In this paper, we propose two machine learning approaches, namely, Data Balance with Supervised Learning (DBSL) and Deep Hybrid Ensemble Learning (DHEL), to accurately predict parcel loss. The practical implication of such predictions is their value in aiding e-commerce retailers in optimizing insurance-related decision-making policies. We conduct a comprehensive evaluation of the proposed machine learning models using one year data from Belgian shipments. The findings show that the DHEL model, which combines a feed-forward autoencoder with a random forest, achieves the highest classification performance. Furthermore, we use the techniques from Explainable AI (XAI) to illustrate how prediction models can be used in enhancing business processes and augmenting the overall value proposition for e-commerce retailers in the last mile delivery.


title: Certifying Bimanual RRT Motion Plans in a Second

abstract: We present an efficient method for certifying non-collision for piecewise-polynomial motion plans in algebraic reparametrizations of configuration space. Such motion plans include those generated by popular randomized methods including RRTs and PRMs, as well as those generated by many methods in trajectory optimization. Based on Sums-of-Squares optimization, our method provides exact, rigorous certificates of non-collision; it can never falsely claim that a motion plan containing collisions is collision-free. We demonstrate that our formulation is practical for real world deployment, certifying the safety of a twelve degree of freedom motion plan in just over a second. Moreover, the method is capable of discriminating the safety or lack thereof of two motion plans which differ by only millimeters.


title: Photon-photon correlation of condensed light in a microcavity

abstract: The study of temporal coherence in a Bose-Einstein condensate of photons can be challenging, especially in the presence of correlations between the photonic modes. In this work, we use a microscopic, multimode model of photonic condensation inside a dye-filled microcavity and the quantum regression theorem, to derive an analytical expression for the equation of motion of the photon-photon correlation function. This allows us to derive the coherence time of the photonic modes and identify a nonmonotonic dependence of the temporal coherence of the condensed light with the cutoff frequency of the microcavity.


title: WebDRO: A Web-based Group-level Clustering and Reweighting Method for Unsupervised Dense Retrieval

abstract: The anchor-document data derived from web graphs offers a wealth of paired information for training dense retrieval models in an unsupervised manner. However, the presence of inherent noise invariably compromises the robustness of training dense retrieval models, consequently hurting the performance. In this paper, we introduce WebDRO, an efficient approach for clustering the web graph data and optimizing group weights to enhance the robustness of the pretraining process of dense retrieval models on web graphs. Initially, we build an embedding model for clustering anchor-document pairs. Specifically, we contrastively train the embedding model for link prediction, which guides the embedding model in capturing the inherent document features behind the web graph links. Subsequently, we employ the group distributional robust optimization to recalibrate the weights across different clusters of anchor-document pairs during training dense retrieval models, directing the model to assign higher weights to clusters with higher loss and focus more on worst-case scenarios. Our experiments conducted on MS MARCO and BEIR demonstrate that our method can effectively improve retrieval performance in unsupervised training settings. Further analysis confirms the stability and validity of group weights learned by WebDRO. All codes will be released via GitHub.


title: AirFL-Mem: Improving Communication-Learning Trade-Off by Long-Term Memory

abstract: Addressing the communication bottleneck inherent in federated learning (FL), over-the-air FL (AirFL) has emerged as a promising solution, which is, however, hampered by deep fading conditions. In this paper, we propose AirFL-Mem, a novel scheme designed to mitigate the impact of deep fading by implementing a \emph{long-term} memory mechanism. Convergence bounds are provided that account for long-term memory, as well as for existing AirFL variants with short-term memory, for general non-convex objectives. The theory demonstrates that AirFL-Mem exhibits the same convergence rate of federated averaging (FedAvg) with ideal communication, while the performance of existing schemes is generally limited by error floors. The theoretical results are also leveraged to propose a novel convex optimization strategy for the truncation threshold used for power control in the presence of Rayleigh fading channels. Experimental results validate the analysis, confirming the advantages of a long-term memory mechanism for the mitigation of deep fading.


title: On the Interplay between Fairness and Explainability

abstract: In order to build reliable and trustworthy NLP applications, models need to be both fair across different demographics and explainable. Usually these two objectives, fairness and explainability, are optimized and/or examined independently of each other. Instead, we argue that forthcoming, trustworthy NLP systems should consider both. In this work, we perform a first study to understand how they influence each other: do fair(er) models rely on more plausible rationales? and vice versa. To this end, we conduct experiments on two English multi-class text classification datasets, BIOS and ECtHR, that provide information on gender and nationality, respectively, as well as human-annotated rationales. We fine-tune pre-trained language models with several methods for (i) bias mitigation, which aims to improve fairness; (ii) rationale extraction, which aims to produce plausible explanations. We find that bias mitigation algorithms do not always lead to fairer models. Moreover, we discover that empirical fairness and explainability are orthogonal.


title: Performative Prediction: Past and Future

abstract: Predictions in the social world generally influence the target of prediction, a phenomenon known as performativity. Self-fulfilling and self-negating predictions are examples of performativity. Of fundamental importance to economics, finance, and the social sciences, the notion has been absent from the development of machine learning. In machine learning applications, performativity often surfaces as distribution shift. A predictive model deployed on a digital platform, for example, influences consumption and thereby changes the data-generating distribution. We survey the recently founded area of performative prediction that provides a definition and conceptual framework to study performativity in machine learning. A consequence of performative prediction is a natural equilibrium notion that gives rise to new optimization challenges. Another consequence is a distinction between learning and steering, two mechanisms at play in performative prediction. The notion of steering is in turn intimately related to questions of power in digital markets. We review the notion of performative power that gives an answer to the question how much a platform can steer participants through its predictions. We end on a discussion of future directions, such as the role that performativity plays in contesting algorithmic systems.


title: Back Transcription as a Method for Evaluating Robustness of Natural Language Understanding Models to Speech Recognition Errors

abstract: In a spoken dialogue system, an NLU model is preceded by a speech recognition system that can deteriorate the performance of natural language understanding. This paper proposes a method for investigating the impact of speech recognition errors on the performance of natural language understanding models. The proposed method combines the back transcription procedure with a fine-grained technique for categorizing the errors that affect the performance of NLU models. The method relies on the usage of synthesized speech for NLU evaluation. We show that the use of synthesized speech in place of audio recording does not change the outcomes of the presented technique in a significant way.


title: Consensus-Based Optimization with Truncated Noise

abstract: Consensus-based optimization (CBO) is a versatile multi-particle metaheuristic optimization method suitable for performing nonconvex and nonsmooth global optimizations in high dimensions. It has proven effective in various applications while at the same time being amenable to a theoretical convergence analysis. In this paper, we explore a variant of CBO, which incorporates truncated noise in order to enhance the well-behavedness of the statistics of the law of the dynamics. By introducing this additional truncation in the noise term of the CBO dynamics, we achieve that, in contrast to the original version, higher moments of the law of the particle system can be effectively bounded. As a result, our proposed variant exhibits enhanced convergence performance, allowing in particular for wider flexibility in choosing the noise parameter of the method as we confirm experimentally. By analyzing the time-evolution of the Wasserstein-$2$ distance between the empirical measure of the interacting particle system and the global minimizer of the objective function, we rigorously prove convergence in expectation of the proposed CBO variant requiring only minimal assumptions on the objective function and on the initialization. Numerical evidences demonstrate the benefit of truncating the noise in CBO.


title: Comparative clustering analysis of Ca II 854.2 nm spectral profiles from simulations and observations

abstract: We aim to compare and contrast the typical shapes of synthetic Ca II 854.2 nm spectra found in Bifrost simulations having different magnetic activity with the spectral shapes found in a quiet Sun observation from the Swedish 1-m Solar Telescope (SST). We use clustering techniques to extract the typical Ca II 854.2 nm profile shapes synthesized from Bifrost simulations with varying amounts of magnetic activity. We degrade the synthetic profiles to observational conditions and repeat the clustering, and we compare our synthetic results with actual observations. While the mean spectra for our high resolution simulations compare reasonably well with the observations, we find that there are considerable differences between the clusters of observed and synthetic intensity profiles, even after the synthetic profiles have been degraded. The typical absorption profiles from the simulations are both narrower and display a steeper transition from the inner wings to the line core. Furthermore, even in our most quiescent simulation we find a far larger fraction of profiles with local emission around the core, or other exotic profile shapes, than in the observations. Looking into the atmospheric structure for a selected set of synthetic clusters, we find distinct differences in the temperature stratification for the clusters most and least similar to the observations. The narrow and steep profiles are associated with either weak gradients in temperature, or temperatures rising to a local maximum in the line wing forming region before sinking to a minimum in the line core forming region. The profiles that display less steep transitions show extended temperature gradients that are steeper in the range $-3 \lesssim \log \tau_{5000} \lesssim -1$.


title: Strong decays of the $\phi(2170)$ as a fully-strange tetraquark state

abstract: We study strong decays of the $\phi(2170)$, along with its possible partner $X(2436)$, as two fully-strange tetraquark states of $J^{PC} = 1^{--}$. We consider seven decay channels: $\phi \eta$, $\phi \eta^\prime$, $\phi f_0(980)$, $\phi f_1(1420)$, $h_1(1415) \eta$, $h_1(1415) \eta^\prime$, and $h_1(1415) f_1(1420)$. Some of these channels are kinematically possible, and we calculate their relative branching ratios through the Fierz rearrangement. Future experimental measurements on these ratios can be useful in determining the nature of the $\phi(2170)$ and $X(2436)$. The $\phi(2170)$ has been observed in the $\phi f_0(980)$, $\phi \eta$, and $\phi \eta^\prime$ channels, and we propose to further examine it in the $h_1(1415) \eta$ channel. Evidences of the $X(2436)$ have been observed in the $\phi f_0(980)$ channel, and we propose to verify whether this structure exists or not in the $\phi \eta$, $\phi \eta^\prime$, $h_1(1415) \eta$, and $h_1(1415) \eta^\prime$ channels.


title: On the Proactive Generation of Unsafe Images From Text-To-Image Models Using Benign Prompts

abstract: Text-to-image models like Stable Diffusion have had a profound impact on daily life by enabling the generation of photorealistic images from textual prompts, fostering creativity, and enhancing visual experiences across various applications. However, these models also pose risks. Previous studies have successfully demonstrated that manipulated prompts can elicit text-to-image models to generate unsafe images, e.g., hateful meme variants. Yet, these studies only unleash the harmful power of text-to-image models in a passive manner. In this work, we focus on the proactive generation of unsafe images using targeted benign prompts via poisoning attacks. We propose two poisoning attacks: a basic attack and a utility-preserving attack. We qualitatively and quantitatively evaluate the proposed attacks using four representative hateful memes and multiple query prompts. Experimental results indicate that text-to-image models are vulnerable to the basic attack even with five poisoning samples. However, the poisoning effect can inadvertently spread to non-targeted prompts, leading to undesirable side effects. Root cause analysis identifies conceptual similarity as an important contributing factor to the side effects. To address this, we introduce the utility-preserving attack as a viable mitigation strategy to maintain the attack stealthiness, while ensuring decent attack performance. Our findings underscore the potential risks of adopting text-to-image models in real-world scenarios, calling for future research and safety measures in this space.


title: Enlarged super-$\mathfrak{bms}_{3}$ algebra and its flat limit

abstract: In this paper we analyze the asymptotic symmetries of the three-dimensional Chern-Simons supergravity for a supersymmetric extension of the semi-simple enlargement of the Poincar\'e algebra, also known as AdS-Lorentz superalgebra, which is characterized by two fermionic generators. We propose a consistent set of asymptotic boundary conditions for the aforementioned supergravity theory, and we show that the corresponding charge algebra defines a supersymmetric extension of the semi-simple enlargement of the $\mathfrak{bms}_{3}$ algebra, with three independent central charges. This asymptotic symmetry algebra can alternatively be written as the direct sum of three copies of the Virasoro algebra, two of which are augmented by supersymmetry. Interestingly, we show that the flat limit of the obtained asymptotic algebra corresponds to a deformed super-$\mathfrak{bms}_{3}$ algebra, being the charge algebra of the minimal Maxwell supergravity theory in three dimensions.


title: Acoustic Monitoring of Inelastic Compaction in Porous Granular Materials

abstract: We study the transition from cohesive to noncohesive granular states of synthetic rocks under oedometric loading, combining simultaneous measurements of ultrasound velocity and acoustic emissions. Our samples are agglomerates made of glass beads bonded with a few percent of cement, either ductile or brittle. These cemented granular samples exhibit an inelastic compaction beyond certain axial stresses likely due to the formation of compaction bands, which is accompanied by a significant decrease of compressional wave velocity. Upon subsequent cyclic unloading and reloading with constant consolidation stress, we found the mechanical and acoustic responses similar to those in noncohesive granular materials, which can be interpreted within the effective medium theory based on the Digby bonding model. Moreover, this model allows P-wave velocity measured at vanishing pressure to be interpreted as an indicator of the debonding on the scale of grain contact. During the inelastic compaction, stick-slip like stress drops were observed in brittle cement-bonded granular samples accompanied by the instantaneous decrease of the P-wave velocity and acoustic emissions which display an Omori-like law for foreshocks, i.e., precursors. By contrast, mechanical responses of ductile cement-bonded granular samples are smooth (without visible stick-slip like stress drops) and mostly aseismic. By applying a cyclic loading and unloading with increasing consolidation stress, we observed a Kaiser-like memory effect in the brittle cement-bonded sample in the weakly damaged state which tends to disappear when the bonds are mostly broken in the non-cohesive granular state after large-amplitude loading. Our study shows that the macroscopic ductile and brittle behavior of cemented granular media is controlled by the local processes on the scale of the bonds between grains.


title: Context Does Matter: End-to-end Panoptic Narrative Grounding with Deformable Attention Refined Matching Network

abstract: Panoramic Narrative Grounding (PNG) is an emerging visual grounding task that aims to segment visual objects in images based on dense narrative captions. The current state-of-the-art methods first refine the representation of phrase by aggregating the most similar $k$ image pixels, and then match the refined text representations with the pixels of the image feature map to generate segmentation results. However, simply aggregating sampled image features ignores the contextual information, which can lead to phrase-to-pixel mis-match. In this paper, we propose a novel learning framework called Deformable Attention Refined Matching Network (DRMN), whose main idea is to bring deformable attention in the iterative process of feature learning to incorporate essential context information of different scales of pixels. DRMN iteratively re-encodes pixels with the deformable attention network after updating the feature representation of the top-$k$ most similar pixels. As such, DRMN can lead to accurate yet discriminative pixel representations, purify the top-$k$ most similar pixels, and consequently alleviate the phrase-to-pixel mis-match substantially.Experimental results show that our novel design significantly improves the matching results between text phrases and image pixels. Concretely, DRMN achieves new state-of-the-art performance on the PNG benchmark with an average recall improvement 3.5%. The codes are available in: https://github.com/JaMesLiMers/DRMN.


title: Quantum Time: a novel resource for quantum information

abstract: Time in relativity theory has a status different from that adopted by standard quantum mechanics, where time is considered as a parameter measured with reference to an external absolute Newtonian frame. This status strongly restricts its role in the dynamics of systems and hinders any formulation to merge quantum mechanics with general relativity, specifically when considering quantum gravity. To overcome those limitations, several authors tried to construct an operator which is conjugate to the Hamiltonian of quantum systems implementing some essential features of the relativistic time. These formulations use the concept of internal or intrinsic time instead of the universal coordinate time used in textbooks. Furthermore, recently it is remarked that the consideration of time with relativistic features could enhance the analysis techniques in quantum information processing and have an impact on its status in causal orders and causal structures of quantum information. The role of clocks, their accuracy and stability has become an important issue in quantum information processing. This article present a substantiative review of recent works which reflect the possibility of utilizing quantum time, measured by quantum clock devised according to Page-Wootters scheme, to stand as a resource for quantum information processing.


title: Real-time 6-DoF Pose Estimation by an Event-based Camera using Active LED Markers

abstract: Real-time applications for autonomous operations depend largely on fast and robust vision-based localization systems. Since image processing tasks require processing large amounts of data, the computational resources often limit the performance of other processes. To overcome this limitation, traditional marker-based localization systems are widely used since they are easy to integrate and achieve reliable accuracy. However, classical marker-based localization systems significantly depend on standard cameras with low frame rates, which often lack accuracy due to motion blur. In contrast, event-based cameras provide high temporal resolution and a high dynamic range, which can be utilized for fast localization tasks, even under challenging visual conditions. This paper proposes a simple but effective event-based pose estimation system using active LED markers (ALM) for fast and accurate pose estimation. The proposed algorithm is able to operate in real time with a latency below \SI{0.5}{\milli\second} while maintaining output rates of \SI{3}{\kilo \hertz}. Experimental results in static and dynamic scenarios are presented to demonstrate the performance of the proposed approach in terms of computational speed and absolute accuracy, using the OptiTrack system as the basis for measurement.


title: Study of the fastest classical nova, V1674 Her: Photoionization and Morpho-kinemetic model analysis

abstract: We present the results of the investigation of the nova V1674 Her (2021), recognised as the swiftest classical nova, with $t_2 \sim 0.90$ days. The distance to the nova is estimated to be 4.97 kpc. The mass and radius of the WD are calculated to be $\sim~1.36~M_\odot$ and $\sim 0.15~R_\oplus$, respectively. Over the course of one month following the outburst, V1674 Her traversed distinct phases -- pre-maxima, early decline, nebular, and coronal -- displaying a remarkably swift transformation. The nebular lines emerged on day 10.00, making it the classical nova with the earliest observed commencement to date. We modelled the observed optical spectrum using the photoionization code \textsc{cloudy}. From the best-fitting model we deduced different physical and chemical parameters associated withe the system. The temperature and luminosity of the central ionizing sources are found in the range of $1.99 - 2.34~\times 10^5$ K and $1.26 - 3.16~ \times 10^{38}$ \ergs, respectively. Elements such as He, O, N, and Ne are found to be overabundant compared to solar abundance in both the nebular and coronal phases. According to the model, Fe II abundance diminishes while Ne abundance increases, potentially elucidating the rare hybrid transition between Fe and He/N nova classes. The ejected mass across all epochs spanned from $3.42 - 7.04~ \times 10^{-5}~M_\odot$. Morpho-kinematic modelling utilising \textsc{shape} revealed that the nova V1674 Her possesses a bipolar structure with an equatorial ring at the centre and an inclination angle of i = 67$\pm$ 1.5$^{\circ}$.


title: SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence

abstract: Spiking neural networks (SNNs) aim to realize brain-inspired intelligence on neuromorphic chips with high energy efficiency by introducing neural dynamics and spike properties. As the emerging spiking deep learning paradigm attracts increasing interest, traditional programming frameworks cannot meet the demands of the automatic differentiation, parallel computation acceleration, and high integration of processing neuromorphic datasets and deployment. In this work, we present the SpikingJelly framework to address the aforementioned dilemma. We contribute a full-stack toolkit for pre-processing neuromorphic datasets, building deep SNNs, optimizing their parameters, and deploying SNNs on neuromorphic chips. Compared to existing methods, the training of deep SNNs can be accelerated $11\times$, and the superior extensibility and flexibility of SpikingJelly enable users to accelerate custom models at low costs through multilevel inheritance and semiautomatic code generation. SpikingJelly paves the way for synthesizing truly energy-efficient SNN-based machine intelligence systems, which will enrich the ecology of neuromorphic computing.


title: ArTST: Arabic Text and Speech Transformer

abstract: We present ArTST, a pre-trained Arabic text and speech transformer for supporting open-source speech technologies for the Arabic language. The model architecture follows the unified-modal framework, SpeechT5, that was recently released for English, and is focused on Modern Standard Arabic (MSA), with plans to extend the model for dialectal and code-switched Arabic in future editions. We pre-trained the model from scratch on MSA speech and text data, and fine-tuned it for the following tasks: Automatic Speech Recognition (ASR), Text-To-Speech synthesis (TTS), and spoken dialect identification. In our experiments comparing ArTST with SpeechT5, as well as with previously reported results in these tasks, ArTST performs on a par with or exceeding the current state-of-the-art in all three tasks. Moreover, we find that our pre-training is conducive for generalization, which is particularly evident in the low-resource TTS task. The pre-trained model as well as the fine-tuned ASR and TTS models are released for research use.


title: Comparison with model-independent and dependent analyses for pion charge radius

abstract: Traditionally, there has been a method to extract the charge radius of a hadron based on the fits of its form factor with some model assumptions. In contrast, a completely different method has been proposed, which does not depend on the models. In this report, we explore several improvements to this model-independent method for analyzing the pion charge radius. Furthermore, we compare the results of the pion charge radius obtained from $N_{f}=2+1$ lattice QCD data at $m_{\pi}=0.51$ GeV using the three different methods: the traditional model-dependent method, the original model-independent method, and our improved model-independent method. In this comparison, we take into account systematic errors estimated in each analysis.


title: Polar Kerr Effect in Multiband Spin-Orbit Coupled Superconductors

abstract: We undertake a theoretical analysis to probe the Kerr spectrum within the superconducting phase of strontium ruthenate, where the Kerr rotation experiments demonstrate the existence of a superconducting state with broken time reversal symmetry. We find that spin-orbit coupling changes the hybridization along the Fermi surface's diagonal zone mainly affects Hall transport. We show that the dominant Hall response arises mainly from the quasi-1D orbitals $d_{yz}$ and $d_{xz}$, linked to their hybridization, while other contributions are negligible. This establishes that, the breaking of time reversal symmetry of quasi-1D orbitals can account for the existence of the Kerr angle, irrespective of the order symmetry specific to the $d_{xy}$ orbital. Moreover, the optical Hall conductivity and Kerr angle estimated for the hypothesised superconducting orders also closely match the experimental findings, providing important novel insight on the role of the spin-orbit coupling, hybridization, and emergent order.


title: Free-form Flows: Make Any Architecture a Normalizing Flow

abstract: Normalizing Flows are generative models that directly maximize the likelihood. Previously, the design of normalizing flows was largely constrained by the need for analytical invertibility. We overcome this constraint by a training procedure that uses an efficient estimator for the gradient of the change of variables formula. This enables any dimension-preserving neural network to serve as a generative model through maximum likelihood training. Our approach allows placing the emphasis on tailoring inductive biases precisely to the task at hand. Specifically, we achieve excellent results in molecule generation benchmarks utilizing $E(n)$-equivariant networks. Moreover, our method is competitive in an inverse problem benchmark, while employing off-the-shelf ResNet architectures.


title: Power Optimization in Satellite Communication Using Multi-Intelligent Reflecting Surfaces

abstract: This study introduces two innovative methodologies aimed at augmenting energy efficiency in satellite-to-ground communication systems through the integration of multiple Reflective Intelligent Surfaces (RISs). The primary objective of these methodologies is to optimize overall energy efficiency under two distinct scenarios. In the first scenario, denoted as Ideal Environment (IE), we enhance energy efficiency by decomposing the problem into two sub-optimal tasks. The initial task concentrates on maximizing power reception by precisely adjusting the phase shift of each RIS element, followed by the implementation of Selective Diversity to identify the RIS element delivering maximal power. The second task entails minimizing power consumption, formulated as a binary linear programming problem, and addressed using the Binary Particle Swarm Optimization (BPSO) technique. The IE scenario presupposes an environment where signals propagate without any path loss, serving as a foundational benchmark for theoretical evaluations that elucidate the systems optimal capabilities. Conversely, the second scenario, termed Non-Ideal Environment (NIE), is designed for situations where signal transmission is subject to path loss. Within this framework, the Adam algorithm is utilized to optimize energy efficiency. This non ideal setting provides a pragmatic assessment of the systems capabilities under conventional operational conditions. Both scenarios emphasize the potential energy savings achievable by the satellite RIS system. Empirical simulations further corroborate the robustness and effectiveness of our approach, highlighting its potential to enhance energy efficiency in satellite-to-ground communication systems.


title: Scalable Causal Structure Learning via Amortized Conditional Independence Testing

abstract: Controlling false positives (Type I errors) through statistical hypothesis testing is a foundation of modern scientific data analysis. Existing causal structure discovery algorithms either do not provide Type I error control or cannot scale to the size of modern scientific datasets. We consider a variant of the causal discovery problem with two sets of nodes, where the only edges of interest form a bipartite causal subgraph between the sets. We develop Scalable Causal Structure Learning (SCSL), a method for causal structure discovery on bipartite subgraphs that provides Type I error control. SCSL recasts the discovery problem as a simultaneous hypothesis testing problem and uses discrete optimization over the set of possible confounders to obtain an upper bound on the test statistic for each edge. Semi-synthetic simulations demonstrate that SCSL scales to handle graphs with hundreds of nodes while maintaining error control and good power. We demonstrate the practical applicability of the method by applying it to a cancer dataset to reveal connections between somatic gene mutations and metastases to different tissues.


title: Inferring entropy production from time-dependent moments

abstract: Measuring entropy production of a system directly from the experimental data is highly desirable since it gives a quantifiable measure of the time-irreversibility for non-equilibrium systems and can be used as a cost function to optimize the performance of the system. Although numerous methods are available to infer the entropy production of stationary systems, there are only a limited number of methods that have been proposed for time-dependent systems and, to the best of our knowledge, none of these methods have been applied to experimental systems. Herein, we develop a general non-invasive methodology to infer a lower bound on the mean total entropy production for arbitrary time-dependent continuous-state Markov systems in terms of the moments of the underlying state variables. The method gives surprisingly accurate estimates for the entropy production, both for theoretical toy models and for experimental bit erasure, even with a very limited amount of experimental data.


title: Dispersive effects for the Schr\"odinger equation on finite metric graphs with infinite ends

abstract: We study the free Schr\"odinger equation on finite metric graphs with infinite ends. We give sufficient conditions to obtain the $L^1$ to $L^\infty$ time decay rate at least $t^{-1/2}$. These conditions allow certain metric graphs with circles and/or with commensurable lengths of the bounded edges. Further we study the dynamics of the probability flow between the bounded sub-graph and the unbounded ends.


title: EdgeCalib: Multi-Frame Weighted Edge Features for Automatic Targetless LiDAR-Camera Calibration

abstract: In multimodal perception systems, achieving precise extrinsic calibration between LiDAR and camera is of critical importance. Previous calibration methods often required specific targets or manual adjustments, making them both labor-intensive and costly. Online calibration methods based on features have been proposed, but these methods encounter challenges such as imprecise feature extraction, unreliable cross-modality associations, and high scene-specific requirements. To address this, we introduce an edge-based approach for automatic online calibration of LiDAR and cameras in real-world scenarios. The edge features, which are prevalent in various environments, are aligned in both images and point clouds to determine the extrinsic parameters. Specifically, stable and robust image edge features are extracted using a SAM-based method and the edge features extracted from the point cloud are weighted through a multi-frame weighting strategy for feature filtering. Finally, accurate extrinsic parameters are optimized based on edge correspondence constraints. We conducted evaluations on both the KITTI dataset and our dataset. The results show a state-of-the-art rotation accuracy of 0.086{\deg} and a translation accuracy of 0.977 cm, outperforming existing edge-based calibration methods in both precision and robustness.


title: A Survey on Experimental Performance Evaluation of Data Distribution Service (DDS) Implementations

abstract: The Data Distribution Service (DDS) is a widely used communication specification for real-time mission-critical systems that follow the principles of publish-subscribe middleware. DDS has an extensive set of quality of service (QoS) parameters allowing a thorough customisation of the intended communication. An extensive survey of the performance of the implementations of this communication middleware is lacking. This paper closes the gap by surveying the state of the art in performance of various DDS implementations and identifying any research gaps that exist within this domain.


title: On Constructing Extensions of Residually Isomorphic Characters

abstract: This is an exposition of our joint work with Kakde, Silliman, and Wang, in which we prove a version of Ribet's Lemma for $\mathrm{GL}_2$ in the residually indistinguishable case. We suppose we are given a Galois representation taking values in the total ring of fractions of a complete reduced Noetherian local ring $\mathbf{T}$, such that the characteristic polynomial of the representation is reducible modulo some ideal $I \subset \mathbf{T}$. We assume that the two characters that arise are congruent modulo the maximal ideal of $\mathbf{T}$. We construct an associated Galois cohomology class valued in a $\mathbf{T}$-module that is "large" in the sense that its Fitting ideal is contained in $I$. We make some simplifying assumptions that streamline the exposition -- we assume the two characters are actually equal, and we ignore the local conditions needed in arithmetic applications.


title: Assessing the relationship between subjective trust, confidence measurements, and mouse trajectory characteristics in an online task

abstract: Trust is essential for our interactions with others but also with artificial intelligence (AI) based systems. To understand whether a user trusts an AI, researchers need reliable measurement tools. However, currently discussed markers mostly rely on expensive and invasive sensors, like electroencephalograms, which may cause discomfort. The analysis of mouse trajectory has been suggested as a convenient tool for trust assessment. However, the relationship between trust, confidence and mouse trajectory is not yet fully understood. To provide more insights into this relationship, we asked participants (n = 146) to rate whether several tweets were offensive while an AI suggested its assessment. Our results reveal which aspects of the mouse trajectory are affected by the users subjective trust and confidence ratings; yet they indicate that these measures might not explain sufficiently the variance to be used on their own. This work examines a potential low-cost trust assessment in AI systems.


title: Photometric Redshifts with Copula Entropy

abstract: In this paper we propose to apply copula entropy (CE) to photometric redshifts. CE is used to measure the correlations between photometric measurements and redshifts and then the measurements associated with high CEs are selected for predicting redshifts. We verified the proposed method on the SDSS quasar data. Experimental results show that the accuracy of photometric redshifts is improved with the selected measurements compared to the results with all the measurements used in the experiments, especially for the samples with high redshifts. The measurements selected with CE include luminosity magnitude, the brightness in ultraviolet band with standard deviation, and the brightness of the other four bands. Since CE is a rigorously defined mathematical concept, the models such derived is interpretable.


title: Probing photon-ALP oscillations from the MAGIC observations of FSRQ QSO B1420+326

abstract: At the beginning of 2020, MAGIC reported a very-high-energy (VHE) flaring activity from the FSRQ QSO B1420+326. It is now the fourth known most distant blazar (z=0.682) with an observed VHE gamma-ray emission. In this work, we investigate the effect of photon-axionlike particle (ALP) oscillations in the gamma-ray spectra measured by Fermi-LAT and MAGIC around the flaring state. We set 95% C.L. upper limit on the ALP parameters and obtain a constraint on the photon-ALP coupling constant $g_{a\gamma} < 2\times10^{-11}$ GeV$^{-1}$ for ALP masses $m_{a} \sim 10^{-10}-10^{-9}$ eV. Assuming the hadronic origin of VHE photons, we also estimate the expected neutrino flux from this source and the contribution to diffuse neutrino flux from QSO B1420+326-like FSRQs at sub-PeV energies. Furthermore, we study the implications of photon-ALP oscillations on the counterpart $\gamma$-rays of the sub-PeV neutrinos. Finally, we investigate a viable scenario of invisible neutrino decay to ALPs on the gamma-ray spectra and diffuse $\gamma$-ray flux at sub-PeV energies. Interestingly, we find that for the choice of neutrino lifetime $\tau_{2}/m_{2} = 10^3$ s eV$^{-1}$, the $\gamma$-ray flux has a good observational sensitivity towards LHAASO-KM2A.


title: (Uni)rational parametrizations of $\mathcal R_{g,2}$, $\mathcal R_{g,4}$ and $\mathcal R_{g,6}$ in low genera

abstract: The moduli space R_{g,2n} parametrizes double covers of smooth curves of genus g ramified at 2n points. We will prove the (uni)rationality of R_{g,2}, R_{g,4} and R_{g,6} in low genera.


title: Strict monadic topology II: descent for closure spaces

abstract: By a closure space we will mean a pair $(A,\mathcal{C})$, in which $A$ is a set and $\mathcal{C}$ a set of subsets of $A$ closed under arbitrary intersections. The purpose of this paper is to initiate a development of descent theory of closure spaces, with our main results being: (a) characterization of descent morphisms of closure spaces; (b) in the category of finite closure spaces every descent morphism is an effective descent morphism; (c) every surjective closed map and every surjective open map of closure spaces is an effective descent morphism.


title: Combined experimental and theoretical studies on glasslike transitions in the frustrated molecular conductors $\theta$-(BEDT-TTF)$_2MM'$(SCN)$_4$

abstract: We present results of the coefficient of thermal expansion for the frustrated quasi-two-dimensional molecular conductor $\theta$-(BEDT-TTF)$_2$RbZn(SCN)$_4$ for temperatures 1.5 K $\leq T \leq$ 290 K. A pronounced first-order phase transition anomaly is observed at the combined charge-order/structural transition at 215 K. Furthermore, clear evidence is found for two separate glasslike transitions at $T_{\mathrm{g}}$ = 90-100 K and $T_{\mathrm{g}}^\dagger$ = 120-130 K, similar to previous findings for $\theta$-(BEDT-TTF)$_2$CsZn(SCN)$_4$ and $\theta$-(BEDT-TTF)$_2$CsCo(SCN)$_4$, reported in T. Thomas et al., Phys. Rev. B 105, L041114 (2022), both of which lack the charge-order/structural transition. Our findings indicate that these glasslike transitions are common features for the $\theta$-(BEDT-TTF)$_2MM^\prime$(SCN)$_4$ family with $M$ = (Rb, Cs) and $M^\prime$ = (Co, Zn), irrespective of the presence or absence of charge order. These results are consistent with our model calculations on the glasslike dynamics associated with the flexible ethylene endgroups of the BEDT-TTF molecules for various $\theta$-(BEDT-TTF)$_2MM^\prime$(SCN)$_4$ salts, predicting two different conformational glass transitions. Moreover, calculations of the hopping integrals show a substantial degree of dependence on the endgroups' conformation, suggesting a significant coupling to the electronic degrees of freedom. Our findings support the possibility that the glassy freezing of the ethylene endgroups could drive or enhance glassy charge dynamics.


title: Robust Covariate Shift Adaptation for Density-Ratio Estimation

abstract: Consider a scenario where we have access to train data with both covariates and outcomes while test data only contains covariates. In this scenario, our primary aim is to predict the missing outcomes of the test data. With this objective in mind, we train parametric regression models under a covariate shift, where covariate distributions are different between the train and test data. For this problem, existing studies have proposed covariate shift adaptation via importance weighting using the density ratio. This approach averages the train data losses, each weighted by an estimated ratio of the covariate densities between the train and test data, to approximate the test-data risk. Although it allows us to obtain a test-data risk minimizer, its performance heavily relies on the accuracy of the density ratio estimation. Moreover, even if the density ratio can be consistently estimated, the estimation errors of the density ratio also yield bias in the estimators of the regression model's parameters of interest. To mitigate these challenges, we introduce a doubly robust estimator for covariate shift adaptation via importance weighting, which incorporates an additional estimator for the regression function. Leveraging double machine learning techniques, our estimator reduces the bias arising from the density ratio estimation errors. We demonstrate the asymptotic distribution of the regression parameter estimator. Notably, our estimator remains consistent if either the density ratio estimator or the regression function is consistent, showcasing its robustness against potential errors in density ratio estimation. Finally, we confirm the soundness of our proposed method via simulation studies.


title: Driving through the Concept Gridlock: Unraveling Explainability Bottlenecks in Automated Driving

abstract: Concept bottleneck models have been successfully used for explainable machine learning by encoding information within the model with a set of human-defined concepts. In the context of human-assisted or autonomous driving, explainability models can help user acceptance and understanding of decisions made by the autonomous vehicle, which can be used to rationalize and explain driver or vehicle behavior. We propose a new approach using concept bottlenecks as visual features for control command predictions and explanations of user and vehicle behavior. We learn a human-understandable concept layer that we use to explain sequential driving scenes while learning vehicle control commands. This approach can then be used to determine whether a change in a preferred gap or steering commands from a human (or autonomous vehicle) is led by an external stimulus or change in preferences. We achieve competitive performance to latent visual features while gaining interpretability within our model setup.


title: EmoCLIP: A Vision-Language Method for Zero-Shot Video Facial Expression Recognition

abstract: Facial Expression Recognition (FER) is a crucial task in affective computing, but its conventional focus on the seven basic emotions limits its applicability to the complex and expanding emotional spectrum. To address the issue of new and unseen emotions present in dynamic in-the-wild FER, we propose a novel vision-language model that utilises sample-level text descriptions (i.e. captions of the context, expressions or emotional cues) as natural language supervision, aiming to enhance the learning of rich latent representations, for zero-shot classification. To test this, we evaluate using zero-shot classification of the model trained on sample-level descriptions on four popular dynamic FER datasets. Our findings show that this approach yields significant improvements when compared to baseline methods. Specifically, for zero-shot video FER, we outperform CLIP by over 10\% in terms of Weighted Average Recall and 5\% in terms of Unweighted Average Recall on several datasets. Furthermore, we evaluate the representations obtained from the network trained using sample-level descriptions on the downstream task of mental health symptom estimation, achieving performance comparable or superior to state-of-the-art methods and strong agreement with human experts. Namely, we achieve a Pearson's Correlation Coefficient of up to 0.85 on schizophrenia symptom severity estimation, which is comparable to human experts' agreement. The code is publicly available at: https://github.com/NickyFot/EmoCLIP.


title: The Next Evolution of Artificial Sense of Touch

abstract: We propose the next evolution of the artificial sense of touch, including an in-depth examination of the latest advancements in tactile sensing technology and the challenges that remain. We delve into the forefront of DNA and nanomaterials that enable the design of functionalized nanostructures in combination with the advantages of auto-assembly mechanisms. We evaluate the impact those technologies have on the challenges still faced in tactile sensing technology, including self-healing mechanisms, self-adaption, multi-modal, stretchable sensor structures, neuromorphic signal transmission, and scalable manufacturing. To conclude, this evolving technology has the potential to redefine the artificial sense of touch, offering mechanisms that enable advanced artificial somatosensory systems that equal or surpass human capabilities.


title: Fully Eulerian models for the numerical simulation of capsules with an elastic bulk nucleus

abstract: In this paper, we present a computational framework based on fully Eulerian models for fluid-structure interaction for the numerical simulation of biological capsules. The flexibility of such models, given by the Eulerian treatment of the interface and deformations, allows us to easily deal with the large deformations experienced by the capsule. The modeling of the membrane is based on a full membrane elasticity Eulerian model that is capable of capturing both area and shear variations thanks to the so-called backward characteristics. In the validation section several test cases are presented with the goal of comparing our results to others present in the literature. In this part, the comparisons are done with different well-known configurations (capsule in shear flow and square-section channel), and by deepening the effect of the elastic constitutive law and capillary number on the membrane dynamics. Finally, to show the potential of this framework we introduce a new test case that describes the relaxation of a capsule in an opening channel. In order to increase the challenges of this test we study the influence of an internal nucleus, modeled as a hyperelastic solid, on the membrane evolution. Several numerical simulations of a 3D relaxation phenomenon are presented to provide characteristic shapes and curves related to the capsule deformations, while also modifying size and stiffness parameter of the nucleus.


title: Angular Location of the $n^{th}$ Einstein Ring at large $n$

abstract: We perform a matched asymptotic expansion to find an analytic formula for the trajectory of a light ray in a Schwarzschild metric, in a power series expansion in the deviation of the impact parameter from its critical value. We present results valid to second sub leading order in this expansion. We use these results to find an analytic expansion for the angular location of the $n^{th}$ Einstein Ring (at large $n$) resulting from a star that lies directly behind a black hole but not necessarily far from it. The small parameter for this expansion is $e^{-\pi (2n+1)}$: our formulae are accurate to third order in this parameter.


title: Weak Solutions to the Degenerate Viscous Cahn-Hilliard Equation

abstract: The Cahn--Hilliard equation is a common model to describe phase separation processes of a mixture of two components. In this paper, we study the viscous Cahn--Hilliard equation with degenerate phase-dependent mobility. We define a notion of weak solutions and prove the existence of such weak solutions by considering the limits of the viscous Cahn--Hilliard equation with positive mobility. Also, we prove that such weak solutions satisfy an energy dissipation inequality under some additional conditions.


title: Demonstration of tritium adsorption on graphene

abstract: In this work, we report on studies of graphene exposed to tritium gas in a controlled environment. The single layer graphene on a $\textrm{SiO}_2$/Si substrate was exposed to 400 mbar of $\textrm{T}_2$ for a total time of $\approx$ 55 h. The resistivity of the graphene sample was measured $\textit{in situ}$ during tritium exposure using the Van der Pauw method. We found that the sheet resistance increases by three orders of magnitude during the exposure, suggesting significant chemisorption of tritium. After exposure, the samples were characterised $\textit{ex situ}$ via spatio-chemical mapping with a confocal Raman microscope, to study the effect of tritium on the graphene structure (tritiation yielding T-graphene), as well as the homogeneity of modifications across the whole area of the graphene film. The Raman spectra after tritium exposure were comparable to previously observed results in hydrogen-loading experiments, carried out by other groups. By thermal annealing we also could demonstrate, using Raman spectral analysis, that the structural changes were largely reversible. Considering all observations, we conclude that the graphene film was at least partially tritiated during the tritium exposure, and that the graphene film by and large withstands the bombardment by electrons from the $\beta$-decay of tritium, as well as by energetic primary and secondary ions.


title: Model predictive control-based value estimation for efficient reinforcement learning

abstract: Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal strategy with only a few attempts for many learning methods. Hereby, we design an improved reinforcement learning method based on model predictive control that models the environment through a data-driven approach. Based on the learned environment model, it performs multi-step prediction to estimate the value function and optimize the policy. The method demonstrates higher learning efficiency, faster convergent speed of strategies tending to the local optimal value, and less sample capacity space required by experience replay buffers. Experimental results, both in classic databases and in a dynamic obstacle avoidance scenario for an unmanned aerial vehicle, validate the proposed approaches.


title: Achieving Constraints in Neural Networks: A Stochastic Augmented Lagrangian Approach

abstract: Regularizing Deep Neural Networks (DNNs) is essential for improving generalizability and preventing overfitting. Fixed penalty methods, though common, lack adaptability and suffer from hyperparameter sensitivity. In this paper, we propose a novel approach to DNN regularization by framing the training process as a constrained optimization problem. Where the data fidelity term is the minimization objective and the regularization terms serve as constraints. Then, we employ the Stochastic Augmented Lagrangian (SAL) method to achieve a more flexible and efficient regularization mechanism. Our approach extends beyond black-box regularization, demonstrating significant improvements in white-box models, where weights are often subject to hard constraints to ensure interpretability. Experimental results on image-based classification on MNIST, CIFAR10, and CIFAR100 datasets validate the effectiveness of our approach. SAL consistently achieves higher Accuracy while also achieving better constraint satisfaction, thus showcasing its potential for optimizing DNNs under constrained settings.


title: Posterior Consistency for Missing Data in Variational Autoencoders

abstract: We consider the problem of learning Variational Autoencoders (VAEs), i.e., a type of deep generative model, from data with missing values. Such data is omnipresent in real-world applications of machine learning because complete data is often impossible or too costly to obtain. We particularly focus on improving a VAE's amortized posterior inference, i.e., the encoder, which in the case of missing data can be susceptible to learning inconsistent posterior distributions regarding the missingness. To this end, we provide a formal definition of posterior consistency and propose an approach for regularizing an encoder's posterior distribution which promotes this consistency. We observe that the proposed regularization suggests a different training objective than that typically considered in the literature when facing missing values. Furthermore, we empirically demonstrate that our regularization leads to improved performance in missing value settings in terms of reconstruction quality and downstream tasks utilizing uncertainty in the latent space. This improved performance can be observed for many classes of VAEs including VAEs equipped with normalizing flows.


title: Why does inflation look single field to us?

abstract: Most high-energy constructions that realise a phase of cosmic inflation contain many degrees of freedom. Yet, cosmological observations are all consistent with single-field embeddings. We show how volume selection effects explain this apparent paradox. Because of quantum diffusion, different regions of space inflate by different amounts. In regions that inflate most, and eventually dominate the volume of the universe, a generic mechanism is unveiled that diverts the inflationary dynamics towards single-field attractors. The formalism of constrained stochastic inflation is developed to this end.


title: Data-integration with pseudoweights and survey-calibration: application to developing US-representative lung cancer risk models for use in screening

abstract: Accurate cancer risk estimation is crucial to clinical decision-making, such as identifying high-risk people for screening. However, most existing cancer risk models incorporate data from epidemiologic studies, which usually cannot represent the target population. While population-based health surveys are ideal for making inference to the target population, they typically do not collect time-to-cancer incidence data. Instead, time-to-cancer specific mortality is often readily available on surveys via linkage to vital statistics. We develop calibrated pseudoweighting methods that integrate individual-level data from a cohort and a survey, and summary statistics of cancer incidence from national cancer registries. By leveraging individual-level cancer mortality data in the survey, the proposed methods impute time-to-cancer incidence for survey sample individuals and use survey calibration with auxiliary variables of influence functions generated from Cox regression to improve robustness and efficiency of the inverse-propensity pseudoweighting method in estimating pure risks. We develop a lung cancer incidence pure risk model from the Prostate, Lung, Colorectal, and Ovarian (PLCO) Cancer Screening Trial using our proposed methods by integrating data from the National Health Interview Survey (NHIS) and cancer registries.


title: Dwarf galaxies show little ISM evolution from $z\sim1$ to $z\sim0$: a spectroscopic study of metallicity, star formation, and electron density

abstract: We present gas-phase metallicity measurements for 583 emission line galaxies at $0.3<z<0.85$, including 388 dwarf galaxies with $log(M_{\star}/M_{\odot}) < 9.5$, and explore the dependence of the metallicity on the stellar mass and star formation properties of the galaxies. Metallicities are determined through the measurement of emission lines in very deep ($\sim$7 hr exposure) Keck/DEIMOS spectra taken primarily from the HALO7D survey. We measure metallicity with three strong-line calibrations (O3H$\beta$, R23, and O3O2) for the overall sample, as well as with the faint [Ne III]$\lambda$3869 and [O III]$\lambda$4363 emission lines for 112 and 17 galaxies where robust detections were possible. We construct mass-metallicity relations (MZR) for each calibration method, finding MZRs consistent with other strong-line results at comparable redshift, as well as with $z\sim0$ galaxies. We quantify the intrinsic scatter in the MZR as a function of mass, finding it increases with lower stellar mass. We also measure a weak but significant correlation between increased MZR scatter and higher specific star formation rate. We find a weak influence of SFR in the fundamental metallicity relation as well, with an SFR coefficient of $\alpha=0.21$. Finally, we use the flux ratios of the [O II]$\lambda\lambda$3727,3729 doublet to calculate gas electron density in $\sim$1000 galaxies with $log(M_{\star}/M_{\odot}) < 10.5$ as a function of redshift. We measure low electron densities ($n_e\sim25$ cm$^{-3}$) for $z<1$ galaxies, again consistent with $z\approx0$ conditions, but measure higher densities ($n_e\sim100$ cm$^{-3}$) at $z>1$. These results all suggest that there is little evolution in star-forming interstellar medium conditions from $z\sim1$ to $z=0$, confirmed with a more complete sample of low-mass galaxies than has previously been available in this redshift range.