title: Trustworthy modelling of atmospheric formaldehyde powered by deep learning

abstract: Formaldehyde (HCHO) is one one of the most important trace gas in the atmosphere, as it is a pollutant causing respiratory and other diseases. It is also a precursor of tropospheric ozone which damages crops and deteriorates human health. Study of HCHO chemistry and long-term monitoring using satellite data is important from the perspective of human health, food security and air pollution. Dynamic atmospheric chemistry models struggle to simulate atmospheric formaldehyde and often overestimate by up to two times relative to satellite observations and reanalysis. Spatial distribution of modelled HCHO also fail to match satellite observations. Here, we present deep learning approach using a simple super-resolution based convolutional neural network towards simulating fast and reliable atmospheric HCHO. Our approach is an indirect method of HCHO estimation without the need to chemical equations. We find that deep learning outperforms dynamical model simulations which involves complicated atmospheric chemistry representation. Causality establishing the nonlinear relationships of different variables to target formaldehyde is established in our approach by using a variety of precursors from meteorology and chemical reanalysis to target OMI AURA satellite based HCHO predictions. We choose South Asia for testing our implementation as it doesnt have in situ measurements of formaldehyde and there is a need for improved quality data over the region. Moreover, there are spatial and temporal data gaps in the satellite product which can be removed by trustworthy modelling of atmospheric formaldehyde. This study is a novel attempt using computer vision for trustworthy modelling of formaldehyde from remote sensing can lead to cascading societal benefits.

categories: physics.ao-ph astro-ph.EP cs.CV cs.LG physics.chem-ph


title: Modeling and Pricing Cyber Insurance -- Idiosyncratic, Systematic, and Systemic Risks

abstract: The paper provides a comprehensive overview of modeling and pricing cyber insurance and includes clear and easily understandable explanations of the underlying mathematical concepts. We distinguish three main types of cyber risks: idiosyncratic, systematic, and systemic cyber risks. While for idiosyncratic and systematic cyber risks, classical actuarial and financial mathematics appear to be well-suited, systemic cyber risks require more sophisticated approaches that capture both network and strategic interactions. In the context of pricing cyber insurance policies, issues of interdependence arise for both systematic and systemic cyber risks; classical actuarial valuation needs to be extended to include more complex methods, such as concepts of risk-neutral valuation and (set-valued) monetary risk measures.


title: Bayesian analysis of systematic errors in the determination of the constant of gravitation

abstract: Measurements of the gravitational constant $G$ are notoriously difficult. Individual state-of-the-art experiments have managed to determine the value of $G$ with high precision: although, when considered collectively, the range in the measured values of $G$ far exceeds individual uncertainties, suggesting the presence of unaccounted for systematic effects. Here, we propose a Bayesian framework to account for the presence of systematic errors in the various measurement of $G$ while proposing a consensus value, following two paths: a parametric approach, based on the Maximum Entropy Principle, and a non-parametric one, the latter being a very flexible approach not committed to any specific functional form. With both our methods, we find that the uncertainty on this fundamental constant, once systematics are included, is significantly larger than what quoted in CODATA 2018. Moreover, the morphology of the non-parametric distribution hints towards the presence of several sources of unaccounted for systematics. In light of this, we recommend a consensus value for the gravitational constant $G = 6.6740^{+0.0015}_{-0.0015} \times 10^{-11}\ \mathrm{m}^3\ \mathrm{kg}^{-1}\ \mathrm{s}^{-2}$.


title: Examining Large Pre-Trained Language Models for Machine Translation: What You Don't Know About It

abstract: Pre-trained language models (PLMs) often take advantage of the monolingual and multilingual dataset that is freely available online to acquire general or mixed domain knowledge before deployment into specific tasks. Extra-large PLMs (xLPLMs) are proposed very recently to claim supreme performances over smaller-sized PLMs such as in machine translation (MT) tasks. These xLPLMs include Meta-AI's wmt21-dense-24-wide-en-X (2021) and NLLB (2022). In this work, we examine if xLPLMs are absolutely superior to smaller-sized PLMs in fine-tuning toward domain-specific MTs. We use two different in-domain data of different sizes: commercial automotive in-house data and clinical shared task data from the ClinSpEn2022 challenge at WMT2022. We choose popular Marian Helsinki as smaller sized PLM and two massive-sized Mega-Transformers from Meta-AI as xLPLMs. Our experimental investigation shows that 1) on smaller-sized in-domain commercial automotive data, xLPLM wmt21-dense-24-wide-en-X indeed shows much better evaluation scores using SacreBLEU and hLEPOR metrics than smaller-sized Marian, even though its score increase rate is lower than Marian after fine-tuning; 2) on relatively larger-size well prepared clinical data fine-tuning, the xLPLM NLLB tends to lose its advantage over smaller-sized Marian on two sub-tasks (clinical terms and ontology concepts) using ClinSpEn offered metrics METEOR, COMET, and ROUGE-L, and totally lost to Marian on Task-1 (clinical cases) on all official metrics including SacreBLEU and BLEU; 3) metrics do not always agree with each other on the same tasks using the same model outputs; 4) clinic-Marian ranked No.2 on Task- 1 (via SACREBLEU/BLEU) and Task-3 (via METEOR and ROUGE) among all submissions.


title: An Atlas of Optimal Low-Thrust Rephasing Solutions in Circular Orbit

abstract: In this paper, the time- and propellant-optimal low-thrust rephasing problems in circular orbit are studied to depict their solution spaces in an atlas. The number of key parameters that settle the rephasing problems is reduced by developing a set of linearized equations of motion based on the Sundman transformation and by formulating two reduced shooting functions using the minimum principle and symmetry properties. Only one key parameter is identified for the time-optimal problem, while two key parameters are obtained for the propellant-optimal one. Numerical investigation of the relationships between these parameters and shooting variables reveals that they can be depicted by some curve (or contour) maps and approximated by piecewise functions (or linear interpolations). For the relatively short- or long-term rephasing cases, some analytical time- and propellant-optimal solutions are proposed and consistent with the numerical solutions. Numerical results demonstrate that the proposed solutions can provide good initial guesses to solve the low-thrust rephasing problems with nonlinear dynamics. Moreover, the approximations of the performance indexes can be used in the preliminary mission design.


title: FFPA-Net: Efficient Feature Fusion with Projection Awareness for 3D Object Detection

abstract: Promising complementarity exists between the texture features of color images and the geometric information of LiDAR point clouds. However, there still present many challenges for efficient and robust feature fusion in the field of 3D object detection. In this paper, first, unstructured 3D point clouds are filled in the 2D plane and 3D point cloud features are extracted faster using projection-aware convolution layers. Further, the corresponding indexes between different sensor signals are established in advance in the data preprocessing, which enables faster cross-modal feature fusion. To address LiDAR points and image pixels misalignment problems, two new plug-and-play fusion modules, LiCamFuse and BiLiCamFuse, are proposed. In LiCamFuse, soft query weights with perceiving the Euclidean distance of bimodal features are proposed. In BiLiCamFuse, the fusion module with dual attention is proposed to deeply correlate the geometric and textural features of the scene. The quantitative results on the KITTI dataset demonstrate that the proposed method achieves better feature-level fusion. In addition, the proposed network shows a shorter running time compared to existing methods.


title: Scalable Task-Driven Robotic Swarm Control via Collision Avoidance and Learning Mean-Field Control

abstract: In recent years, reinforcement learning and its multi-agent analogue have achieved great success in solving various complex control problems. However, multi-agent reinforcement learning remains challenging both in its theoretical analysis and empirical design of algorithms, especially for large swarms of embodied robotic agents where a definitive toolchain remains part of active research. We use emerging state-of-the-art mean-field control techniques in order to convert many-agent swarm control into more classical single-agent control of distributions. This allows profiting from advances in single-agent reinforcement learning at the cost of assuming weak interaction between agents. However, the mean-field model is violated by the nature of real systems with embodied, physically colliding agents. Thus, we combine collision avoidance and learning of mean-field control into a unified framework for tractably designing intelligent robotic swarm behavior. On the theoretical side, we provide novel approximation guarantees for general mean-field control both in continuous spaces and with collision avoidance. On the practical side, we show that our approach outperforms multi-agent reinforcement learning and allows for decentralized open-loop application while avoiding collisions, both in simulation and real UAV swarms. Overall, we propose a framework for the design of swarm behavior that is both mathematically well-founded and practically useful, enabling the solution of otherwise intractable swarm problems.


title: Heart Attack Classification System using Neural Network Trained with Particle Swarm Optimization

abstract: The prior detection of a heart attack could lead to the saving of one's life. Putting specific criteria into a system that provides an early warning of an imminent at-tack will be advantageous to a better prevention plan for an upcoming heart attack. Some studies have been conducted for this purpose, but yet the goal has not been reached to prevent a patient from getting such a disease. In this paper, Neural Network trained with Particle Swarm Optimization (PSONN) is used to analyze the input criteria and enhance heart attack anticipation. A real and novel dataset that has been recorded on the disease is used. After preprocessing the data, the features are fed into the system. As a result, the outcomes from PSONN have been evaluated against those from other algorithms. Decision Tree, Random Forest, Neural network trained with Backpropagation (BPNN), and Naive Bayes were among those employed. Then the results of 100%, 99.2424%, 99.2323%, 81.3131%, and 66.4141% are produced concerning the mentioned algorithms, which show that PSONN has recorded the highest accuracy rate among all other tested algorithms.


title: Large Impact of Small Vertex Cuts on the Mechanics of Origami Bellows

abstract: For origami structures, perforating or cutting slits along creases is an effective method to define fold lines and alleviate stress concentrations at vertices. In this letter we show numerically and experimentally that for non-rigid-foldable origami bellows (e.g. Miura-ori, Kresling patterns) the introduction of small cut-outs at the vertices results in up to an order of magnitude reduction of the bellows' stiffness under axial compression. Further, the cut-outs at vertices impact the nonlinear response, e.g. the position and magnitude of a force limit point and presence of bistable configurations. As the origami bellows are not rigid foldable, an axial compression will necessarily result in facet deformations; the small cut-outs at the vertices are found to provide an unexpectedly large stress alleviation, resulting in disproportionate changes in mechanical properties of the bellows. In order to accurately model the mechanics of origami bellows, such manufacturing details must therefore be captured accurately. Lastly, introducing vertex cut-outs can be offered as a novel approach to tailoring the stiffness of non-rigid foldable origami structures.


title: Can Pre-trained Models Really Learn Better Molecular Representations for AI-aided Drug Discovery?

abstract: Self-supervised pre-training is gaining increasingly more popularity in AI-aided drug discovery, leading to more and more pre-trained models with the promise that they can extract better feature representations for molecules. Yet, the quality of learned representations have not been fully explored. In this work, inspired by the two phenomena of Activity Cliffs (ACs) and Scaffold Hopping (SH) in traditional Quantitative Structure-Activity Relationship (QSAR) analysis, we propose a method named Representation-Property Relationship Analysis (RePRA) to evaluate the quality of the representations extracted by the pre-trained model and visualize the relationship between the representations and properties. The concepts of ACs and SH are generalized from the structure-activity context to the representation-property context, and the underlying principles of RePRA are analyzed theoretically. Two scores are designed to measure the generalized ACs and SH detected by RePRA, and therefore the quality of representations can be evaluated. In experiments, representations of molecules from 10 target tasks generated by 7 pre-trained models are analyzed. The results indicate that the state-of-the-art pre-trained models can overcome some shortcomings of canonical Extended-Connectivity FingerPrints (ECFP), while the correlation between the basis of the representation space and specific molecular substructures are not explicit. Thus, some representations could be even worse than the canonical fingerprints. Our method enables researchers to evaluate the quality of molecular representations generated by their proposed self-supervised pre-trained models. And our findings can guide the community to develop better pre-training techniques to regularize the occurrence of ACs and SH.


title: CMSBERT-CLR: Context-driven Modality Shifting BERT with Contrastive Learning for linguistic, visual, acoustic Representations

abstract: Multimodal sentiment analysis has become an increasingly popular research area as the demand for multimodal online content is growing. For multimodal sentiment analysis, words can have different meanings depending on the linguistic context and non-verbal information, so it is crucial to understand the meaning of the words accordingly. In addition, the word meanings should be interpreted within the whole utterance context that includes nonverbal information. In this paper, we present a Context-driven Modality Shifting BERT with Contrastive Learning for linguistic, visual, acoustic Representations (CMSBERT-CLR), which incorporates the whole context's non-verbal and verbal information and aligns modalities more effectively through contrastive learning. First, we introduce a Context-driven Modality Shifting (CMS) to incorporate the non-verbal and verbal information within the whole context of the sentence utterance. Then, for improving the alignment of different modalities within a common embedding space, we apply contrastive learning. Furthermore, we use an exponential moving average parameter and label smoothing as optimization strategies, which can make the convergence of the network more stable and increase the flexibility of the alignment. In our experiments, we demonstrate that our approach achieves state-of-the-art results.


title: On local sharply n-transitive groups

abstract: The paper is devoted to generalizations of actions of topological groups on manifolds. Instead of a topological group, we consider a local topological group generalizing the notion of a~germ or a~neighborhood in a topological group. The notion of an action of a local group on a topological space is introduced. The paper constructs the theory of local sharply $n$-transitive groups and local $n$-pseudofields. Local sharply $n$-transitive groups are reduced to simpler algebraic objects -- local $n$-pseudofields, similarly to the way Lie groups are reduced to Lie algebras, and sharply two-transitive groups, are reduced to neardomains. This can be useful, since, opposite to locally compact and connected sharply $n$-transitive groups, which are absent for $n > 3$, local sharply $n$-transitive groups exist for any $n$, for example, the group $GL_n(\mathbb{R})$. Being boundedly sharply $n$-transitive, the groups under consideration are also Lie groups, which gives extra methods for their study.


title: Report of the Topical Group on Particle Dark Matter for Snowmass 2021

abstract: This report summarizes the findings of the CF1 Topical Subgroup to Snowmass 2021, which was focused on particle dark matter. One of the most important scientific goals of the next decade is to reveal the nature of dark matter (DM). To accomplish this goal, we must delve deep, to cover high priority targets including weakly-interacting massive particles (WIMPs), and search wide, to explore as much motivated DM parameter space as possible. A diverse, continuous portfolio of experiments at large, medium, and small scales that includes both direct and indirect detection techniques maximizes the probability of discovering particle DM. Detailed calibrations and modeling of signal and background processes are required to make a convincing discovery. In the event that a candidate particle is found through different means, for example at a particle collider, the program described in this report is also essential to show that it is consistent with the actual cosmological DM. The US has a leading role in both direct and indirect detection dark matter experiments -- to maintain this leading role, it is imperative to continue funding major experiments and support a robust R\&D program.


title: A case for DOT: Theoretical Foundations for Objects With Pattern Matching and GADT-style Reasoning

abstract: Many programming languages in the OO tradition now support pattern matching in some form. Historical examples include Scala and Ceylon, with the more recent additions of Java, Kotlin, TypeScript, and Flow. But pattern matching on generic class hierarchies currently results in puzzling type errors in most of these languages. Yet this combination of features occurs naturally in many scenarios, such as when manipulating typed ASTs. To support it properly, compilers need to implement a form of subtyping reconstruction: the ability to reconstruct subtyping information uncovered at runtime during pattern matching. We introduce cDOT, a new calculus in the family of Dependent Object Types (DOT) intended to serve as a formal foundation for subtyping reconstruction. Being descended from pDOT, itself a formal foundation for Scala, cDOT can be used to encode advanced object-oriented features such as generic inheritance, type constructor variance, F-bounded polymorphism, and first-class recursive modules. We demonstrate that subtyping reconstruction subsumes GADTs by encoding $\lambda_{2,G\mu}$, a classical constraint-based GADT calculus, into cDOT.


title: Astromorphic Self-Repair of Neuromorphic Hardware Systems

abstract: While neuromorphic computing architectures based on Spiking Neural Networks (SNNs) are increasingly gaining interest as a pathway toward bio-plausible machine learning, attention is still focused on computational units like the neuron and synapse. Shifting from this neuro-synaptic perspective, this paper attempts to explore the self-repair role of glial cells, in particular, astrocytes. The work investigates stronger correlations with astrocyte computational neuroscience models to develop macro-models with a higher degree of bio-fidelity that accurately captures the dynamic behavior of the self-repair process. Hardware-software co-design analysis reveals that bio-morphic astrocytic regulation has the potential to self-repair hardware realistic faults in neuromorphic hardware systems with significantly better accuracy and repair convergence for unsupervised learning tasks on the MNIST and F-MNIST datasets. Our implementation source code and trained models are available at https://github.com/NeuroCompLab-psu/Astromorphic_Self_Repair.


title: CP violation in $b$ and $c$ quark decays

abstract: Generically, non-Standard-Model particles contribute to processes with order-one charge-parity (CP) violating phases, as CP is not a fundamental symmetry of nature. The exploration of CP violation becomes therefore a sensitive search for non-Standard-Model physics. We briefly review the current status of CP-violation studies in bottom- and charm-quark transitions focusing on those quantities that are most sensitive to non-Standard-Model contributions and discuss opportunities and challenges for the next decade and beyond.


title: Machine Reading, Fast and Slow: When Do Models "Understand" Language?

abstract: Two of the most fundamental challenges in Natural Language Understanding (NLU) at present are: (a) how to establish whether deep learning-based models score highly on NLU benchmarks for the 'right' reasons; and (b) to understand what those reasons would even be. We investigate the behavior of reading comprehension models with respect to two linguistic 'skills': coreference resolution and comparison. We propose a definition for the reasoning steps expected from a system that would be 'reading slowly', and compare that with the behavior of five models of the BERT family of various sizes, observed through saliency scores and counterfactual explanations. We find that for comparison (but not coreference) the systems based on larger encoders are more likely to rely on the 'right' information, but even they struggle with generalization, suggesting that they still learn specific lexical patterns rather than the general principles of comparison.


title: Compositional generalization through abstract representations in human and artificial neural networks

abstract: Humans have a remarkable ability to rapidly generalize to new tasks that is difficult to reproduce in artificial learning systems. Compositionality has been proposed as a key mechanism supporting generalization in humans, but evidence of its neural implementation and impact on behavior is still scarce. Here we study the computational properties associated with compositional generalization in both humans and artificial neural networks (ANNs) on a highly compositional task. First, we identified behavioral signatures of compositional generalization in humans, along with their neural correlates using whole-cortex functional magnetic resonance imaging (fMRI) data. Next, we designed pretraining paradigms aided by a procedure we term {\em primitives pretraining} to endow compositional task elements into ANNs. We found that ANNs with this prior knowledge had greater correspondence with human behavior and neural compositional signatures. Importantly, primitives pretraining induced abstract internal representations, excellent zero-shot generalization, and sample-efficient learning. Moreover, it gave rise to a hierarchy of abstract representations that matched human fMRI data, where sensory rule abstractions emerged in early sensory areas, and motor rule abstractions emerged in later motor areas. Our findings give empirical support to the role of compositional generalization in human behavior, implicate abstract representations as its neural implementation, and illustrate that these representations can be embedded into ANNs by designing simple and efficient pretraining procedures.


title: Uncertainty propagation for nonlinear dynamics: A polynomial optimization approach

abstract: We use Lyapunov-like functions and convex optimization to propagate uncertainty in the initial condition of nonlinear systems governed by ordinary differential equations. We consider the full nonlinear dynamics without approximation, producing rigorous bounds on the expected future value of a quantity of interest even when only limited statistics of the initial condition (e.g., mean and variance) are known. For dynamical systems evolving in compact sets, the best upper (lower) bound coincides with the largest (smallest) expectation among all initial state distributions consistent with the known statistics. For systems governed by polynomial equations and polynomial quantities of interest, one-sided estimates on the optimal bounds can be computed using tools from polynomial optimization and semidefinite programming. Moreover, these numerical bounds provably converge to the optimal ones in the compact case. We illustrate the approach on a van der Pol oscillator and on the Lorenz system in the chaotic regime.


title: $R_I$ biorthogonal polynomials of Hahn type

abstract: A finite family of $R_I$ polynomials is introduced and studied. It consists in a set of polynomials of $_{3}F_{2}$ form whose biorthogonality to an ensemble of rational functions is spelled out. These polynomials are shown to satisfy two generalized eigenvalue problems: in addition to their recurrence relation of $R_I$ type, they are also found to obey a difference equation. Underscoring this bispectrality is a triplet of operators with tridiagonal actions.


title: The lambda extensions of the Ising correlation functions C(M, N)

abstract: We revisit, with a pedagogical heuristic motivation, the lambda extension of the low-temperature row correlation functions C(M,N) of the two-dimensional Ising model. In particular, using these one-parameter series to understand the deformation theory around selected values of $\lambda$, namely $\lambda = \cos(\pi \, m/n)$ with m and n integers, we show that these series yield perturbation coefficients, generalizing form factors, that are D-finite functions. As a by-product these exact results provide an infinite number of highly non-trivial identities on the complete elliptic integrals of the first and second kind. These results underline the fundamental role of Jacobi theta functions and Jacobi forms, the previous D-finite functions being (relatively simple) rational functions of Jacobi theta functions, when rewritten in terms of the nome of elliptic functions.


title: Hourly operation of a regulated lake via Model Predictive Control

abstract: The optimal operation of regulated lakes is a challenging task involving conflicting objectives, ranging from controlling lake levels to avoid floods and low levels to water supply downstream. The traditional approach to operation policy design is based on an offline optimization, where a feedback control rule mapping lake storage into daily release decisions is identified over a set of observational data. In this paper, we propose a receding-horizon policy for a more frequent, online regulation of the lake level, and we discuss its tuning as compared to benchmark approaches. As side contributions, we provide a daily alternative based on the same rationale, and we show that this is still valid under some assumptions on the water inflow. Numerical simulations are used to show the effectiveness of the proposed approach. We demonstrate the approach on the regulated lake Como, Italy.


title: Statistical process monitoring of artificial neural networks

abstract: The rapid advancement of models based on artificial intelligence demands innovative monitoring techniques which can operate in real time with low computational costs. In machine learning, especially if we consider artificial neural networks (ANNs), the models are often trained in a supervised manner. Consequently, the learned relationship between the input and the output must remain valid during the model's deployment. If this stationarity assumption holds, we can conclude that the ANN provides accurate predictions. Otherwise, the retraining or rebuilding of the model is required. We propose considering the latent feature representation of the data (called "embedding") generated by the ANN to determine the time when the data stream starts being nonstationary. In particular, we monitor embeddings by applying multivariate control charts based on the data depth calculation and normalized ranks. The performance of the introduced method is compared with benchmark approaches for various ANN architectures and different underlying data formats.


title: Mean-Field Approximation of Cooperative Constrained Multi-Agent Reinforcement Learning (CMARL)

abstract: Mean-Field Control (MFC) has recently been proven to be a scalable tool to approximately solve large-scale multi-agent reinforcement learning (MARL) problems. However, these studies are typically limited to unconstrained cumulative reward maximization framework. In this paper, we show that one can use the MFC approach to approximate the MARL problem even in the presence of constraints. Specifically, we prove that, an $N$-agent constrained MARL problem, with state, and action spaces of each individual agents being of sizes $|\mathcal{X}|$, and $|\mathcal{U}|$ respectively, can be approximated by an associated constrained MFC problem with an error, $e\triangleq \mathcal{O}\left([\sqrt{|\mathcal{X}|}+\sqrt{|\mathcal{U}|}]/\sqrt{N}\right)$. In a special case where the reward, cost, and state transition functions are independent of the action distribution of the population, we prove that the error can be improved to $e=\mathcal{O}(\sqrt{|\mathcal{X}|}/\sqrt{N})$. Also, we provide a Natural Policy Gradient based algorithm and prove that it can solve the constrained MARL problem within an error of $\mathcal{O}(e)$ with a sample complexity of $\mathcal{O}(e^{-6})$.


title: On the Dissipation of Ideal Hamiltonian Monte Carlo Sampler

abstract: We report on what seems to be an intriguing connection between variable integration time and partial velocity refreshment of Ideal Hamiltonian Monte Carlo samplers, both of which can be used for reducing the dissipative behavior of the dynamics. More concretely, we show that on quadratic potentials, efficiency can be improved through these means by a $\sqrt{\kappa}$ factor in Wasserstein-2 distance, compared to classical constant integration time, fully refreshed HMC. We additionally explore the benefit of randomized integrators for simulating the Hamiltonian dynamics under higher order regularity conditions.


title: Coeffects for Sharing and Mutation

abstract: In type-and-coeffect systems, contexts are enriched by coeffects modeling how they are actually used, typically through annotations on single variables. Coeffects are computed bottom-up, combining, for each term, the coeffects of its subterms, through a fixed set of algebraic operators. We show that this principled approach can be adopted to track sharing in the imperative paradigm, that is, links among variables possibly introduced by the execution. This provides a significant example of non-structural coeffects, which cannot be computed by-variable, since the way a given variable is used can affect the coeffects of other variables. To illustrate the effectiveness of the approach, we enhance the type system tracking sharing to model a sophisticated set of features related to uniqueness and immutability. Thanks to the coeffect-based approach, we can express such features in a simple way and prove related properties with standard techniques.


title: Envy-freeness in 3D Hedonic Games

abstract: We study the problem of partitioning a set of agents into coalitions based on the agents' additively separable preferences, which can also be viewed as a hedonic game. We apply three successively weaker solution concepts, namely envy-freeness, weakly justified envy-freeness, and justified envy-freeness. In a model in which coalitions may have any size, trivial solutions exist for these concepts, which provides a strong motivation for placing restrictions on coalition size. In this paper, we require feasible coalitions to have size three. We study the existence of partitions that are envy-free, weakly justified envy-free, and justified envy-free, and the computational complexity of finding such partitions, if they exist. We present a comprehensive complexity classification, in terms of the restrictions placed on the agents' preferences. From this, we identify a general trend that for the three successively weaker solution concepts, existence and polynomial-time solvability hold under successively weaker restrictions.


title: Vaidya and generalized Vaidya solutions by gravitational decoupling

abstract: In this paper we apply the gravitational decoupling method for dynamical systems in order to obtain a new type of solution which can describe a hairy dynamical black hole. We consider three cases of decoupling. The first one is the simplest and well-known when the mass function is the function only of space coordinate $r$. The second case is Vaidya spacetime case when the mass function depends on time $v$ . And the third case represents the generalization of these two cases: the mass function is the function of both $r$ and $v$. We also calculate the apparent horizon and singularity location for all three cases.


title: Automatic Error Analysis for Document-level Information Extraction

abstract: Document-level information extraction (IE) tasks have recently begun to be revisited in earnest using the end-to-end neural network techniques that have been successful on their sentence-level IE counterparts. Evaluation of the approaches, however, has been limited in a number of dimensions. In particular, the precision/recall/F1 scores typically reported provide few insights on the range of errors the models make. We build on the work of Kummerfeld and Klein (2013) to propose a transformation-based framework for automating error analysis in document-level event and (N-ary) relation extraction. We employ our framework to compare two state-of-the-art document-level template-filling approaches on datasets from three domains; and then, to gauge progress in IE since its inception 30 years ago, vs. four systems from the MUC-4 (1992) evaluation.


title: High-performance microresonator optical parametric oscillator on a silicon chip

abstract: Optical parametric oscillation (OPO) is distinguished by its wavelength access, that is, the ability to flexibly generate coherent light at wavelengths that are dramatically different from the pump laser, and in principle bounded solely by energy conservation between the input pump field and the output signal/idler fields. As society adopts advanced tools in quantum information science, metrology, and sensing, microchip OPO may provide an important path for accessing relevant wavelengths. However, a practical source of coherent light should additionally have high conversion efficiency and high output power. Here, we demonstrate a silicon photonics OPO device with unprecedented performance. Our OPO device, based on the third-order ($\chi^{(3)}$) nonlinearity in a silicon nitride microresonator, produces output signal and idler fields widely separated from each other in frequency ($>$150 THz), and exhibits a pump-to-idler conversion efficiency up to 29 $\%$ with a corresponding output idler power of $>$18 mW on-chip. This performance is achieved by suppressing competitive processes and by strongly overcoupling the output light. This methodology can be readily applied to existing silicon photonics platforms with heterogeneously-integrated pump lasers, enabling flexible coherent light generation across a broad range of wavelengths with high output power and efficiency.


title: New bounds on the number of Edges of the maximal Permutation Graphs

abstract: In this paper, we bound the number of edges of a maximal permutation graph with n vertices. We propose a new method to compute the lower bound by splitting the set of labellings of the edges into six parts, considering one separate problem for each part, explicitly determining the cardinality of four parts and summing up the corresponding values. We finish with an upper bound of the number of edges of a maximal permutation graph.


title: Impact of indirect CP violation on Br$(K_S \to \mu^+\mu^-)_{\ell=0}$

abstract: The decay $K_S \to (\mu^+\mu^-)_{\ell=0}$, with the final muon pair in an angular-momentum zero state, is a sensitive probe of short-distance physics. It has recently been shown how to extract this branching ratio from neutral kaon decay data. We point out that the impact of indirect CP violation on the standard-model prediction of this mode, while nominally of order $|\epsilon_K| \sim 10^{-3}$, is enhanced by a large amplitude ratio and leads to a shift of the branching ratio Br$(K_S \to \mu^+\mu^-)_{\ell=0}$ by a few percent, depending on the size of a relative phase that can be extracted from data. We also update the standard-model prediction of the short-distance contribution.


title: Efficiency Ordering of Stochastic Gradient Descent

abstract: We consider the stochastic gradient descent (SGD) algorithm driven by a general stochastic sequence, including i.i.d noise and random walk on an arbitrary graph, among others; and analyze it in the asymptotic sense. Specifically, we employ the notion of `efficiency ordering', a well-analyzed tool for comparing the performance of Markov Chain Monte Carlo (MCMC) samplers, for SGD algorithms in the form of Loewner ordering of covariance matrices associated with the scaled iterate errors in the long term. Using this ordering, we show that input sequences that are more efficient for MCMC sampling also lead to smaller covariance of the errors for SGD algorithms in the limit. This also suggests that an arbitrarily weighted MSE of SGD iterates in the limit becomes smaller when driven by more efficient chains. Our finding is of particular interest in applications such as decentralized optimization and swarm learning, where SGD is implemented in a random walk fashion on the underlying communication graph for cost issues and/or data privacy. We demonstrate how certain non-Markovian processes, for which typical mixing-time based non-asymptotic bounds are intractable, can outperform their Markovian counterparts in the sense of efficiency ordering for SGD. We show the utility of our method by applying it to gradient descent with shuffling and mini-batch gradient descent, reaffirming key results from existing literature under a unified framework. Empirically, we also observe efficiency ordering for variants of SGD such as accelerated SGD and Adam, open up the possibility of extending our notion of efficiency ordering to a broader family of stochastic optimization algorithms.


title: A characterization of groups of type $F_4$ arising from the first Tits construction

abstract: We show that algebraic groups of type $F_4$ (or equivalently Albert algebras) arising from the first Tits construction are determined uniquely by their $g_3$ invariant.


title: Proving Hypersafety Compositionally

abstract: Hypersafety properties of arity $n$ are program properties that relate $n$ traces of a program (or, more generally, traces of $n$ programs). Classic examples include determinism, idempotence, and associativity. A number of relational program logics have been introduced to target this class of properties. Their aim is to construct simpler proofs by capitalizing on structural similarities between the $n$ related programs. We propose an unexplored, complementary proof principle that establishes hyper-triples (i.e. hypersafety judgments) as a unifying compositional building block for proofs, and we use it to develop a Logic for Hyper-triple Composition (LHC), which supports forms of proof compositionality that were not achievable in previous logics. We prove LHC sound and apply it to a number of challenging examples.


title: Extended Intelligence

abstract: We argue that intelligence, construed as the disposition to perform tasks successfully, is a property of systems composed of agents and their contexts. This is the thesis of extended intelligence. We argue that the performance of an agent will generally not be preserved if its context is allowed to vary. Hence, this disposition is not possessed by an agent alone, but is rather possessed by the system consisting of an agent and its context, which we dub an agent-in-context. An agent's context may include an environment, other agents, cultural artifacts (like language, technology), or all of these, as is typically the case for humans and artificial intelligence systems, as well as many non-human animals. In virtue of the thesis of extended intelligence, we contend that intelligence is context-bound, task-particular and incommensurable among agents. Our thesis carries strong implications for how intelligence is analyzed in the context of both psychology and artificial intelligence.


title: Limiting analysis of a crystal dissolution and precipitation model coupled with the unsteady stokes equations in the context of porous media flow

abstract: We study the diffusion-reaction-advection model for mobile chemical species together with the dissolution and precipitation of immobile species in a porous medium at the micro-scale. This leads to a system of semilinear parabolic partial differential equations in the pore space coupled with a nonlinear ordinary differential equation at the grain boundary of the solid matrices. The fluid flow within the pore space is given by unsteady Stokes equation. The novelty of this work is to do the iterative limit analysis of the system by tackling the nonlinear terms, monotone multi-valued dissolution rate term, space-dependent non-identical diffusion coefficients and nonlinear precipitation (reaction) term. We also establish the existence of a unique positive global weak solution for the coupled system. In addition to that, for upscaling we introduce a modified version of the extension operator. Finally, we conclude the paper by showing that the upscaled model admits a unique solution.


title: On the Trail of Lost Pennies: player-funded tug-of-war on the integers

abstract: We study random-turn resource-allocation games. In the Trail of Lost Pennies, a counter moves on $\mathbb{Z}$. At each turn, Maxine stakes $a \in [0,\infty)$ and Mina $b \in [0,\infty)$. The counter $X$ then moves adjacently, to the right with probability $\tfrac{a}{a+b}$. If $X_i \to -\infty$ in this infinte-turn game, Mina receives one unit, and Maxine zero; if $X_i \to \infty$, then these receipts are zero and $x$. Thus the net receipt to a given player is $-A+B$, where $A$ is the sum of her stakes, and $B$ is her terminal receipt. The game was inspired by unbiased tug-of-war in~[PSSW] from 2009 but in fact closely resembles the original version of tug-of-war, introduced [HarrisVickers87] in the economics literature in 1987. We show that the game has surprising features. For a natural class of strategies, Nash equilibria exist precisely when $x$ lies in $[\lambda,\lambda^{-1}]$, for a certain $\lambda \in (0,1)$. We indicate that $\lambda$ is remarkably close to one, proving that $\lambda \leq 0.999904$ and presenting clear numerical evidence that $\lambda \geq 1 - 10^{-4}$. For each $x \in [\lambda,\lambda^{-1}]$, we find countably many Nash equilibria. Each is roughly characterized by an integral {\em battlefield} index: when the counter is nearby, both players stake intensely, with rapid but asymmetric decay in stakes as it moves away. Our results advance premises [HarrisVickers87,Konrad12] for fund management and the incentive-outcome relation that plausibly hold for many player-funded stake-governed games. Alongside a companion treatment [HP22] of games with allocated budgets, we thus offer a detailed mathematical treatment of an illustrative class of tug-of-war games. We also review the separate developments of tug-of-war in economics and mathematics in the hope that mathematicians direct further attention to tug-of-war in its original resource-allocation guise.


title: On the Gauss-Kuzmin-L\'evy problem for nearest integer continued fractions

abstract: This note provides an effective bound in the Gauss-Kuzmin-L\'evy problem for some Gauss type shifts associated with nearest integer continued fractions, acting on the interval $I_0=[0,\frac{1}{2}]$ or $I_0=[-\frac{1}{2},\frac{1}{2}]$. We prove asymptotic formulas $\lambda (T^{-n}I) =\mu(I)(\vert I_0 \vert +O(q^n))$ for such transformations $T$, where $\lambda$ is the Lebesgue measure on $\mathbb R$, $\mu$ the normalized $T$-invariant Lebesgue absolutely continuous measure, $I$ subinterval in $I_0$, and $q=0.288$ is smaller than the Wirsing constant $q_W=0.3036\ldots$


title: Replay and compositional computation

abstract: Replay in the brain has been viewed as rehearsal, or, more recently, as sampling from a transition model. Here, we propose a new hypothesis: that replay is able to implement a form of compositional computation where entities are assembled into relationally-bound structures to derive qualitatively new knowledge. This idea builds on recent advances in neuroscience which indicate that the hippocampus flexibly binds objects to generalizable roles and that replay strings these role-bound objects into compound statements. We suggest experiments to test our hypothesis, and we end by noting the implications for AI systems which lack the human ability to radically generalize past experience to solve new problems.


title: A Unifying Framework for Online Optimization with Long-Term Constraints

abstract: We study online learning problems in which a decision maker has to take a sequence of decisions subject to $m$ long-term constraints. The goal of the decision maker is to maximize their total reward, while at the same time achieving small cumulative constraints violation across the $T$ rounds. We present the first best-of-both-world type algorithm for this general class of problems, with no-regret guarantees both in the case in which rewards and constraints are selected according to an unknown stochastic model, and in the case in which they are selected at each round by an adversary. Our algorithm is the first to provide guarantees in the adversarial setting with respect to the optimal fixed strategy that satisfies the long-term constraints. In particular, it guarantees a $\rho/(1+\rho)$ fraction of the optimal reward and sublinear regret, where $\rho$ is a feasibility parameter related to the existence of strictly feasible solutions. Our framework employs traditional regret minimizers as black-box components. Therefore, by instantiating it with an appropriate choice of regret minimizers it can handle the full-feedback as well as the bandit-feedback setting. Moreover, it allows the decision maker to seamlessly handle scenarios with non-convex rewards and constraints. We show how our framework can be applied in the context of budget-management mechanisms for repeated auctions in order to guarantee long-term constraints that are not packing (e.g., ROI constraints).


title: A Genetic Quantum Annealing Algorithm

abstract: A genetic algorithm (GA) is a search-based optimization technique based on the principles of Genetics and Natural Selection. We present an algorithm which enhances the classical GA with input from quantum annealers. As in a classical GA, the algorithm works by breeding a population of possible solutions based on their fitness. However, the population of individuals is defined by the continuous couplings on the quantum annealer, which then give rise via quantum annealing to the set of corresponding phenotypes that represent attempted solutions. This introduces a form of directed mutation into the algorithm that can enhance its performance in various ways. Two crucial enhancements come from the continuous couplings having strengths that are inherited from the fitness of the parents (so-called nepotism) and from the annealer couplings allowing the entire population to be influenced by the fittest individuals (so-called quantum-polyandry). We find our algorithm to be significantly more powerful on several simple problems than a classical GA.


title: Global existence and uniform boundedness of the classical solutions for the system of multi-species transport with mass control

abstract: The goal of this work is to establish the global existence of nonnegative classical solutions in all dimensions for a system of highly nonlinear reaction-diffusion equations. We address the case for different diffusion coefficients and the system of reversible reactions with non-homogeneous Neumann boundary conditions. The systems are assumed to satisfy only the mass control condition and to have locally Lipschitz nonlinearities with arbitrary growth. The key aspect of this work is that we didn't assume that the diffusion coefficients are close to each other. We utilize the duality method and the regularization of the heat operator to derive the result. We also illustrate the global in time bounds for the solutions. The application includes concrete corrosion in sewer pipes or sulfate corrosion in sewer pipes.


title: Perturbation theory and canonical coordinates in celestial mechanics

abstract: KAM theory owes most of its success to its initial motivation: the application to problems of celestial mechanics. The masterly application was offered by V.I.Arnold in the 60s who worked out a theorem, that he named the Fundamental Theorem (FT), especially designed for the planetary problem. However, FT could be really used at that purpose only when, about 50 years later, a set of coordinates constructively taking the invariance by rotation and close-to-integrability into account was used. Since then, some progress has been done in the symplectic assessment of the problem, and here we review such results.


title: Uncertainty Aware ML-based surrogate models for particle accelerators: A Study at the Fermilab Booster Accelerator Complex

abstract: Standard deep learning methods, such as Ensemble Models, Bayesian Neural Networks and Quantile Regression Models provide estimates to prediction uncertainties for data-driven deep learning models. However, they can be limited in their applications due to their heavy memory, inference cost, and ability to properly capture out-of-distribution uncertainties. Additionally, some of these models require post-training calibration which limits their ability to be used for continuous learning applications. In this paper, we present a new approach to provide prediction with calibrated uncertainties that includes out-of-distribution contributions and compare it to standard methods on the Fermi National Accelerator Laboratory (FNAL) Booster accelerator complex.


title: A Robotic Visual Grasping Design: Rethinking Convolution Neural Network with High-Resolutions

abstract: High-resolution representations are important for vision-based robotic grasping problems. Existing works generally encode the input images into low-resolution representations via sub-networks and then recover high-resolution representations. This will lose spatial information, and errors introduced by the decoder will be more serious when multiple types of objects are considered or objects are far away from the camera. To address these issues, we revisit the design paradigm of CNN for robotic perception tasks. We demonstrate that using parallel branches as opposed to serial stacked convolutional layers will be a more powerful design for robotic visual grasping tasks. In particular, guidelines of neural network design are provided for robotic perception tasks, e.g., high-resolution representation and lightweight design, which respond to the challenges in different manipulation scenarios. We then develop a novel grasping visual architecture referred to as HRG-Net, a parallel-branch structure that always maintains a high-resolution representation and repeatedly exchanges information across resolutions. Extensive experiments validate that these two designs can effectively enhance the accuracy of visual-based grasping and accelerate network training. We show a series of comparative experiments in real physical environments at Youtube: https://youtu.be/Jhlsp-xzHFY.


title: Multi-probe analysis of the galaxy cluster CL J1226.9+3332: Hydrostatic mass and hydrostatic-to-lensing bias

abstract: The precise estimation of the mass of galaxy clusters is a major issue for cosmology. Large galaxy cluster surveys rely on scaling laws that relate cluster observables to their masses. From the high resolution observations of ~ 45 galaxy clusters with NIKA2 and XMM-Newton instruments, the NIKA2 SZ Large Program should provide an accurate scaling relation between the thermal Sunyaev-Zel'dovich effect and the hydrostatic mass. In this paper, we present an exhaustive analysis of the hydrostatic mass of the well known galaxy cluster CL J1226.9+3332, the highest-redshift cluster in the NIKA2 SZ Large Program at z = 0.89. We combine the NIKA2 observations with thermal Sunyaev-Zel'dovich data from NIKA, Bolocam and MUSTANG instruments and XMM-Newton X-ray observations and test the impact of the systematic effects on the mass reconstruction. We conclude that slight differences in the shape of the mass profile can be crucial when defining the integrated mass at R500, which demonstrates the importance of the modeling in the mass determination. We prove the robustness of our hydrostatic mass estimates by showing the agreement with all the results found in the literature. Another key information for cosmology is the bias of the masses estimated assuming hydrostatic equilibrium hypothesis. Based on the lensing convergence maps from the Cluster Lensing And Supernova survey with Hubble (CLASH) data, we obtain the lensing mass estimate for CL J1226.9+3332. From this we are able to measure the hydrostatic-to-lensing mass bias for this cluster, that spans from 1 - bHSE/lens ~ 0.7 to 1, presenting the impact of data-sets and mass reconstruction models on the bias.


title: Klein-Gordon equation for electrically charged particles with new energy-momentum operator

abstract: We address the Klein-Gordon equation for a spinless charged particle in the presence of an electromagnetic (EM) field, and focus on its known shortcoming, related to the existence of solutions with a negative probability density. We disclose a principal way to overcome this shortcoming, using our recent results obtained in the analysis of quantum phase effects for charges and dipoles, which prove the need to abandon the customary definition of the momentum operator for a charged particle in an EM field through its canonical momentum, and to adopt the more general definition of this operator through the sum of mechanical and electromagnetic momenta for the charged particle in an EM field. We show that the ap-plication of the new energy-momentum operator to the Klein-Gordon equation actually eliminates solutions with negative probability density. Some implications of the obtained results are discussed


title: Quantum Mechanical Comparison between Lithiated and Sodiated Silicon Nanowires

abstract: This computational research study will compare the specific charge capacity (SCC) between lithium ions inserted into crystallize silicon (c-Si) nanowires versus sodium ions inserted into amorphous silicon (a-Si) nanowires. It will be demonstrated that the potential energy V(r) within the lithium-silicon nanowire supports a coherent energy state model with discrete electron particles while the sodium-silicon nanowire potential energy will be discovered to be essentially zero and thus the electron current that travels through the sodiated silicon nanowire will be modeled as free electron with wave-like characteristics. This is due to the vast differences in the electric fields of the lithiated and sodiated silicon nanowires where the electric fields are of the order of 10^(+10)V/m and 10^(-15) V/m respectively. The main reason for the great disparity in electric fields are due to the present of optical amplification within lithium ions and the absence of this process within sodium ions. It will be shown that optical amplification develops coherent optical interactions which is the primary reason for the surge of specific charge capacity in the lithiated silicon nanowire. Conversely, the lack of optical amplification is the reason for the incoherent optical interactions within sodium ions which is the reason for the low presence of SCC in sodiated silicon nanowires.


title: Omnipredictors for Constrained Optimization

abstract: The notion of omnipredictors (Gopalan, Kalai, Reingold, Sharan and Wieder ITCS 2021), suggested a new paradigm for loss minimization. Rather than learning a predictor based on a known loss function, omnipredictors can easily be post-processed to minimize any one of a rich family of loss functions compared with the loss of hypotheses in a class $\mathcal C$. It has been shown that such omnipredictors exist and are implied (for all convex and Lipschitz loss functions) by the notion of multicalibration from the algorithmic fairness literature. In this paper, we introduce omnipredictors for constrained optimization and study their complexity and implications. The notion that we introduce allows the learner to be unaware of the loss function that will be later assigned as well as the constraints that will be later imposed, as long as the subpopulations that are used to define these constraints are known. We show how to obtain omnipredictors for constrained optimization problems, relying on appropriate variants of multicalibration. We also investigate the implications of this notion when the constraints used are so-called group fairness notions.


title: The Impending Opacity Challenge in Exoplanet Atmospheric Characterization

abstract: With a new generation of observatories coming online this decade, the process of characterizing exoplanet atmospheres will need to be reinvented. Currently mostly on the instrumental side, characterization bottlenecks will soon stand by the models used to translate spectra into atmospheric properties. Limitations stemming from our stellar and atmospheric models have already been highlighted. Here, we show that the current limitations of the opacity models used to decode exoplanet spectra propagate into an accuracy wall at ~0.5-1.0 dex (i.e., 3 to 10x) on the atmospheric properties, which is an order of magnitude above the precision targeted by JWST Cycle 1 programs and needed for, e.g., meaningful C/O-ratio constraints and biosignatures identification. We perform a sensitivity analysis using nine different opacity models and find that most of the retrievals produce harmonious fits owing to compensations in the form of >5$\sigma$ biases on the derived atmospheric parameters translating in the aforementioned accuracy wall. We suggest a two-tier approach to alleviate this problem involving a new retrieval procedure and guided improvements in opacity data, their standardization and optimal dissemination.


title: Curvature Propagation for the 3+1 Dimensional U(1) Symmetric Einstein Spacetimes

abstract: As it is well known, the global structure of the Einstein equations for general relativity in the context of the initial value problem, is a difficult and intricate mathematical problem. Therefore, any additional structure in their formulation is useful as a tool for studying the global behaviour of the initial value problem of the Einstein equations. In our previous works, we have used the additional structure provided by the dimensional reduction to $2+1$ dimensional Einstein-wave map system. In this work, we shall focus on yet another structure in the Einstein equations for the U(1) symmetric spacetimes, namely the analogy with the Yang-Mills theory and reconcile with the dimensionally reduced field equations.


title: An electromagnetic way to derive basic relativistic transformations

abstract: We derive the relativistic velocity addition law, the transformations of electromagnetic fields and space-time intervals by examining the drift velocities in a crossed electromagnetic field configuration. The postulate of the light velocity invariance is not taken as a priori, but is derived as the universal upper limit of physical drift velocities. The key is that a physical drift of either an electric charge or a magnetic charge remains a drift motion by inertial reference frame transformations. Such a simple fact is incompatible with the Galilean velocity addition. This derivation provides a way to introduce relativity via elementary electromagnetism.


title: Electric and magnetic fields as explicitly observer dependent four-dimensional vectors and their Lorentz transformations according to Minkowski-Ivezi\'c

abstract: In this paper a geometric approach to the special relativity (SR) is used that is called the "invariant special relativity" (ISR). In the ISR it is considered that in the four-dimensional (4D) spacetime physical laws are geometric, coordinate-free relationships between the 4D geometric, coordinate-free quantities. It is mathematicaly proved that in the ISR the electric and magnetic fields are properly defined vectors on the 4D spacetime. According to the first proof the dimension of a vector field is mathematicaly determined by the dimension of its domain. Since the electric and magnetic fields are defined on the 4D spacetime they are properly defined 4D vectors, the 4D geometric quantities (GQs). As shown in an axiomatic geometric formulation of electromagnetism with only one axiom, the field equation for the bivector field F [33], [T. Ivezi\'c, Found. Phys. Lett. 18, 401 (2005), arXiv: physics/0412167], the primary quantity for the whole electromagnetism is the bivector field F. The electric and magnetic fields 4D vectors E and B are determined in a mathematically correct way in terms of F and the 4D velocity vector v of the observer who measures E and B fields. Furthermore, the proofs are presented that under the mathematicaly correct Lorentz transformations, which are first derived by Minkowski and reinvented and generalized in terms of 4D GQs, e.g., in [23], [T. Ivezi\'c, Phys. Scr. 82, 055007 (2010)], the electric field 4D vector transforms as any other 4D vector transforms, i.e., again to the electric field 4D vector; there is no mixing with the magnetic field 4D vector B, as in the usual transformations (UT) of the 3D fields. This formulation with the 4D GQs is in a true agreement with experiments in electromagnetism, e.g., the motional emf.


title: Phenomenological formula for Quantum Hall resistivity based on the Riemann zeta function

abstract: We propose a formula constructed out of elementary functions that captures many of the detailed features of the transverse resistivity $\rho_{xy}$ for the integer quantum Hall effect. It is merely a phenomenological formula in the sense that it is not based on any transport calculation for a specific class of physical models involving electrons in a disordered landscape, thus, whether a physical model exists which realizes this resistivity remains an open question. Nevertheless, since the formula involves the Riemann zeta function and its non-trivial zeros play a central role, it is amusing to consider the implications of the Riemann Hypothesis in light of it.


title: Dynamics of ultrarelativistic charged particles with strong radiation reaction. I. Aristotelian equilibrium state

abstract: Previous studies from the astrophysics and laser physics communities have identified an interesting phenomenon wherein ultrarelativistic charged particles experiencing strong radiation reaction tend to move along special directions fixed by the local electromagnetic field. In the relativity literature these are known as the "principal null directions" (PNDs) of the Maxwell field. A particle in this regime has "Aristotelian" dynamics in the sense that its velocity (rather than acceleration) is determined by the local field. We study this Aristotelian equilibrium in detail, starting from the Landau-Lifshitz equation describing charged particle motion including radiation reaction. Using a Frenet-Serret frame adapted to the PNDs, we derive the Lorentz factor describing motion along the local PND, together with drift velocities reflecting slower passage from one PND to another. We derive conditions on the field configuration that are necessary for such an equilibrium to occur. We demonstrate agreement of our analytic formulas with full numerical solutions of the Landau-Lifshitz equation in the appropriate regime.


title: General relativity and background Lorentz transformations solve Supplee's submarine paradox

abstract: A submarine moving at relativistic horizontal velocity sinks in Earth's rest frame due to length contraction while appearing to float in its own frame. Using spacetime geometry and the Lorentz transformations, we show that the resolution lies in how metric components transform between reference frames in relative motion. This solution frees us from assumptions made in previous studies on how a Newtonian gravitational force should transform. The method of background Lorentz transformations is technically simpler than previous treatments in the framework of general relativity. Moreover, we find a novel and intuitive understanding of the paradox, and correct an erroneous expression for the gravitational force obtained by Supplee and used again in the literature.


title: Topological symmetry in quantum field theory

abstract: We introduce a framework for internal topological symmetries in quantum field theory, including "noninvertible symmetries" and "categorical symmetries". This leads to a calculus of topological defects which takes full advantage of well-developed theorems and techniques in topological field theory. Our discussion focuses on finite symmetries, and we give indications for a generalization to other symmetries. We treat quotients and quotient defects (often called "gauging" and "condensation defects"), finite electromagnetic duality, and duality defects, among other topics. We include an appendix on finite homotopy theories, which are often used to encode finite symmetries and for which computations can be carried out using methods of algebraic topology. Throughout we emphasize exposition and examples over a detailed technical treatment.


title: A $(D_\tau,D_x)$-manifold with $N$-correlators of $N_t$-objects

abstract: In this paper, we describe a mathematical formalism for a $(D_\tau,D_x)$-dimensional manifold with $N$-correlators of $N_t$ types of objects, with cross correlations and contaminants. In particular, we build this formalism using simple notions of mathematical physics, field theory, topology, algebra, statistics n-correlators and Fourier transform. We discuss the applicability of this formalism in the context of cosmological scales, i.e. from astronomical scales to quantum scales, for which we give some intuitive examples.


title: Wandering Domains in $\mathbb{C}\times \mathbb{R}$

abstract: Approximation theory of entire functions has been used to demonstrate the construction of a map on $\mathbb{C}\times\mathbb{R}$ having wandering domains. We also present suitable modification to this construction that helps in obtaining maps with similar characteristics such as infinitely many attracting Fatou components, infinitely many wandering domains having common paths, etc.


title: On the Surprising Effectiveness of Transformers in Low-Labeled Video Recognition

abstract: Recently vision transformers have been shown to be competitive with convolution-based methods (CNNs) broadly across multiple vision tasks. The less restrictive inductive bias of transformers endows greater representational capacity in comparison with CNNs. However, in the image classification setting this flexibility comes with a trade-off with respect to sample efficiency, where transformers require ImageNet-scale training. This notion has carried over to video where transformers have not yet been explored for video classification in the low-labeled or semi-supervised settings. Our work empirically explores the low data regime for video classification and discovers that, surprisingly, transformers perform extremely well in the low-labeled video setting compared to CNNs. We specifically evaluate video vision transformers across two contrasting video datasets (Kinetics-400 and SomethingSomething-V2) and perform thorough analysis and ablation studies to explain this observation using the predominant features of video transformer architectures. We even show that using just the labeled data, transformers significantly outperform complex semi-supervised CNN methods that leverage large-scale unlabeled data as well. Our experiments inform our recommendation that semi-supervised learning video work should consider the use of video transformers in the future.


title: Neural Networks Reduction via Lumping

abstract: The increasing size of recently proposed Neural Networks makes it hard to implement them on embedded devices, where memory, battery and computational power are a non-trivial bottleneck. For this reason during the last years network compression literature has been thriving and a large number of solutions has been been published to reduce both the number of operations and the parameters involved with the models. Unfortunately, most of these reducing techniques are actually heuristic methods and usually require at least one re-training step to recover the accuracy. The need of procedures for model reduction is well-known also in the fields of Verification and Performances Evaluation, where large efforts have been devoted to the definition of quotients that preserve the observable underlying behaviour. In this paper we try to bridge the gap between the most popular and very effective network reduction strategies and formal notions, such as lumpability, introduced for verification and evaluation of Markov Chains. Elaborating on lumpability we propose a pruning approach that reduces the number of neurons in a network without using any data or fine-tuning, while completely preserving the exact behaviour. Relaxing the constraints on the exact definition of the quotienting method we can give a formal explanation of some of the most common reduction techniques.


title: Nanoscale imaging of antiferromagnetic domains in epitaxial films of Cr2O3 via scanning diamond magnetic probe microscopy

abstract: We report direct imaging of boundary magnetization associated with antiferromagnetic domains in magnetoelectric epitaxial Cr2O3 thin films using diamond nitrogen vacancy microscopy. We found a correlation between magnetic domain size and structural grain size which we associate with the domain formation process. We performed field cooling, i.e., cooling from above to below the N\'eel temperature in the presence of magnetic field, which resulted in the selection of one of the two otherwise degenerate 180 degree domains. Lifting of such a degeneracy is achievable with a magnetic field alone due to the Zeeman energy of a weak parasitic magnetic moment in Cr2O3 films that originates from defects and the imbalance of the boundary magnetization of opposing interfaces. This boundary magnetization couples to the antiferromagnetic order parameter enabling selection of its orientation. Nanostructuring the Cr2O3 film with mesa structures revealed reversible edge magnetic states with the direction of magnetic field during field cooling.


title: Large-scale circulations in a shear-free convective turbulence: Mean-field simulations

abstract: It has been previously shown (Phys. Rev. E 66, 066305, 2002) that a non-rotating turbulent convection with nonuniform large-scale flows contributes to the turbulent heat flux. As a result, the turbulent heat flux depends explicitly not only on the gradients of the large-scale temperature, but it also depends on the gradients of the large-scale velocity. This is because the nonuniform large-scale flows produce anisotropic velocity fluctuations which modify the turbulent heat flux. This effect causes an excitation of a convective-wind instability and formation of large-scale semi-organised coherent structures (large-scale convective cells). We perform mean-field numerical simulations of shear-free convection which take into account the modification of the turbulent heat flux by nonuniform large-scale flows. The redistribution of the turbulent heat flux by the nonuniform large-scale motions in turbulent convection plays a crucial role in the formation of the large-scale semi-organised coherent structures. This effect results in a strong reduction of the critical effective Rayleigh number (based on the eddy viscosity and turbulent temperature diffusivity) required for the formation of the large-scale convective cells. The convective-wind instability is excited when the scale separation ratio between the height of the convective layer and the integral turbulence scale is large. The level of the mean kinetic energy at saturation increases with the scale separation ratio. Inside the large-scale convective cells, there are local regions with the positive vertical gradient of the potential temperature which implies that these regions are stably stratified.


title: Control Barrier Function Contracts for Vehicular Mission Planning Under Signal Temporal Logic Specifications

abstract: We present a compositional control synthesis method based on assume-guarantee contracts with application to correct-by-construction design of vehicular mission plans. In our approach, a mission-level specification expressed in a fragment of signal temporal logic (STL) is decomposed into predicates defined on non-overlapping time intervals. The STL predicates are then mapped to an aggregation of contracts associated with continuously differentiable time-varying control barrier functions. The barrier functions are used to constrain the lower-level control synthesis problem, which is solved via quadratic programming. Our approach can avoid the conservatism of previous methods for task-driven control based on under-approximations. We illustrate its effectiveness on a case study motivated by vehicular mission planning under safety constraints as well as constraints imposed by traffic regulations under vehicle-to-vehicle and vehicle-to-infrastructure communication.


title: Gollum: A Gold Standard for Large Scale Multi Source Knowledge Graph Matching

abstract: The number of Knowledge Graphs (KGs) generated with automatic and manual approaches is constantly growing. For an integrated view and usage, an alignment between these KGs is necessary on the schema as well as instance level. While there are approaches that try to tackle this multi source knowledge graph matching problem, large gold standards are missing to evaluate their effectiveness and scalability. We close this gap by presenting Gollum -- a gold standard for large-scale multi source knowledge graph matching with over 275,000 correspondences between 4,149 different KGs. They originate from knowledge graphs derived by applying the DBpedia extraction framework to a large wiki farm. Three variations of the gold standard are made available: (1) a version with all correspondences for evaluating unsupervised matching approaches, and two versions for evaluating supervised matching: (2) one where each KG is contained both in the train and test set, and (3) one where each KG is exclusively contained in the train or the test set.


title: Report of the Topical Group on Artificial Neutrino Sources for Snowmass 2021

abstract: The NF09 topical group was charged with soliciting input to Snowmass on the topic of artificial neutrino sources. In this report, we attempt to catalogue all new or upgraded artificial neutrino sources that are being considered by the global neutrino physics community over the next decade. This report also highlights projects that can improve our knowledge of the fluxes from these sources, which is important to maximize their use.


title: Variational Representations of Annealing Paths: Bregman Information under Monotonic Embedding

abstract: Markov Chain Monte Carlo methods for sampling from complex distributions and estimating normalization constants often simulate samples from a sequence of intermediate distributions along an annealing path, which bridges between a tractable initial distribution and a target density of interest. Prior works have constructed annealing paths using quasi-arithmetic means, and interpreted the resulting intermediate densities as minimizing an expected divergence to the endpoints. To analyze these variational representations of annealing paths, we extend known results showing that the arithmetic mean over arguments minimizes the expected Bregman divergence to a single representative point. In particular, we obtain an analogous result for quasi-arithmetic means, when the inputs to the Bregman divergence are transformed under a monotonic embedding function. Our analysis highlights the interplay between quasi-arithmetic means, parametric families, and divergence functionals using the rho-tau representational Bregman divergence framework, and associates common divergence functionals with intermediate densities along an annealing path.

categories: cs.LG cs.IT math.IT math.ST stat.ML stat.TH


title: Euler scheme for approximation of solution of nonlinear ODEs under inexact information

abstract: We investigate error of the Euler scheme in the case when the right-hand side function of the underlying ODE satisfies nonstandard assumptions such as local one-sided Lipschitz condition and local H\"older continuity. Moreover, we assume two cases in regards to information availability: exact and noisy with respect to the right-hand side function. Optimality analysis of the Euler scheme is also provided. Finally, we present the results of some numerical experiments.


title: Report of the Topical Group on Neutrino Applications for Snowmass 2021

abstract: This report has been prepared as part of the US Community Study on the Future of Particle Physics (Snowmass 2021) by the Snowmass Neutrino Frontier Topical Group NF07 Conveners, based on input from contributed White papers and Letters of Interest.


title: Hydra Attention: Efficient Attention with Many Heads

abstract: While transformers have begun to dominate many tasks in vision, applying them to large images is still computationally difficult. A large reason for this is that self-attention scales quadratically with the number of tokens, which in turn, scales quadratically with the image size. On larger images (e.g., 1080p), over 60% of the total computation in the network is spent solely on creating and applying attention matrices. We take a step toward solving this issue by introducing Hydra Attention, an extremely efficient attention operation for Vision Transformers (ViTs). Paradoxically, this efficiency comes from taking multi-head attention to its extreme: by using as many attention heads as there are features, Hydra Attention is computationally linear in both tokens and features with no hidden constants, making it significantly faster than standard self-attention in an off-the-shelf ViT-B/16 by a factor of the token count. Moreover, Hydra Attention retains high accuracy on ImageNet and, in some cases, actually improves it.


title: Some arithmetical properties of convergents to algebraic numbers

abstract: Let $\xi$ be an irrational algebraic real number and $(p_k / q_k)_{k \ge 1}$ denote the sequence of its convergents. Let $(u_n)_{n \geq 1}$ be a non-degenerate linear recurrence sequence of integers, which is not a polynomial sequence. We show that if the intersection of the sequences $(q_k)_{k \ge 1}$ and $(u_n)_{n \geq 1}$ is infinite, then $\xi$ is a quadratic number. We also discuss several arithmetical properties of the sequence $(q_k)_{k \ge 1}$.


title: On the supersymmetric pseudo-QED

abstract: Within the superfield approach, we discuss the three-dimensional supersymmetric (SUSY) pseudo-QED. We prove that it is all-loop renormalizable. We demonstrate that the SUSY pseudo-QED action can be generated as a quantum correction from the coupling of a spinor gauge superfield to a set of $N$ massless complex scalar superfields. Afterwards, we calculate the two-point function of the scalar superfields in the pseudo-QED which displays a divergence vanishing in a certain gauge.


title: The pathfinder Dragonfly Spectral Line Mapper: Pushing the limits for ultra-low surface brightness spectroscopy

abstract: The pathfinder Dragonfly Spectral Line Mapper is a distributed aperture telescope based off of the Dragonfly Telephoto Array with additional instrumentation (the Dragonfly "Filter-Tilter") to enable ultranarrow bandpass imaging. The pathfinder is composed of three redundant optical tube assemblies (OTAs) which are mounted together to form a single field of view imaging telescope (where the effective aperture diameter increases as the square-root of the number of OTAs). The pathfinder has been on sky from March 2020 to October 2021 equipped with narrowband filters to provide proof-of-concept imaging, surface brightness limit measurements, on sky testing, and observing software development. Here we describe the pathfinder telescope and the sensitivity limits reached along with observing methods. We outline the current limiting factors for reaching ultra-low surface brightnesses and present a comprehensive comparison of instrument sensitivities to low surface brightness line emission and other methods of observing the ultra-faint line emission from diffuse gas. Finally, we touch on plans for the upcoming 120-OTA Dragonfly Spectral Line Mapper, which is currently under construction.


title: Distributed Aperture Telescopes and the Dragonfly Telephoto Array

abstract: Telescope arrays allow high-performance wide-field imaging systems to be built more quickly and at lower cost than conventional telescopes. Distributed aperture telescopes (the premier example of which is the Dragonfly Telephoto Array) are a special type of array in which all telescopes point at roughly the same position in the sky. In this configuration the array performs like a large and optically very fast single telescope with unusually good control over systematic errors. In a few key areas, such as low surface brightness imaging over wide fields of view, distributed aperture telescopes outperform conventional survey telescopes by a wide margin. In these Proceedings we outline the rationale for distributed aperture telescopes, and highlight the strengths and weaknesses of the concept. Areas of observational parameter space in which the design excels are identified. These correspond to areas of astrophysics that are both relatively unexplored and which have unusually strong breakthrough potential.


title: The Dragonfly Spectral Line Mapper: Design and First Light

abstract: The Dragonfly Spectral Line Mapper (DSLM) is the latest evolution of the Dragonfly Telephoto Array, which turns it into the world's most powerful wide-field spectral line imager. The DSLM will be the equivalent of a 1.6m aperture $f$/0.26 refractor with a built-in Integral Field Spectrometer, covering a five square degree field of view. The new telescope is designed to carry out ultra-narrow bandpass imaging of the low surface brightness universe with exquisite control over systematic errors, including real-time calibration of atmospheric variations in airglow. The key to Dragonfly's transformation is the "Filter-Tilter", a mechanical assembly which holds ultra-narrow bandpass interference filters in front of each lens in the array and tilts them to smoothly shift their central wavelength. Here we describe our development process based on rapid prototyping, iterative design, and mass production. This process has resulted in numerous improvements to the design of the DSLM from the initial pathfinder instrument, including changes to narrower bandpass filters and the addition of a suite of calibration filters for continuum light subtraction and sky line monitoring. Improvements have also been made to the electronics and hardware of the array, which improve tilting accuracy, rigidity and light baffling. Here we present laboratory and on-sky measurements from the deployment of the first bank of lenses in May 2022, and a progress report on the completion of the full array in early 2023.


title: Semi-Symbolic Inference for Efficient Streaming Probabilistic Programming

abstract: Efficient inference is often possible in a streaming context using Rao-Blackwellized particle filters (RBPFs), which exactly solve inference problems when possible and fall back on sampling approximations when necessary. While RBPFs can be implemented by hand to provide efficient inference, the goal of streaming probabilistic programming is to automatically generate such efficient inference implementations given input probabilistic programs. In this work, we propose semi-symbolic inference, a technique for executing probabilistic programs using a runtime inference system that automatically implements Rao-Blackwellized particle filtering. To perform exact and approximate inference together, the semi-symbolic inference system manipulates symbolic distributions to perform exact inference when possible and falls back on approximate sampling when necessary. This approach enables the system to implement the same RBPF a developer would write by hand. To ensure this, we identify closed families of distributions -- such as linear-Gaussian and finite discrete models -- on which the inference system guarantees exact inference. We have implemented the runtime inference system in the ProbZelus streaming probabilistic programming language. Despite an average $1.6\times$ slowdown compared to the state of the art on existing benchmarks, our evaluation shows that speedups of $3\times$-$87\times$ are obtainable on a new set of challenging benchmarks we have designed to exploit closed families.


title: Defending Root DNS Servers Against DDoS Using Layered Defenses

abstract: Distributed Denial-of-Service (DDoS) attacks exhaust resources, leaving a server unavailable to legitimate clients. The Domain Name System (DNS) is a frequent target of DDoS attacks. Since DNS is a critical infrastructure service, protecting it from DoS is imperative. Many prior approaches have focused on specific filters or anti-spoofing techniques to protect generic services. DNS root nameservers are more challenging to protect, since they use fixed IP addresses, serve very diverse clients and requests, receive predominantly UDP traffic that can be spoofed, and must guarantee high quality of service. In this paper we propose a layered DDoS defense for DNS root nameservers. Our defense uses a library of defensive filters, which can be optimized for different attack types, with different levels of selectivity. We further propose a method that automatically and continuously evaluates and selects the best combination of filters throughout the attack. We show that this layered defense approach provides exceptional protection against all attack types using traces of ten real attacks from a DNS root nameserver. Our automated system can select the best defense within seconds and quickly reduces traffic to the server within a manageable range, while keeping collateral damage lower than 2%. We can handle millions of filtering rules without noticeable operational overhead.


title: MRI-MECH: Mechanics-informed MRI to estimate esophageal health

abstract: Dynamic magnetic resonance imaging (MRI) is a popular medical imaging technique to generate image sequences of the flow of a contrast material inside tissues and organs. However, its application to imaging bolus movement through the esophagus has only been demonstrated in few feasibility studies and is relatively unexplored. In this work, we present a computational framework called mechanics-informed MRI (MRI-MECH) that enhances that capability thereby increasing the applicability of dynamic MRI for diagnosing esophageal disorders. Pineapple juice was used as the swallowed contrast material for the dynamic MRI and the MRI image sequence was used as input to the MRI-MECH. The MRI-MECH modeled the esophagus as a flexible one-dimensional tube and the elastic tube walls followed a linear tube law. Flow through the esophagus was then governed by one-dimensional mass and momentum conservation equations. These equations were solved using a physics-informed neural network (PINN). The PINN minimized the difference between the measurements from the MRI and model predictions ensuring that the physics of the fluid flow problem was always followed. MRI-MECH calculated the fluid velocity and pressure during esophageal transit and estimated the mechanical health of the esophagus by calculating wall stiffness and active relaxation. Additionally, MRI-MECH predicted missing information about the lower esophageal sphincter during the emptying process, demonstrating its applicability to scenarios with missing data or poor image resolution. In addition to potentially improving clinical decisions based on quantitative estimates of the mechanical health of the esophagus, MRI-MECH can also be enhanced for application to other medical imaging modalities to enhance their functionality as well.


title: Decentralized Infrastructure for (Neuro)science

abstract: The most pressing problems in science are neither empirical nor theoretical, but infrastructural. Scientific practice is defined by coproductive, mutually reinforcing infrastructural deficits and incentive systems that everywhere constrain and contort our art of curiosity in service of profit and prestige. Our infrastructural problems are not unique to science, but reflective of the broader logic of digital enclosure where platformatized control of information production and extraction fuels some of the largest corporations in the world. I have taken lessons learned from decades of intertwined digital cultures within and beyond academia like wikis, pirates, and librarians in order to draft a path towards more liberatory infrastructures for both science and society. Based on a system of peer-to-peer linked data, I sketch interoperable systems for shared data, tools, and knowledge that map onto three domains of platform capture: storage, computation and communication. The challenge of infrastructure is not solely technical, but also social and cultural, and so I attempt to ground a practical development blueprint in an ethics for organizing and maintaining it. I intend this draft as a rallying call for organization, to be revised with the input of collaborators and through the challenges posed by its implementation. I argue that a more liberatory future for science is neither utopian nor impractical -- the truly impractical choice is to continue to organize science as prestige fiefdoms resting on a pyramid scheme of underpaid labor, playing out the clock as every part of our work is swallowed whole by circling information conglomerates. It was arguably scientists looking for a better way to communicate that created something as radical as the internet in the first place, and I believe we can do it again.


title: Hierarchical Attention Network for Explainable Depression Detection on Twitter Aided by Metaphor Concept Mappings

abstract: Automatic depression detection on Twitter can help individuals privately and conveniently understand their mental health status in the early stages before seeing mental health professionals. Most existing black-box-like deep learning methods for depression detection largely focused on improving classification performance. However, explaining model decisions is imperative in health research because decision-making can often be high-stakes and life-and-death. Reliable automatic diagnosis of mental health problems including depression should be supported by credible explanations justifying models' predictions. In this work, we propose a novel explainable model for depression detection on Twitter. It comprises a novel encoder combining hierarchical attention mechanisms and feed-forward neural networks. To support psycholinguistic studies, our model leverages metaphorical concept mappings as input. Thus, it not only detects depressed individuals, but also identifies features of such users' tweets and associated metaphor concept mappings.


title: A Jacobian Criterion for Artin $v$-stacks

abstract: We prove a generalization of the Jacobian criterion of Fargues-Scholze for spaces of sections of a smooth quasi-projective variety over the Fargues-Fontaine curve. Namely, we show how to use their criterion to deduce an analogue for spaces of sections of a smooth Artin stack over the (schematic) Fargues-Fontaine curve obtained by taking the stack quotient of a smooth quasi-projective variety by the action of a linear algebraic group. As an application, we show various moduli stacks appearing in the Fargues-Scholze geometric Langlands program are cohomologically smooth Artin $v$-stacks and compute their $\ell$-dimensions.


title: Unsupervised Opinion Summarization Using Approximate Geodesics

abstract: Opinion summarization is the task of creating summaries capturing popular opinions from user reviews. In this paper, we introduce Geodesic Summarizer (GeoSumm), a novel system to perform unsupervised extractive opinion summarization. GeoSumm involves an encoder-decoder based representation learning model, that generates representations of text as a distribution over latent semantic units. GeoSumm generates these representations by performing dictionary learning over pre-trained text representations at multiple decoder layers. We then use these representations to quantify the relevance of review sentences using a novel approximate geodesic distance based scoring mechanism. We use the relevance scores to identify popular opinions in order to compose general and aspect-specific summaries. Our proposed model, GeoSumm, achieves state-of-the-art performance on three opinion summarization datasets. We perform additional experiments to analyze the functioning of our model and showcase the generalization ability of {\X} across different domains.


title: Zermelo-Fraenkel Axioms, Internal Classes, External Sets

abstract: Usual math sets have special types: countable, compact, open, occasionally Borel, rarely projective, etc. They have finite "depth": are described by a single Set Theory formula with variables ranging over objects unrelated to math formulas. Exotic expressions referring to sets with no depth limit or to Powerset axiom appear mostly in esoteric or foundational studies. Recognizing internal to math (formula-specified) and external (based on parameters in those formulas) aspects of math objects greatly simplifies foundations. I postulate external sets (not internally specified, treated as the domain of variables) to be hereditarily countable and independent of formula-defined classes, i.e. with finite Kolmogorov Information about them. This allows elimination of all non-integer quantifiers in Set Theory statements.


title: Detecting Synthetic Speech Manipulation in Real Audio Recordings

abstract: Recent advances in artificial speech and audio technologies have improved the abilities of deep-fake operators to falsify media and spread malicious misinformation. Anyone with limited coding skills can use freely available speech synthesis tools to create convincing simulations of influential speakers' voices with the malicious intent to distort the original message. With the latest technology, malicious operators do not have to generate an entire audio clip; instead, they can insert a partial manipulation or a segment of synthetic speech into a genuine audio recording to change the entire context and meaning of the original message. Detecting these insertions is especially challenging because partially manipulated audio can more easily avoid synthetic speech detectors than entirely fake messages can. This paper describes a potential partial synthetic speech detection system based on the x-ResNet architecture with a probabilistic linear discriminant analysis (PLDA) backend and interleaved aware score processing. Experimental results suggest that the PLDA backend results in a 25% average error reduction among partially synthesized datasets over a non-PLDA baseline.


title: DiP-GNN: Discriminative Pre-Training of Graph Neural Networks

abstract: Graph neural network (GNN) pre-training methods have been proposed to enhance the power of GNNs. Specifically, a GNN is first pre-trained on a large-scale unlabeled graph and then fine-tuned on a separate small labeled graph for downstream applications, such as node classification. One popular pre-training method is to mask out a proportion of the edges, and a GNN is trained to recover them. However, such a generative method suffers from graph mismatch. That is, the masked graph inputted to the GNN deviates from the original graph. To alleviate this issue, we propose DiP-GNN (Discriminative Pre-training of Graph Neural Networks). Specifically, we train a generator to recover identities of the masked edges, and simultaneously, we train a discriminator to distinguish the generated edges from the original graph's edges. In our framework, the graph seen by the discriminator better matches the original graph because the generator can recover a proportion of the masked edges. Extensive experiments on large-scale homogeneous and heterogeneous graphs demonstrate the effectiveness of the proposed framework.


title: Leveraging cross-correlations and linear covariance-based filtering for line-intensity map reconstructions at linear scales

abstract: We explore the possible application of linear covariance-based (LCB) filtering to line-intensity mapping (LIM) signal reconstructions. Originally introduced for reconstruction of the integrated Sachs-Wolfe effect in the cosmic microwave background, the LCB filter is an optimal map estimator that extends the simple Wiener filter by leveraging external correlated data. Given a detectable strong LIM-galaxy or LIM-LIM cross power spectrum, we show recovery of high-redshift, large-scale line-intensity fluctuations -- even in the presence of bright interloper emission -- in simulations of a futuristic [C II] LIM survey as well as simulated future iterations of the CO Mapping Array Project (COMAP). With sufficient galaxy abundances or low LIM survey noise, normalised cross-correlation between the LCB reconstruction and the true signal reaches 70-90% on large, linear comoving scales corresponding to $k\sim0.1$ Mpc$^{-1}$. This suggests the possible use of such signal reconstructions in astrophysical or cosmological contexts that require identifying the locations of line emissivity peaks and voids, although clear shortcomings exist on smaller scales. The successful application of the LCB filter in simulated LIM contexts highlights the importance of cross-correlations to studies of the reionising and reionised high-redshift universe with LIM and other large-scale structure surveys.