title: MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graph

abstract: Recent years have seen a rapid growth of utilizing graph neural networks (GNNs) in the biomedical domain for tackling drug-related problems. However, like any other deep architectures, GNNs are data hungry. While requiring labels in real world is often expensive, pretraining GNNs in an unsupervised manner has been actively explored. Among them, graph contrastive learning, by maximizing the mutual information between paired graph augmentations, has been shown to be effective on various downstream tasks. However, the current graph contrastive learning framework has two limitations. First, the augmentations are designed for general graphs and thus may not be suitable or powerful enough for certain domains. Second, the contrastive scheme only learns representations that are invariant to local perturbations and thus does not consider the global structure of the dataset, which may also be useful for downstream tasks. Therefore, in this paper, we study graph contrastive learning in the context of biomedical domain, where molecular graphs are present. We propose a novel framework called MoCL, which utilizes domain knowledge at both local- and global-level to assist representation learning. The local-level domain knowledge guides the augmentation process such that variation is introduced without changing graph semantics. The global-level knowledge encodes the similarity information between graphs in the entire dataset and helps to learn representations with richer semantics. The entire model is learned through a double contrast objective. We evaluate MoCL on various molecular datasets under both linear and semi-supervised settings and results show that MoCL achieves state-of-the-art performance.


title: Random Forest classifier for EEG-based seizure prediction

abstract: Epileptic seizure prediction has gained considerable interest in the computational Epilepsy research community. This paper presents a Machine Learning based method for epileptic seizure prediction which outperforms state-of-the art methods. We compute a probability for a given epoch, of being pre-ictal against interictal using the Random Forest classifier and introduce new concepts to enhance the robustness of the algorithm to false alarms. We assessed our method on 20 patients of the benchmark scalp EEG CHB-MIT dataset for a seizure prediction horizon (SPH) of 5 minutes and a seizure occurrence period (SOP) of 30 minutes. Our approach achieves a sensitivity of 82.07 % and a low false positive rate (FPR) of 0.0799 /h. We also tested our approach on intracranial EEG recordings.


title: Designing Toxic Content Classification for a Diversity of Perspectives

abstract: In this work, we demonstrate how existing classifiers for identifying toxic comments online fail to generalize to the diverse concerns of Internet users. We survey 17,280 participants to understand how user expectations for what constitutes toxic content differ across demographics, beliefs, and personal experiences. We find that groups historically at-risk of harassment - such as people who identify as LGBTQ+ or young adults - are more likely to to flag a random comment drawn from Reddit, Twitter, or 4chan as toxic, as are people who have personally experienced harassment in the past. Based on our findings, we show how current one-size-fits-all toxicity classification algorithms, like the Perspective API from Jigsaw, can improve in accuracy by 86% on average through personalized model tuning. Ultimately, we highlight current pitfalls and new design directions that can improve the equity and efficacy of toxic content classifiers for all users.


title: Formal Verification of a Map Merging Protocol in the Multi-Agent Programming Contest

abstract: Communication is a critical part of enabling multi-agent systems to cooperate. This means that applying formal methods to protocols governing communication within multi-agent systems provides useful confidence in its reliability. In this paper, we describe the formal verification of a complex communication protocol that coordinates agents merging maps of their environment. The protocol was used by the LFC team in the 2019 edition of the Multi-Agent Programming Contest (MAPC). Our specification of the protocol is written in Communicating Sequential Processes (CSP), which is a well-suited approach to specifying agent communication protocols due to its focus on concurrent communicating systems. We validate the specification's behaviour using scenarios where the correct behaviour is known, and verify that eventually all the maps have merged.


title: Identifying Linked Fraudulent Activities Using GraphConvolution Network

abstract: In this paper, we present a novel approach to identify linked fraudulent activities or actors sharing similar attributes, using Graph Convolution Network (GCN). These linked fraudulent activities can be visualized as graphs with abstract concepts like relationships and interactions, which makes GCNs an ideal solution to identify the graph edges which serve as links between fraudulent nodes. Traditional approaches like community detection require strong links between fraudulent attempts like shared attributes to find communities and the supervised solutions require large amount of training data which may not be available in fraud scenarios and work best to provide binary separation between fraudulent and non fraudulent activities. Our approach overcomes the drawbacks of traditional methods as GCNs simply learn similarities between fraudulent nodes to identify clusters of similar attempts and require much smaller dataset to learn. We demonstrate our results on linked accounts with both strong and weak links to identify fraud rings with high confidence. Our results outperform label propagation community detection and supervised GBTs algorithms in terms of solution quality and computation time.


title: GearV: A Two-Gear Hypervisor for Mixed-Criticality IoT Systems

abstract: This paper presents GearV, a two-gear lightweight hypervisor architecture to address the some known challenges. By dividing hypervisor into some partitions, and dividing scheduling policies into Gear1 and Gear2 respectively, GearV creates a consolidated platform to run best-effort system and safety-critical system simultaneously with managed engineering effort. The two-gears architecture also simplifies retrofitting the virtualization systems. We believe that GearV can serves as a reasonable hypervisor architecture for the mix-critical IoT systems.


title: Surveillance of COVID-19 Pandemic using Social Media: A Reddit Study in North Carolina

abstract: Coronavirus disease (COVID-19) pandemic has changed various aspects of people's lives and behaviors. At this stage, there are no other ways to control the natural progression of the disease than adopting mitigation strategies such as wearing masks, watching distance, and washing hands. Moreover, at this time of social distancing, social media plays a key role in connecting people and providing a platform for expressing their feelings. In this study, we tap into social media to surveil the uptake of mitigation and detection strategies, and capture issues and concerns about the pandemic. In particular, we explore the research question, "how much can be learned regarding the public uptake of mitigation strategies and concerns about COVID-19 pandemic by using natural language processing on Reddit posts?" After extracting COVID-related posts from the four largest subreddit communities of North Carolina over six months, we performed NLP-based preprocessing to clean the noisy data. We employed a custom Named-entity Recognition (NER) system and a Latent Dirichlet Allocation (LDA) method for topic modeling on a Reddit corpus. We observed that 'mask', 'flu', and 'testing' are the most prevalent named-entities for "Personal Protective Equipment", "symptoms", and "testing" categories, respectively. We also observed that the most discussed topics are related to testing, masks, and employment. The mitigation measures are the most prevalent theme of discussion across all subreddits.


title: Launchpad: A Programming Model for Distributed Machine Learning Research

abstract: A major driver behind the success of modern machine learning algorithms has been their ability to process ever-larger amounts of data. As a result, the use of distributed systems in both research and production has become increasingly prevalent as a means to scale to this growing data. At the same time, however, distributing the learning process can drastically complicate the implementation of even simple algorithms. This is especially problematic as many machine learning practitioners are not well-versed in the design of distributed systems, let alone those that have complicated communication topologies. In this work we introduce Launchpad, a programming model that simplifies the process of defining and launching distributed systems that is specifically tailored towards a machine learning audience. We describe our framework, its design philosophy and implementation, and give a number of examples of common learning algorithms whose designs are greatly simplified by this approach.


title: Assessing Open Interfaces and Protocols of PLCs for Computation Offloading at Field Level

abstract: Programmable logic controllers (PLCs) are the core element of industrial plants in todays deployments. They read sensor values, execute control algorithms, and write output values. Furthermore, industrial plants have lifetimes of one or more decades. Thus, in a realistic Industry 4.0 scenario, these devices have to be integrated in novel systems. In order to apply advanced concepts and technologies, such as computation offloading, which requires data exchange between PLCs and edge cloud, we investigate open communication interfaces of two typical PLCs of Siemens S7 series. Hence, each of the interfaces is analyzed based on plug & play capability, if metadata is provided, protocol efficiency, and performance. For the latter, the smallest possible update time for each of the interfaces will be measured.


title: Options on Bonds: Implied Volatilities from Affine Short-Rate Dynamics

abstract: We derive an explicit asymptotic approximation for the implied volatilities of Call options written on bonds assuming the short-rate is described by an affine short-rate model. For specific affine short-rate models, we perform numerical experiments in order to gauge the accuracy of our approximation.


title: Positive bound states to nonlinear Choquard equations in the presence of nonsymmetric potentials

abstract: The existence of a positive solution to a class of Choquard equations with potential going at a positive limit at infinity possibly from above or oscillating is proved. Our results include the physical case and do not require any symmetry assumptions on the potential.


title: MVT: Mask Vision Transformer for Facial Expression Recognition in the wild

abstract: Facial Expression Recognition (FER) in the wild is an extremely challenging task in computer vision due to variant backgrounds, low-quality facial images, and the subjectiveness of annotators. These uncertainties make it difficult for neural networks to learn robust features on limited-scale datasets. Moreover, the networks can be easily distributed by the above factors and perform incorrect decisions. Recently, vision transformer (ViT) and data-efficient image transformers (DeiT) present their significant performance in traditional classification tasks. The self-attention mechanism makes transformers obtain a global receptive field in the first layer which dramatically enhances the feature extraction capability. In this work, we first propose a novel pure transformer-based mask vision transformer (MVT) for FER in the wild, which consists of two modules: a transformer-based mask generation network (MGN) to generate a mask that can filter out complex backgrounds and occlusion of face images, and a dynamic relabeling module to rectify incorrect labels in FER datasets in the wild. Extensive experimental results demonstrate that our MVT outperforms state-of-the-art methods on RAF-DB with 88.62%, FERPlus with 89.22%, and AffectNet-7 with 64.57%, respectively, and achieves a comparable result on AffectNet-8 with 61.40%.


title: An App for the Discovery of Properties of Poncelet Triangles

abstract: We describe a newly-developed, free, browser-based application, for the interactive exploration of the dynamic geometry of Poncelet families of triangles. The main focus is on responsive display of the beauteous loci of centers of such families, refreshing them smoothly upon any changes in simulation parameters. The app informs the user when curves swept are conics and reports if certain metric quantities are conserved. Live simulations can be easily shared via a URL. A list of more than 400 pre-made experiments is included which can be regarded as conjectures and/or exercises. Millions of experiment combinations are possible.


title: Self Similar Properties of Avalanche Statistics in a Simple Turbulent Model

abstract: In this paper, we consider a simplified model of turbulence for large Reynolds numbers driven by a constant power energy input on large scales. In the statistical stationary regime, the behaviour of the kinetic energy is characterised by two well defined phases: a laminar phase where the kinetic energy grows linearly for a (random) time $t_w$ followed by abrupt avalanche-like energy drops of sizes $S$ due to strong intermittent fluctuations of energy dissipation. We study the probability distribution $P[t_w]$ and $P[S]$ which both exhibit a quite well defined scaling behaviour. Although $t_w$ and $S$ are not statistically correlated, we suggest and numerically checked that their scaling properties are related based on a simple, but non trivial, scaling argument. We propose that the same approach can be used for other systems showing avalanche-like behaviour such as amorphous solids and seismic events.


title: Near-squares in binary recurrence sequences

abstract: We call an integer a \emph{near-square} if its absolute value is a square or a prime times a square. We investigate such near-squares in the binary recurrence sequences defined for integers $a \geq 3$ by $u_{0}(a)=0$, $u_{1}(a)=1$ and $u_{n+2}(a)=au_{n+1}(a)-u_{n}(a)$ for $n \geq 0$. We show that for a given $a \geq 3$, there is at most one $n \geq 5$ such that $u_{n}(a)$ is a near-square. With the exceptions of $u_{6}(3)=12^{2}$ and $u_{7}(6)=239 \cdot 13^{2}$, any such $u_{n}(a)$ can only be a near-square if $a \equiv 2 \bmod 4$, $n \equiv 3 \bmod 4$ is prime and $n \geq 19$. This is part of a more general phenomenon regarding near-squares in non-degenerate recurrence sequences defined for integers $a$ and $b=-b_{1}^{2}$ by $u_{0}(a,b)=0$, $u_{1}(a,b)=1$ and $u_{n+2}(a,b)=au_{n+1}(a,b)+bu_{n}(a,b)$ for $n \geq 0$ (see our Conjecture 1.1). It arises from a new Aurifeuillean-like factorization of elements of recurrence sequences that we have discovered (see relation (1.1)).


title: A factor matching of optimal tail between Poisson processes

abstract: Consider two independent Poisson point processes of unit intensity in the Euclidean space of dimension $d$ at least 3. We construct a perfect matching between the two point sets that is a factor (i.e., an equivariant measurable function of the point configurations), and with the property that the distance between a configuration point and its pair has a tail distribution that decays as fast as possible, namely, as $b\exp (-cr^d)$ with suitable constants $b,c>0$. Our proof relies on two earlier results: an allocation rule of similar tail for a Poisson point process, and a recent theorem that enables one to obtain perfect matchings from fractional perfect matchings in our setup.


title: A critical look at the current train/test split in machine learning

abstract: The randomized or cross-validated split of training and testing sets has been adopted as the gold standard of machine learning for decades. The establishment of these split protocols are based on two assumptions: (i)-fixing the dataset to be eternally static so we could evaluate different machine learning algorithms or models; (ii)-there is a complete set of annotated data available to researchers or industrial practitioners. However, in this article, we intend to take a closer and critical look at the split protocol itself and point out its weakness and limitation, especially for industrial applications. In many real-world problems, we must acknowledge that there are numerous situations where assumption (ii) does not hold. For instance, for interdisciplinary applications like drug discovery, it often requires real lab experiments to annotate data which poses huge costs in both time and financial considerations. In other words, it can be very difficult or even impossible to satisfy assumption (ii). In this article, we intend to access this problem and reiterate the paradigm of active learning, and investigate its potential on solving problems under unconventional train/test split protocols. We further propose a new adaptive active learning architecture (AAL) which involves an adaptation policy, in comparison with the traditional active learning that only unidirectionally adds data points to the training pool. We primarily justify our points by extensively investigating an interdisciplinary drug-protein binding problem. We additionally evaluate AAL on more conventional machine learning benchmarking datasets like CIFAR-10 to demonstrate the generalizability and efficacy of the new framework.


title: A window on infrared QCD with small expansion parameters

abstract: Lattice simulations of the QCD correlation functions in the Landau gauge have established two remarkable facts. First, the coupling constant in the gauge sector remains finite and moderate at all scales, suggesting that some kind of perturbative description should be valid down to infrared momenta. Second, the gluon propagator reaches a finite nonzero value at vanishing momentum, corresponding to a gluon screening mass. We review recent studies which aim at describing the long-distance properties of Landau gauge QCD by means of the perturbative Curci-Ferrari model. The latter is the simplest deformation of the Faddeev-Popov Lagrangian in the Landau gauge that includes a gluon screening mass at tree-level. There are, by now, strong evidences that this approach successfully describes many aspects of the infrared QCD dynamics. In particular, several correlation functions were computed at one- and two-loop orders and compared with {\it ab-initio} lattice simulations. The typical error is of the order of ten percent for a one-loop calculation and drops to few percents at two loops. We review such calculations in the quenched approximation as well as in the presence of dynamical quarks. In the latter case, the spontaneous breaking of the chiral symmetry requires to go beyond a coupling expansion but can still be described in a controlled approximation scheme in terms of small parameters. We also review applications of the approach to nonzero temperature and chemical potential.


title: LaplaceNet: A Hybrid Graph-Energy Neural Network for Deep Semi-Supervised Classification

abstract: Semi-supervised learning has received a lot of recent attention as it alleviates the need for large amounts of labelled data which can often be expensive, requires expert knowledge and be time consuming to collect. Recent developments in deep semi-supervised classification have reached unprecedented performance and the gap between supervised and semi-supervised learning is ever-decreasing. This improvement in performance has been based on the inclusion of numerous technical tricks, strong augmentation techniques and costly optimisation schemes with multi-term loss functions. We propose a new framework, LaplaceNet, for deep semi-supervised classification that has a greatly reduced model complexity. We utilise a hybrid approach where pseudolabels are produced by minimising the Laplacian energy on a graph. These pseudo-labels are then used to iteratively train a neural-network backbone. Our model outperforms state-of-the art methods for deep semi-supervised classification, over several benchmark datasets. Furthermore, we consider the application of strong-augmentations to neural networks theoretically and justify the use of a multi-sampling approach for semi-supervised learning. We demonstrate, through rigorous experimentation, that a multi-sampling augmentation approach improves generalisation and reduces the sensitivity of the network to augmentation.


title: Modeling of Particle Transport, Neutrals and Radiation in Magnetically-Confined Plasmas with Aurora

abstract: We present Aurora, an open-source package for particle transport, neutrals and radiation modeling in magnetic confinement fusion plasmas. Aurora's modern multi-language interface enables simulations of 1.5D impurity transport within high-performance computing frameworks, particularly for the inference of particle transport coefficients. A user-friendly Python library allows simple interaction with atomic rates from the Atomic Data and Atomic Structure database as well as other sources. This enables a range of radiation predictions, both for power balance and spectroscopic analysis. We discuss here the superstaging approximation for complex ions, as a way to group charge states and reduce computational cost, demonstrating its wide applicability within the Aurora forward model and beyond. Aurora also facilitates neutral particle analysis, both from experimental spectroscopic data and other simulation codes. Leveraging Aurora's capabilities to interface SOLPS-ITER results, we demonstrate that charge exchange is unlikely to affect the total radiated power from the ITER core during high performance operation. Finally, we describe the ImpRad module in the OMFIT framework, developed to enable experimental analysis and transport inferences on multiple devices using Aurora.

categories: physics.plasm-ph physics.app-ph physics.comp-ph physics.data-an


title: Distance and extinction to the Milky Way spiral arms along the Galactic centre line of sight

abstract: The position of the Sun inside the Milky Way's disc hampers the study of the spiral arm structure. We aim to analyse the spiral arms along the line-of-sight towards the Galactic centre (GC) to determine their distance, extinction, and stellar population. We use the GALACTICNUCLEUS survey, a JHKs high angular resolution photometric catalogue (0.2") for the innermost regions of the Galaxy. We fitted simple synthetic colour-magnitude models to our data via $\chi^2$ minimisation. We computed the distance and extinction to the detected spiral arms. We also analysed the extinction curve and the relative extinction between the detected features. Finally, we built extinction-corrected Ks luminosity functions (KLFs) to study the stellar populations present in the second and third spiral arm features. We determined the mean distances to the spiral arms: $d1=1.6\pm0.2$, $d2=2.6\pm0.2$, $d3=3.9\pm0.3$, and $d4=4.5\pm0.2$ kpc, and the mean extinctions: $A_{H1}=0.35\pm0.08$, $A_{H2}=0.77\pm0.08$, $A_{H3}=1.68\pm0.08$, and $A_{H4}=2.30\pm0.08$ mag. We analysed the extinction curve in the near infrared for the stars in the spiral arms and found mean values of $A_J/A_{H}=1.89\pm0.11$ and $A_H/A_{K_s}=1.86\pm0.11$, in agreement with the results obtained for the GC. This implies that the shape of the extinction curve does not depend on distance or absolute extinction. We also built extinction maps for each spiral arm and obtained that they are homogeneous and might correspond to independent extinction layers. Finally, analysing the KLFs from the second and the third spiral arms, we found that they have similar stellar populations. We obtained two main episodes of star formation: $>6$ Gyr ($\sim60-70\%$ of the stellar mass), and $1.5-4$ Gyr ($\sim20-30\%$ of the stellar mass), compatible with previous work. We also detected recent star formation at a lower level ($\sim10\%$) for the third spiral arm.


title: Learning from Multiple Noisy Partial Labelers

abstract: Programmatic weak supervision creates models without hand-labeled training data by combining the outputs of heuristic labelers. Existing frameworks make the restrictive assumption that labelers output a single class label. Enabling users to create partial labelers that output subsets of possible class labels would greatly expand the expressivity of programmatic weak supervision. We introduce this capability by defining a probabilistic generative model that can estimate the underlying accuracies of multiple noisy partial labelers without ground truth labels. We show how to scale up learning, for example learning on 100k examples in one minute, a 300x speed up compared to a naive implementation. We also prove that this class of models is generically identifiable up to label swapping under mild conditions. We evaluate our framework on three text classification and six object classification tasks. On text tasks, adding partial labels increases average accuracy by 8.6 percentage points. On image tasks, we show that partial labels allow us to approach some zero-shot object classification problems with programmatic weak supervision by using class attributes as partial labelers. On these tasks, our framework has accuracy comparable to recent embedding-based zero-shot learning methods, while using only pre-trained attribute detectors.


title: RobustNav: Towards Benchmarking Robustness in Embodied Navigation

abstract: As an attempt towards assessing the robustness of embodied navigation agents, we propose RobustNav, a framework to quantify the performance of embodied navigation agents when exposed to a wide variety of visual - affecting RGB inputs - and dynamics - affecting transition dynamics - corruptions. Most recent efforts in visual navigation have typically focused on generalizing to novel target environments with similar appearance and dynamics characteristics. With RobustNav, we find that some standard embodied navigation agents significantly underperform (or fail) in the presence of visual or dynamics corruptions. We systematically analyze the kind of idiosyncrasies that emerge in the behavior of such agents when operating under corruptions. Finally, for visual corruptions in RobustNav, we show that while standard techniques to improve robustness such as data-augmentation and self-supervised adaptation offer some zero-shot resistance and improvements in navigation performance, there is still a long way to go in terms of recovering lost performance relative to clean "non-corrupt" settings, warranting more research in this direction. Our code is available at https://github.com/allenai/robustnav


title: The two-sphere partition function in two-dimensional quantum gravity at fixed area

abstract: We discuss two-dimensional quantum gravity coupled to conformal matter and fixed area in a semiclassical large and negative matter central charge limit. In this setup the gravity theory -- otherwise highly fluctuating -- admits a round two-sphere saddle. We discuss the two-sphere partition function up to two-loop order from the path integral perspective. This amounts to studying Feynman diagrams incorporating the fixed area constraint on the round two-sphere. In particular we find that all ultraviolet divergences cancel to this order. We compare our results with the two-sphere partition function obtained from the DOZZ formula.


title: Chasing Sparsity in Vision Transformers: An End-to-End Exploration

abstract: Vision transformers (ViTs) have recently received explosive popularity, but their enormous model sizes and training costs remain daunting. Conventional post-training pruning often incurs higher training budgets. In contrast, this paper aims to trim down both the training memory overhead and the inference complexity, without sacrificing the achievable accuracy. We carry out the first-of-its-kind comprehensive exploration, on taking a unified approach of integrating sparsity in ViTs "from end to end". Specifically, instead of training full ViTs, we dynamically extract and train sparse subnetworks, while sticking to a fixed small parameter budget. Our approach jointly optimizes model parameters and explores connectivity throughout training, ending up with one sparse network as the final output. The approach is seamlessly extended from unstructured to structured sparsity, the latter by considering to guide the prune-and-grow of self-attention heads inside ViTs. We further co-explore data and architecture sparsity for additional efficiency gains by plugging in a novel learnable token selector to adaptively determine the currently most vital patches. Extensive results on ImageNet with diverse ViT backbones validate the effectiveness of our proposals which obtain significantly reduced computational cost and almost unimpaired generalization. Perhaps most surprisingly, we find that the proposed sparse (co-)training can sometimes improve the ViT accuracy rather than compromising it, making sparsity a tantalizing "free lunch". For example, our sparsified DeiT-Small at (5%, 50%) sparsity for (data, architecture), improves 0.28% top-1 accuracy, and meanwhile enjoys 49.32% FLOPs and 4.40% running time savings. Our codes are available at https://github.com/VITA-Group/SViTE.


title: High moment and pathwise error estimates for fully discrete mixed finite element approximations of the Stochastic Stokes Equations with Multiplicative Noises

abstract: This paper is concerned with high moment and pathwise error estimates for both velocity and pressure approximations of the Euler-Maruyama scheme for time discretization and its two fully discrete mixed finite element discretizations. The main idea for deriving the high moment error estimates for the velocity approximation is to use a bootstrap technique starting from the second moment error estimate. The pathwise error estimate, which is sub-optimal in the energy norm, is obtained by using Kolmogorov's theorem based on the high moment error estimates. Unlike for the velocity error estimate, the higher moment and pathwise error estimates for the pressure approximation are derived in a time-averaged norm. In addition, the impact of noise types on the rates of convergence for both velocity and pressure approximations is also addressed.


title: From center-vortex ensembles to the confining flux tube

abstract: In this review, we discuss the present status of the description of confining flux tubes in SU(N) pure Yang-Mills theory in terms of ensembles of percolating center vortices. This is based on three main pillars: modelling in the continuum the ensemble components detected in the lattice, the derivation of effective field representations, and contrasting the associated properties with Monte Carlo lattice results. The integration of the present knowledge about these points is essential to get closer to a unified physical picture for confinement. Here, we shall emphasize the last advances, which point to the importance of including the nonoriented center-vortex component and non-Abelian degrees when modelling the center-vortex ensemble measure. These inputs are responsible for the emergence of topological solitons and the possibility of accommodating the asymptotic scaling properties of the confining string tension.


title: TOI-1278 B: SPIRou unveils a rare Brown Dwarf Companion in Close-In Orbit around an M dwarf

abstract: We present the discovery of an $18.5\pm0.5$M$_{\rm Jup}$ brown dwarf (BD) companion to the M0V star TOI-1278. The system was first identified through a percent-deep transit in TESS photometry; further analysis showed it to be a grazing transit of a Jupiter-sized object. Radial velocity (RV) follow-up with the SPIRou near-infrared high-resolution velocimeter and spectropolarimeter in the framework of the 300-night SPIRou Legacy Survey (SLS) carried out at the Canada-France-Hawaii Telescope (CFHT) led to the detection of a Keplerian RV signal with a semi-amplitude of $2306\pm10$ m/s in phase with the 14.5-day transit period, having a slight but non-zero eccentricity. The intermediate-mass ratio ($M_\star/M_{\rm{comp}} \sim31$) is unique for having such a short separation ($0.095\pm0.001$ AU) among known M-dwarf systems. Interestingly, M dwarf-brown dwarf systems with similar mass ratios exist with separations of tens to thousands of AUs.


title: Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks

abstract: Deep neural networks are powerful machines for visual pattern recognition, but reasoning tasks that are easy for humans may still be difficult for neural models. Humans possess the ability to extrapolate reasoning strategies learned on simple problems to solve harder examples, often by thinking for longer. For example, a person who has learned to solve small mazes can easily extend the very same search techniques to solve much larger mazes by spending more time. In computers, this behavior is often achieved through the use of algorithms, which scale to arbitrarily hard problem instances at the cost of more computation. In contrast, the sequential computing budget of feed-forward neural networks is limited by their depth, and networks trained on simple problems have no way of extending their reasoning to accommodate harder problems. In this work, we show that recurrent networks trained to solve simple problems with few recurrent steps can indeed solve much more complex problems simply by performing additional recurrences during inference. We demonstrate this algorithmic behavior of recurrent networks on prefix sum computation, mazes, and chess. In all three domains, networks trained on simple problem instances are able to extend their reasoning abilities at test time simply by "thinking for longer."


title: What Makes Multi-modal Learning Better than Single (Provably)

abstract: The world provides us with data of multiple modalities. Intuitively, models fusing data from different modalities outperform their uni-modal counterparts, since more information is aggregated. Recently, joining the success of deep learning, there is an influential line of work on deep multi-modal learning, which has remarkable empirical results on various applications. However, theoretical justifications in this field are notably lacking. Can multi-modal learning provably perform better than uni-modal? In this paper, we answer this question under a most popular multi-modal fusion framework, which firstly encodes features from different modalities into a common latent space and seamlessly maps the latent representations into the task space. We prove that learning with multiple modalities achieves a smaller population risk than only using its subset of modalities. The main intuition is that the former has a more accurate estimate of the latent space representation. To the best of our knowledge, this is the first theoretical treatment to capture important qualitative phenomena observed in real multi-modal applications from the generalization perspective. Combining with experiment results, we show that multi-modal learning does possess an appealing formal guarantee.


title: The diagonal of quartic fivefolds

abstract: We show that a very general quartic hypersurface in $\mathbb P^6 $ over a field of characteristic different from 2 does not admit a decomposition of the diagonal, hence is not retract rational. This generalizes a result of Nicaise--Ottem, who showed stable irrationality over fields of characteristic 0. To prove our result, we introduce a new cycle-theoretic obstruction that may be seen as an analogue of the motivic obstruction for rationality in characteristic zero, introduced by Nicaise--Shinder and Kontsevich--Tschinkel.


title: Object Based Attention Through Internal Gating

abstract: Object-based attention is a key component of the visual system, relevant for perception, learning, and memory. Neurons tuned to features of attended objects tend to be more active than those associated with non-attended objects. There is a rich set of models of this phenomenon in computational neuroscience. However, there is currently a divide between models that successfully match physiological data but can only deal with extremely simple problems and models of attention used in computer vision. For example, attention in the brain is known to depend on top-down processing, whereas self-attention in deep learning does not. Here, we propose an artificial neural network model of object-based attention that captures the way in which attention is both top-down and recurrent. Our attention model works well both on simple test stimuli, such as those using images of handwritten digits, and on more complex stimuli, such as natural images drawn from the COCO dataset. We find that our model replicates a range of findings from neuroscience, including attention-invariant tuning, inhibition of return, and attention-mediated scaling of activity. Understanding object based attention is both computationally interesting and a key problem for computational neuroscience.


title: Pseudo-Bounces vs. New Instantons

abstract: Some false vacua do not decay via bounces. This usually happens when a flat direction of the tunneling action due to scale invariance is lifted to a sloping valley by a scale breaking perturbation, pushing the bounce off to infinity. We compare two types of alternative decay configurations that have been proposed recently to describe decay in such cases: pseudo-bounces and new instantons. Although both field configurations are quite similar, we find that the pseudo-bounce action is lower than the new instanton one and describes more faithfully the bottom of the action valley. In addition, pseudo-bounces cover a range of field space wider than new instantons and, as a result, lead to an action that can be lower than the one for new instantons by orders of magnitude.


title: Spatial Bloch oscillations of a quantum gas in a "beat-note" superlattice

abstract: We report the experimental realization of a new kind of optical lattice for ultra-cold atoms where arbitrarily large separation between the sites can be achieved without renouncing to the stability of ordinary lattices. Two collinear lasers, with slightly different commensurate wavelengths and retroreflected on a mirror, generate a superlattice potential with a periodic "beat-note" profile where the regions with large amplitude modulation provide the effective potential minima for the atoms. To prove the analogy with a standard large spacing optical lattice we study Bloch oscillations of a Bose Einstein condensate with negligible interactions in the presence of a small force. The observed dynamics between sites separated by ten microns for times exceeding one second proves the high stability of the potential. This novel lattice is the ideal candidate for the coherent manipulation of atomic samples at large spatial separations and might find direct application in atom-based technologies like trapped atom interferometers and quantum simulators.


title: Hubble Expansion and Freeze-Out at RHIC-BES Energies from UrQMD

abstract: The freeze-out process in heavy ion collisions is driven by the competition between the scattering rate and the expansion rate of the matter. We analyse the expansion rate $\Theta$ (often called Hubble flow) in relativistic heavy ion collisions in the FAIR and RHIC-BES energy regimes and compare it to the scattering rate $\Gamma$ using the UrQMD transport model. We observe that the time evolution of the system is clearly separated into a compression phase and an expansion phase with time dependent $\Theta_\parallel$ and $\Theta_\perp$. The calculated values of the Hubble expansion at kinetic decoupling are in line with previous simple estimates by statistical hadronization models with a Siemens-Rasmussen type emission source. However, the actual shape of the expanding matter is, as expected, found to be between a spherically symmetric and a purely longitudinal expansion. We confirm for the first time in a microscopic simulation that the decoupling hypersurface is indeed determined by the competition of the expansion rate $\Theta$ and the scattering rate $\Gamma$ as suggested previously. This suggests that, in the range of collision energies explored in this study, simple iso-thermal/iso-energy density criteria that are often used in hybrid models to couple hydrodynamic and transport simulations may not capture the true decoupling hyper-surface.


title: Everettian mechanics with hyperfinitely many worlds

abstract: The present paper shows how one might model Everettian quantum mechanics using hyperfinitely many worlds. A hyperfinite model allows one to consider idealized measurements of observables with continuous-valued spectra where different outcomes are associated with possibly infinitesimal probabilities. One can also prove hyperfinite formulations of Everett's limiting relative-frequency and randomness properties, theorems he considered central to his formulation of quantum mechanics. This approach also provides a more general framework in which to consider no-collapse formulations of quantum mechanics more generally.


title: Optical and electrical properties of Nd3+doped Na2O-ZnO-TeO2 Material

abstract: Neodymium doped Na2O-ZnO-TeO2 (NZT) glasses were prepared by the conventional melt quenching technique. DTA and TG were used to confirmation of glass preparation through the glass transition temperature at 447{\deg}C for the glass system. The analysis of FTIR spectra and X-ray diffraction described the nature of the samples were ionic and amorphous respectively. The optical bandgap energy was estimated using absorption spectra and found to be decreased from 2.63eV to 1.32 eV due to the increase of doping concentration. The intensity of the emission spectra was enhanced for the higher concentration of Nd3+ ions. The dielectric constant of the glass samples was found to be constant for the large range of frequency (3 kHz to 1 MHz). The variation of conductivity with the temperature of the samples had shown the Arrhenius mechanism of conduction.


title: LEADS: Learning Dynamical Systems that Generalize Across Environments

abstract: When modeling dynamical systems from real-world data samples, the distribution of data often changes according to the environment in which they are captured, and the dynamics of the system itself vary from one environment to another. Generalizing across environments thus challenges the conventional frameworks. The classical settings suggest either considering data as i.i.d. and learning a single model to cover all situations or learning environment-specific models. Both are sub-optimal: the former disregards the discrepancies between environments leading to biased solutions, while the latter does not exploit their potential commonalities and is prone to scarcity problems. We propose LEADS, a novel framework that leverages the commonalities and discrepancies among known environments to improve model generalization. This is achieved with a tailored training formulation aiming at capturing common dynamics within a shared model while additional terms capture environment-specific dynamics. We ground our approach in theory, exhibiting a decrease in sample complexity with our approach and corroborate these results empirically, instantiating it for linear dynamics. Moreover, we concretize this framework for neural networks and evaluate it experimentally on representative families of nonlinear dynamics. We show that this new setting can exploit knowledge extracted from environment-dependent data and improves generalization for both known and novel environments. Code is available at https://github.com/yuan-yin/LEADS.


title: Automatic Generation of Machine Learning Synthetic Data Using ROS

abstract: Data labeling is a time intensive process. As such, many data scientists use various tools to aid in the data generation and labeling process. While these tools help automate labeling, many still require user interaction throughout the process. Additionally, most target only a few network frameworks. Any researchers exploring multiple frameworks must find additional tools orwrite conversion scripts. This paper presents an automated tool for generating synthetic data in arbitrary network formats. It uses Robot Operating System (ROS) and Gazebo, which are common tools in the robotics community. Through ROS paradigms, it allows extensive user customization of the simulation environment and data generation process. Additionally, a plugin-like framework allows the development of arbitrary data format writers without the need to change the main body of code. Using this tool, the authors were able to generate an arbitrarily large image dataset for three unique training formats using approximately 15 min of user setup time and a variable amount of hands-off run time, depending on the dataset size. The source code for this data generation tool is available at https://github.com/Navy-RISE-Lab/nn_data_collection


title: A feather on the hat: Tracing the giant stellar stream around the Sombrero galaxy

abstract: Recent evidence of extremely metal-rich stars found in the Sombrero galaxy (M104) halo suggests that this galaxy has undergone a recent major merger with a relatively massive galaxy. In this paper, we present wide-field deep images of the M104 outskirts obtained with a 18-cm amateur telescope with the purpose of detecting any coherent tidal features from this possible major merger. Our new data, together with a model of the M104 inner halo and scattered light from stars around the field, allow us to trace for the first time the full path of the stream on both sides of the disk of the galaxy. We fully characterize the ring-like tidal structure and we confirm that this is the only observable coherent substructure in the inner halo region. This result is in agreement with the hypothesis that M104 was created by a wet major merger more than 3.5 Gyr ago that heated up the stellar population, blurring all old substructure. We generated a set of numerical models that reproduce the formation of the observed tidal structure. Our best fit model suggests the formation of this stream in the last 3 Gyr is independent of the wet major merger that created the M104 system. Therefore, the formation of the tidal stream can put a constraint on the time when the major merger occurred.


title: KIGLIS: Smart Networks for Smart Cities

abstract: Smart cities will be characterized by a variety of intelligent and networked services, each with specific requirements for the underlying network infrastructure. While smart city architectures and services have been studied extensively, little attention has been paid to the network technology. The KIGLIS research project, consisting of a consortium of companies, universities and research institutions, focuses on artificial intelligence for optimizing fiber-optic networks of a smart city, with a special focus on future mobility applications, such as automated driving. In this paper, we present early results on our process of collecting smart city requirements for communication networks, which will lead towards reference infrastructure and architecture solutions. Finally, we suggest directions in which artificial intelligence will improve smart city networks.


title: DETReg: Unsupervised Pretraining with Region Priors for Object Detection

abstract: Recent self-supervised pretraining methods for object detection largely focus on pretraining the backbone of the object detector, neglecting key parts of detection architecture. Instead, we introduce DETReg, a new self-supervised method that pretrains the entire object detection network, including the object localization and embedding components. During pretraining, DETReg predicts object localizations to match the localizations from an unsupervised region proposal generator and simultaneously aligns the corresponding feature embeddings with embeddings from a self-supervised image encoder. We implement DETReg using the DETR family of detectors and show that it improves over competitive baselines when finetuned on COCO, PASCAL VOC, and Airbus Ship benchmarks. In low-data regimes DETReg achieves improved performance, e.g., when training with only 1% of the labels and in the few-shot learning settings.


title: The Eisenstein ideal of weight $k$ and ranks of Hecke algebras

abstract: Let $p$ and $\ell$ be primes such that $p > 3$ and $p \mid \ell-1$ and $k$ be an even integer. We use deformation theory of pseudo-representations to study the completion of the Hecke algebra acting on the space of cuspidal modular forms of weight $k$ and level $\Gamma_0(\ell)$ at the maximal Eisenstein ideal containing $p$. We give a necessary and sufficient condition for the $\mathbb{Z}_p$-rank of this Hecke algebra to be greater than $1$ in terms of vanishing of the cup products of certain global Galois cohomology classes. We also recover some of the results proven by Wake and Wang-Erickson for $k=2$ using our methods. In addition, we prove some $R=\mathbb{T}$ theorems under certain hypothesis.


title: Neural Speaker Embeddings for Ultrasound-based Silent Speech Interfaces

abstract: Articulatory-to-acoustic mapping seeks to reconstruct speech from a recording of the articulatory movements, for example, an ultrasound video. Just like speech signals, these recordings represent not only the linguistic content, but are also highly specific to the actual speaker. Hence, due to the lack of multi-speaker data sets, researchers have so far concentrated on speaker-dependent modeling. Here, we present multi-speaker experiments using the recently published TaL80 corpus. To model speaker characteristics, we adjusted the x-vector framework popular in speech processing to operate with ultrasound tongue videos. Next, we performed speaker recognition experiments using 50 speakers from the corpus. Then, we created speaker embedding vectors and evaluated them on the remaining speakers. Finally, we examined how the embedding vector influences the accuracy of our ultrasound-to-speech conversion network in a multi-speaker scenario. In the experiments we attained speaker recognition error rates below 3%, and we also found that the embedding vectors generalize nicely to unseen speakers. Our first attempt to apply them in a multi-speaker silent speech framework brought about a marginal reduction in the error rate of the spectral estimation step.


title: The planar limit of ${\cal N}=2$ chiral correlators

abstract: We derive the planar limit of 2- and 3-point functions of single-trace chiral primary operators of ${\cal N}=2$ SQCD on $S^4$, to all orders in the 't Hooft coupling. In order to do so, we first obtain a combinatorial expression for the planar free energy of a hermitian matrix model with an infinite number of arbitrary single and double trace terms in the potential; this solution might have applications in many other contexts. We then use these results to evaluate the analogous planar correlation functions on ${\mathbb R}^4$. Specifically, we compute all the terms with a single value of the $\zeta$ function for a few planar 2- and 3-point functions, and conjecture general formulas for these terms for all 2- and 3-point functions on ${\mathbb R}^4$.


title: A Survey of Transformers

abstract: Transformers have achieved great success in many artificial intelligence fields, such as natural language processing, computer vision, and audio processing. Therefore, it is natural to attract lots of interest from academic and industry researchers. Up to the present, a great variety of Transformer variants (a.k.a. X-formers) have been proposed, however, a systematic and comprehensive literature review on these Transformer variants is still missing. In this survey, we provide a comprehensive review of various X-formers. We first briefly introduce the vanilla Transformer and then propose a new taxonomy of X-formers. Next, we introduce the various X-formers from three perspectives: architectural modification, pre-training, and applications. Finally, we outline some potential directions for future research.


title: Hierarchical Lov\'asz Embeddings for Proposal-free Panoptic Segmentation

abstract: Panoptic segmentation brings together two separate tasks: instance and semantic segmentation. Although they are related, unifying them faces an apparent paradox: how to learn simultaneously instance-specific and category-specific (i.e. instance-agnostic) representations jointly. Hence, state-of-the-art panoptic segmentation methods use complex models with a distinct stream for each task. In contrast, we propose Hierarchical Lov\'asz Embeddings, per pixel feature vectors that simultaneously encode instance- and category-level discriminative information. We use a hierarchical Lov\'asz hinge loss to learn a low-dimensional embedding space structured into a unified semantic and instance hierarchy without requiring separate network branches or object proposals. Besides modeling instances precisely in a proposal-free manner, our Hierarchical Lov\'asz Embeddings generalize to categories by using a simple Nearest-Class-Mean classifier, including for non-instance "stuff" classes where instance segmentation methods are not applicable. Our simple model achieves state-of-the-art results compared to existing proposal-free panoptic segmentation methods on Cityscapes, COCO, and Mapillary Vistas. Furthermore, our model demonstrates temporal stability between video frames.


title: Electromagnetic induction imaging with a scanning radio-frequency atomic magnetometer

abstract: We demonstrate electromagnetic induction imaging with an unshielded, portable radio-frequency atomic magnetometer scanning over the target object. This configuration satisfies standard requirements in typical applications, from security screening to medical imaging. The ability to scan the magnetometer over the object relies on the miniaturization of the sensor head and on the active compensation of the ambient magnetic field. Additionally, a procedure is implemented to extract high-quality images from the recorded spatial dependent magnetic resonance. The procedure is shown to be effective in suppressing the detrimental effects of the spatial variation of the magnetic environment.


title: Identification of Magnetic Interactions and High-field Quantum Spin Liquid in $\alpha$-RuCl$_3$

abstract: The frustrated magnet $\alpha$-RuCl$_3$ constitutes a fascinating quantum material platform that harbors the intriguing Kitaev physics. However, a consensus on its intricate spin interactions and field-induced quantum phases has not been reached yet. Here we exploit multiple state-of-the-art many-body methods and determine the microscopic spin model that quantitatively explains major observations in $\alpha$-RuCl$_3$, including the zigzag order, double-peak specific heat, magnetic anisotropy, and the characteristic M-star dynamical spin structure, etc. According to our model simulations, the in-plane field drives the system into the polarized phase at about 7 T and a thermal fractionalization occurs at finite temperature, reconciling observations in different experiments. Under out-of-plane fields, the zigzag order is suppressed at 35 T, above which, and below a polarization field of 100 T level, there emerges a field-induced quantum spin liquid. The fractional entropy and algebraic low-temperature specific heat unveil the nature of a gapless spin liquid, which can be explored in high-field measurements on $\alpha$-RuCl$_3$.


title: Heatmaps in soccer: event vs tracking datasets

abstract: We investigate how similar heatmaps of soccer players are when constructed from (i) event datasets and (ii) tracking datasets. When using event datasets, we show that the scale at which the events are grouped strongly influences the correlation with the tracking heatmaps. Furthermore, there is an optimal scale at which the correlation between event and tracking heatmaps is the highest. However, even at the optimal scale, correlations between both approaches are moderate. Furthermore, there is high heterogeneity in the players' correlation, ranging from negative values to correlations close to the unity. We show that the number of events performed by a player does not crucially determine the level of correlation between both heatmaps. Finally, we analyzed the influence of the player position, showing that defenders are the players with the highest correlations while forwards have the lowest.


title: Turing: an Accurate and Interpretable Multi-Hypothesis Cross-Domain Natural Language Database Interface

abstract: A natural language database interface (NLDB) can democratize data-driven insights for non-technical users. However, existing Text-to-SQL semantic parsers cannot achieve high enough accuracy in the cross-database setting to allow good usability in practice. This work presents Turing, a NLDB system toward bridging this gap. The cross-domain semantic parser of Turing with our novel value prediction method achieves $75.1\%$ execution accuracy, and $78.3\%$ top-5 beam execution accuracy on the Spider validation set. To benefit from the higher beam accuracy, we design an interactive system where the SQL hypotheses in the beam are explained step-by-step in natural language, with their differences highlighted. The user can then compare and judge the hypotheses to select which one reflects their intention if any. The English explanations of SQL queries in Turing are produced by our high-precision natural language generation system based on synchronous grammars.


title: Scaling Vision Transformers

abstract: Attention-based neural networks such as the Vision Transformer (ViT) have recently attained state-of-the-art results on many computer vision benchmarks. Scale is a primary ingredient in attaining excellent results, therefore, understanding a model's scaling properties is a key to designing future generations effectively. While the laws for scaling Transformer language models have been studied, it is unknown how Vision Transformers scale. To address this, we scale ViT models and data, both up and down, and characterize the relationships between error rate, data, and compute. Along the way, we refine the architecture and training of ViT, reducing memory consumption and increasing accuracy of the resulting models. As a result, we successfully train a ViT model with two billion parameters, which attains a new state-of-the-art on ImageNet of 90.45% top-1 accuracy. The model also performs well for few-shot transfer, for example, reaching 84.86% top-1 accuracy on ImageNet with only 10 examples per class.


title: Safe Deep Q-Network for Autonomous Vehicles at Unsignalized Intersection

abstract: We propose a safe DRL approach for autonomous vehicle (AV) navigation through crowds of pedestrians while making a left turn at an unsignalized intersection. Our method uses two long-short term memory (LSTM) models that are trained to generate the perceived state of the environment and the future trajectories of pedestrians given noisy observations of their movement. A future collision prediction algorithm based on the future trajectories of the ego vehicle and pedestrians is used to mask unsafe actions if the system predicts a collision. The performance of our approach is evaluated in two experiments using the high-fidelity CARLA simulation environment. The first experiment tests the performance of our method at intersections that are similar to the training intersection and the second experiment tests our method at intersections with a different topology. For both experiments, our methods do not result in a collision with a pedestrian while still navigating the intersection at a reasonable speed.


title: Entanglement wedge cross section for noncommutative Yang-Mills theory

abstract: The signature of noncommutativity on various measures of entanglement has been observed by considering the holographic dual of noncommutative super Yang-Mills theory. We have followed a systematic analytical approach in order to compute the holographic entanglement entropy corresponding to a strip like subsystem of length $l$. The relationship between the subsystem size (in dimensionless form) $\frac{l}{a}$ and the turning point (in dimensionless form) introduces a critical length scale $\frac{l_c}{a}$ which leads to three domains in the theory, namely, the deep UV domain ($l< l_c$; $au_{t}\gg 1$, $au_{t}\sim au_{b}$), deep noncommutative domain ($l> l_c,~au_{b}>au_t\gg 1$) and deep IR domain ($l> l_c,~au_t\ll 1$). This in turn means that the length scale $l_c$ distinctly points out the UV/IR mixing property of the non-local theory under consideration. We have carried out the holographic study of entanglement entropy for each of these domains by employing both analytical and numerical techniques. The broken Lorentz symmetry induced by noncommutativity has motivated us to redefine the entropic $c$-function. We have obtained the noncommutative correction to the $c$-function upto leading order in the noncommutative parameter. We have also looked at the behaviour of this quantity over all the domains of the theory. We then move on to compute the minimal cross-section area of the entanglement wedge by considering two disjoint subsystems $A$ and $B$. On the basis of $E_P = E_W$ duality, this leads to the holographic computation of the entanglement of purification. The correlation between two subsystems, namely, the holographic mutual information $I(A:B)$ has also been computed. Moreover, the computations of $E_W$ and $I(A:B)$ has been done for each of the domains in the theory. We have then briefly discussed the effect of the UV cut-off on the IR behaviours of these quantities.


title: XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation

abstract: While deep and large pre-trained models are the state-of-the-art for various natural language processing tasks, their huge size poses significant challenges for practical uses in resource constrained settings. Recent works in knowledge distillation propose task-agnostic as well as task-specific methods to compress these models, with task-specific ones often yielding higher compression rate. In this work, we develop a new task-agnostic distillation framework XtremeDistilTransformers that leverages the advantage of task-specific methods for learning a small universal model that can be applied to arbitrary tasks and languages. To this end, we study the transferability of several source tasks, augmentation resources and model architecture for distillation. We evaluate our model performance on multiple tasks, including the General Language Understanding Evaluation (GLUE) benchmark, SQuAD question answering dataset and a massive multi-lingual NER dataset with 41 languages. We release three distilled task-agnostic checkpoints with 13MM, 22MM and 33MM parameters obtaining SOTA performance in several tasks.


title: Are Pretrained Transformers Robust in Intent Classification? A Missing Ingredient in Evaluation of Out-of-Scope Intent Detection

abstract: Pre-trained Transformer-based models were reported to be robust in intent classification. In this work, we first point out the importance of in-domain out-of-scope detection in few-shot intent recognition tasks and then illustrate the vulnerability of pre-trained Transformer-based models against samples that are in-domain but out-of-scope (ID-OOS). We construct two new datasets, and empirically show that pre-trained models do not perform well on both ID-OOS examples and general out-of-scope examples, especially on fine-grained few-shot intent detection tasks. To figure out how the models mistakenly classify ID-OOS intents as in-scope intents, we further conduct analysis on confidence scores and the overlapping keywords, as well as point out several prospective directions for future work. Resources are available on https://github.com/jianguoz/Few-Shot-Intent-Detection.


title: Translate, then Parse! A strong baseline for Cross-Lingual AMR Parsing

abstract: In cross-lingual Abstract Meaning Representation (AMR) parsing, researchers develop models that project sentences from various languages onto their AMRs to capture their essential semantic structures: given a sentence in any language, we aim to capture its core semantic content through concepts connected by manifold types of semantic relations. Methods typically leverage large silver training data to learn a single model that is able to project non-English sentences to AMRs. However, we find that a simple baseline tends to be over-looked: translating the sentences to English and projecting their AMR with a monolingual AMR parser (translate+parse,T+P). In this paper, we revisit this simple two-step base-line, and enhance it with a strong NMT system and a strong AMR parser. Our experiments show that T+P outperforms a recent state-of-the-art system across all tested languages: German, Italian, Spanish and Mandarin with +14.6, +12.6, +14.3 and +16.0 Smatch points.


title: Data-Efficient Instance Generation from Instance Discrimination

abstract: Generative Adversarial Networks (GANs) have significantly advanced image synthesis, however, the synthesis quality drops significantly given a limited amount of training data. To improve the data efficiency of GAN training, prior work typically employs data augmentation to mitigate the overfitting of the discriminator yet still learn the discriminator with a bi-classification (i.e., real vs. fake) task. In this work, we propose a data-efficient Instance Generation (InsGen) method based on instance discrimination. Concretely, besides differentiating the real domain from the fake domain, the discriminator is required to distinguish every individual image, no matter it comes from the training set or from the generator. In this way, the discriminator can benefit from the infinite synthesized samples for training, alleviating the overfitting problem caused by insufficient training data. A noise perturbation strategy is further introduced to improve its discriminative power. Meanwhile, the learned instance discrimination capability from the discriminator is in turn exploited to encourage the generator for diverse generation. Extensive experiments demonstrate the effectiveness of our method on a variety of datasets and training settings. Noticeably, on the setting of 2K training images from the FFHQ dataset, we outperform the state-of-the-art approach with 23.5% FID improvement.


title: Non-Hermitian skin effect of dislocations and its topological origin

abstract: We demonstrate that dislocations in two-dimensional non-Hermitian systems can give rise to density accumulation or depletion through the localization of an extensive number of states. These effects are shown by numerical simulations in a prototype lattice model and expose a different face of non-Hermitian skin effect, by disentangling it from the need for boundaries. We identify a topological invariant responsible for the dislocation skin effect, which takes the form of a ${\mathbb Z}_2$ Hopf index that depends on the Burgers vector characterizing the dislocations. Remarkably, we find that this effect and its corresponding signature for defects in Hermitian systems falls outside of the known topological classification based on bulk-defect correspondence.


title: Structure of Kaluza-Klein Graviton Scattering Amplitudes from Gravitational Equivalence Theorem and Double-Copy

abstract: We study the structure of scattering amplitudes of the Kaluza-Klein (KK) gravitons and of the gravitational KK Goldstone bosons in the compactified 5d General Relativity (GR). We analyze the geometric "Higgs" mechanism for mass-generation of KK gravitons under compactification with a general $R_\xi$ gauge-fixing, which is free from the vDVZ discontinuity. Then, we formulate the Gravitational Equivalence Theorem (GRET) to connect the longitudinal KK graviton amplitudes to the KK Goldstone amplitudes, which is a manifestation of the geometric Higgs mechanism at $S$-matrix level. We directly compute the tree-level KK Goldstone amplitudes which equal the longitudinal KK graviton amplitudes in the high energy limit. We further extend the double-copy method with color-kinematics duality to reconstruct the massive KK longitudinal graviton (Goldstone) amplitudes from the KK longitudinal gauge boson (Goldstone) amplitudes in the compactified 5d Yang-Mills (YM) theory under high energy expansion. From these, we reconstruct the GRET of the KK longitudinal graviton (Goldstone) amplitudes in the 5d GR from the KK longitudinal gauge boson (Goldstone) amplitudes in the 5d YM theory. Using either the GRET or the double-copy reconstruction, we provide a theoretical mechanism showing that the sum of all the energy-power terms [up to $O(E^{10})$] in the high-energy four longitudinal KK graviton amplitudes must cancel down to $O(E^2)$ as enforced by matching the energy-power dependence of the corresponding KK Goldstone amplitudes or by matching that of the double-copy amplitudes from the KK YM theory. With the double-copy approach, we establish a new correspondence between the two energy-cancellations: $E^4 \to E^0$ in the 5d KK YM theory and $E^{10} \to E^2$ in the 5d KK GR theory. We further analyze the structure of the residual terms in the GRET and uncover a new energy-cancellation mechanism therein.


title: Simulated Adversarial Testing of Face Recognition Models

abstract: Most machine learning models are validated and tested on fixed datasets. This can give an incomplete picture of the capabilities and weaknesses of the model. Such weaknesses can be revealed at test time in the real world. The risks involved in such failures can be loss of profits, loss of time or even loss of life in certain critical applications. In order to alleviate this issue, simulators can be controlled in a fine-grained manner using interpretable parameters to explore the semantic image manifold. In this work, we propose a framework for learning how to test machine learning algorithms using simulators in an adversarial manner in order to find weaknesses in the model before deploying it in critical scenarios. We apply this method in a face recognition setup. We show that certain weaknesses of models trained on real data can be discovered using simulated samples. Using our proposed method, we can find adversarial synthetic faces that fool contemporary face recognition models. This demonstrates the fact that these models have weaknesses that are not measured by commonly used validation datasets. We hypothesize that this type of adversarial examples are not isolated, but usually lie in connected spaces in the latent space of the simulator. We present a method to find these adversarial regions as opposed to the typical adversarial points found in the adversarial example literature.


title: BERT Learns to Teach: Knowledge Distillation with Meta Learning

abstract: We present Knowledge Distillation with Meta Learning (MetaDistil), a simple yet effective alternative to traditional knowledge distillation (KD) methods where the teacher model is fixed during training. We show the teacher network can learn to better transfer knowledge to the student network (i.e., learning to teach) with the feedback from the performance of the distilled student network in a meta learning framework. Moreover, we introduce a pilot update mechanism to improve the alignment between the inner-learner and meta-learner in meta learning algorithms that focus on an improved inner-learner. Experiments on various benchmarks show that MetaDistil can yield significant improvements compared with traditional KD algorithms and is less sensitive to the choice of different student capacity and hyperparameters, facilitating the use of KD on different tasks and models.


title: TIMEDIAL: Temporal Commonsense Reasoning in Dialog

abstract: Everyday conversations require understanding everyday events, which in turn, requires understanding temporal commonsense concepts interwoven with those events. Despite recent progress with massive pre-trained language models (LMs) such as T5 and GPT-3, their capability of temporal reasoning in dialogs remains largely under-explored. In this paper, we present the first study to investigate pre-trained LMs for their temporal reasoning capabilities in dialogs by introducing a new task and a crowd-sourced English challenge set, TIMEDIAL. We formulate TIME-DIAL as a multiple-choice cloze task with over 1.1K carefully curated dialogs. Empirical results demonstrate that even the best performing models struggle on this task compared to humans, with 23 absolute points of gap in accuracy. Furthermore, our analysis reveals that the models fail to reason about dialog context correctly; instead, they rely on shallow cues based on existing temporal patterns in context, motivating future research for modeling temporal concepts in text and robust contextual reasoning about them. The dataset is publicly available at: https://github.com/google-research-datasets/timedial.


title: Extent of frustration in the classical Kitaev-$\Gamma$ model via bond anisotropy

abstract: In the pseudospin-$\frac{1}{2}$ honeycomb Mott insulators with strong spin-orbit coupling, there are two types of bond-dependent exchange interactions, named Kitaev ($K$) and $\Gamma$, leading to strong frustration. While the ground state of the Kitaev model is a quantum spin liquid with fractionalized excitations, the ground state of the $\Gamma$ model remains controversial. In particular, the phase diagram of the $K\Gamma$ model with ferromagnetic $K$ and antiferromagnetic $\Gamma$ interactions has been intensively studied because of its relevance to candidate materials such as $\alpha$-RuCl$_{3}$. Numerical studies also included the effects of tuning the bond strengths, i.e., $z$-bond strength different from the other bonds. However, no clear consensus on the overall phase diagram has been reached yet. Here we study the classical $K\Gamma$ model with the anisotropic bond strength using Monte Carlo simulations to understand the emerging phases out of competition between the two frustrated limits. We also address how the anisotropic bond strength affects the phase diagram and strength of quantum fluctuations. We found various large unit cell phases due to the competing frustrations, and analyzed their intrinsic degeneracy based on the symmetry of the Hamiltonian. Using the linear spin wave theory we showed that the anisotropic bond strength enhances quantum fluctuations in the $\Gamma$-dominant regime where a small reduced moment is observed. The implications of our findings in relation to the quantum model are also discussed.


title: Effects of surface potentials on Goos-Haenchen and Imbert-Fedorov shifts in Weyl semimetals

abstract: Weyl semimetals exhibit exotic transport responses, among which, recently Goos-Haenchen (GH) and Imbert-Fedorov (IF) effects have received a revived attention, which are, otherwise, well-studied phenomena in optical systems and certain electronic systems. Besides the usual parametric dependence of the shifts inherited from the underlying Hamiltonian to describe the Weyl system and/or that induced by external controls, the IF shift further carries a topological identity -- it depends on the chirality of the Weyl cones. A realistic system of Weyl semimetal naturally accommodates surface potentials induced by impurities present on its surface that could pose impediments to observe clean transport signatures predicted in theoretical models. Classifying these potentials, we study their effects on GH and IF shifts to provide useful guidance to future experiments that are tuned to the objective of characterizing Weyl semimetals and for a possible realisation of novel devices based on these phenomena. A transfer matrix-based approach is invoked to study the profile of Weyl wavefunctions across the interface which is hosting the impurity potentials, revealing that such potentials can lead to several discerning effects which, in certain cases, extend even to nullifying the IF shift completely and giving rise to phenomenon like valley inversion.


title: Supersymmetry breaking, brane dynamics and Swampland conjectures

abstract: We investigate interactions between branes of various dimensions, both charged and uncharged, in three non-supersymmetric string models. These include the $USp(32)$ and $U(32)$ orientifold projections of the type IIB and type $0$B strings, as well as the $SO(16) \times SO(16)$ projection of the exceptional heterotic string. The resulting ten-dimensional spectra are free of tachyons, and the combinations of branes that they contain give rise to rich and varied dynamics. We compute static potentials for parallel stacks of branes in three complementary regimes: the probe regime, in which one of the two stacks is parametrically heavier than the other, the string-amplitude regime, in which both stacks are light, and the holographic regime. Whenever comparisons are possible, we find qualitative agreement despite the absence of supersymmetry. For charged branes, our analysis reveals that the Weak Gravity Conjecture is satisfied in a novel way via a renormalization of the effective charge-to-tension ratio.


title: DNS attack mitigation Using OpenStack Isolation

abstract: The Domain Name System (DNS) is essential for the Internet, giving a mechanism to resolve hostnames into Internet Protocol (IP) addresses. DNS is known as the world's largest distributed database that manages hostnames and Internet Protocol. By having the DNS, only simple names that can be easily memorized will be used and then the domain name system will map it into the numeric Internet Protocol addresses that are used by computers to communicate. This research aims to propose a model for the development of a private cloud infrastructure to host DNS. The cloud infrastructure will be created using the OpenStack software platform where each server will be hosted separately in a different virtual machine. Virtual network architecture will be created using the Software Defined Networking (SDN) approach and it will be secured using Firewall as a Service (FWaaS). By hosting DNS in private cloud infrastructure, the DNS servers will be out of reach by attackers which will prevent DNS attacks. Besides, available research had proven that the cloud is the best choice for DNS. A prototype had been implemented and evaluated for its efficiencies. The findings from the evaluation carried out shown a positive result.


title: Chiral magnetic properties of QCD phase-diagram

abstract: The QCD phase diagram is studied, at finite magnetic field. Our calculations are based on the QCD effective model, the SU($3$) Polyakov linear sigma model (PLSM), in which the chiral symmetry is integrated in the hadron phase and in the parton phase, the up-, down- and strange-quark degrees of freedom are incorporated besides the inclusion of Polyakov loop potentials in the pure gauge limit, which are motivated by various underlying QCD symmetries. The Landau quantization and the magnetic catalysis are implemented. The response of the QCD matter to an external magnetic field such as magnetization, magnetic susceptibility and permeability has been estimated. We conclude that the parton phase has higher values of magnetization, magnetic susceptibility, and permeability relative to the hadron phase. Depending on the contributions to the Landau levels, we conclude that the chiral magnetic field enhances the chiral quark condensates and hence the chiral QCD phase diagram, i.e. the hadron-parton phase transition likely takes place, at lower critical temperatures and chemical potentials.


title: Phase retrieval with physics informed zero-shot learning

abstract: Phase can be reliably estimated from a single diffracted intensity image, if a faithful prior information about the object is available. Examples include amplitude bounds, object support, sparsity in the spatial or a transform domain, deep image prior and the prior learnt from the labelled datasets by a deep neural network. Deep learning facilitates state of art reconstruction quality but requires a large labelled dataset (ground truth-measurement pair acquired in the same experimental conditions) for training. To alleviate this data requirement problem, this letter proposes a zero-shot learning method. The letter demonstrates that the object-prior learnt by a deep neural network while being trained for a denoising task can also be utilized for the phase retrieval, if the diffraction physics is effectively enforced on the network output. The letter additionally demonstrates that the incorporation of total variation in the proposed zero-shot framework facilitates the reconstruction of similar quality in lesser time (e.g. ~8.5 fold, for a test reported in this letter).


title: Microstructured fiber links for THz communications and their fabrication using infinity printing

abstract: In this work, a novel infinity 3D printing technique is explored to fabricate continuous multi-meter-long low-loss near-zero dispersion suspended-core polypropylene fibers for application in terahertz (THz) communications. Particular attention is paid to process parameter optimization for 3D printing with low-loss polypropylene plastic. Three microstructured THz fibers were 3D printed using the standard and infinity 3D printers, and an in-depth theoretical and experimental comparison between the fibers were carried out. Transmission losses (by power) of 4.79 dB/m, 17.34 dB/m and 11.13 dB/m are experimentally demonstrated for the three fibers operating at 128 GHz. Signal transmission with BER far below the forward error correction limit (10-3) for the corresponding three fiber types of lengths of 2 m, 0.75 m and 1.6 m are observed, and an error-free transmission is realized at the bit rates up to 5.2 Gbps. THz imaging of the fiber near-field is used to visualize modal distributions and study optimal fiber excitation conditions. The ability of shielding the fundamental mode from the environment, mechanical robustness and ease of handling of thus developed effectively single-mode high optical performance fibers make them excellent candidates for upcoming fiber-assisted THz communications. Additionally, novel fused deposition modeling (FDM)-based infinity printing technique allows continuous fabrication of unlimited in length fibers of complex transverse geometries using advanced thermoplastic composites, which, in our opinion, is poised to become a key fabrication technique for advanced terahertz fiber manufacturing.


title: On 7-division fields of CM elliptic curves

abstract: Let $\mathcal{E}$ be a CM elliptic curve defined over a number field $K$, with Weiestrass form $y^3=x^3+bx$ or $y^2=x^3+c$. For every positive integer $m$, we denote by ${\mathcal{E}}[m]$ the $m$-torsion subgroup of ${\mathcal{E}}$ and by $K_m:=K({\mathcal{E}}[m])$ the $m$-th division field, i.e. the extension of $K$ generated by the coordinates of the points in ${\mathcal{E}}[m]$. We classify all fields $K_7$. In particular we give explicit generators for $K_7/K$ and produce all Galois groups ${\textrm{Gal}}(K_7/K)$. We also show some applications to the Local-Global Divisibility Problem and to modular curves.


title: Starlight in Darkness: The Birth of Stars

abstract: This article will briefly review the theory of star formation (SF) and its development using observations. This is very relevant in the present context since planet formation appears to be a byproduct of SF, and the whole question of life in the universe and its origin can be viewed with a new perspective.


title: Higher-Derivative Supergravity, AdS$_4$ Holography, and Black Holes

abstract: We use conformal supergravity techniques to study four-derivative corrections in four-dimensional gauged supergravity. We show that the four-derivative Lagrangian for the propagating degrees of freedom of the $\mathcal{N}=2$ gravity multiplet is determined by two real dimensionless constants. We demonstrate that all solutions of the two-derivative equations of motion in the supergravity theory also solve the four-derivative equations of motion. These results are then applied to explicitly calculate the regularized on-shell action for any asymptotically locally AdS$_4$ solution of the two-derivative equations of motion. The four-derivative terms in the supergravity Lagrangian modify the entropy and other thermodynamic observables for the black hole solutions of the theory. We calculate these corrections explicitly and demonstrate that the quantum statistical relation holds for general stationary black holes in the presence of the four-derivative corrections. Employing an embedding of this supergravity model in M-theory we show how to use supersymmetric localization results in the holographically dual three-dimensional SCFT to determine the unknown coefficients in the four-derivative supergravity action. This in turn leads to new detailed results for the first subleading $N^{\frac{1}{2}}$ correction to the large $N$ partition function of a class of three-dimensional SCFTs on compact Euclidean manifolds. In addition, we calculate explicitly the first subleading correction to the Bekenstein-Hawking entropy of asymptotically AdS$_4$ black holes in M-theory. We also discuss how to add matter multiplets to the supergravity theory in the presence of four-derivative terms and to generalize some of these results to six- and higher-derivative supergravity.


title: Classification of Exceptional Nodal Topologies Protected by $\mathcal{PT}$ Symmetry

abstract: Exceptional degeneracies, at which both eigenvalues and eigenvectors coalesce, and parity-time ($\mathcal{PT}$) symmetry, reflecting balanced gain and loss in photonic systems, are paramount concepts in non-Hermitian systems. We here complete the topological classification of exceptional nodal degeneracies protected by $\mathcal{PT}$ symmetry in up to three dimensions and provide simple example models whose exceptional nodal topologies include previously overlooked possibilities such as second-order knotted surfaces of arbitrary genus, third-order knots and fourth-order points.


title: Stabilizing Topological Superfluidity of Lattice Fermions

abstract: Attractive interaction between spinless fermions in a two-dimensional lattice drives the formation of a topological superfluid. But the topological phase is dynamically unstable towards phase separation when the system has a high density of states and large interaction strength. This limits the critical temperature to an experimentally challenging regime where, for example, even ultracold atoms and molecules in optical lattices would struggle to realize the topological superfluid. We propose that the introduction of a weaker longer-range repulsion, in addition to the short-range attraction between lattice fermions, will suppress the phase separation instability. Taking the honeycomb lattice as an example, we show that our proposal significantly enlarges the stable portion of the topological superfluid phase and increases the critical temperature by an order of magnitude. Our work opens a route to enhance the stability of topological superfluids by engineering inter-particle interactions.


title: Inelastic Dark Matter at the Fermilab Short Baseline Neutrino Program

abstract: We study the sensitivity of the Fermilab Short-Baseline Neutrino (SBN) experiments, MicroBooNE, ICARUS, and SBND, to MeV- to GeV-scale inelastic dark matter interacting through a dark photon mediator. These models provide interesting scenarios of light thermal dark matter, which, while challenging to probe with direct and indirect detection experiments, are amenable to accelerator-based searches. We consider production of the dark sector states with both the Fermilab Booster 8 GeV and NuMI 120 GeV proton beams and study the signatures of scattering and decay of the heavy excited dark state in the SBN detectors. These distinct signatures probe complementary regions of parameter space. All three experiments will be able to cover new ground, with an excellent near-term opportunity to search for cosmologically motivated targets explaining the observed dark matter abundance.


title: An analysis of Bayesian estimates for missing higher orders in perturbative calculations

abstract: With current high precision collider data, the reliable estimation of theoretical uncertainties due to missing higher orders (MHOs) in perturbation theory has become a pressing issue for collider phenomenology. Traditionally, the size of the MHOs is estimated through scale variation, a simple but ad hoc method without probabilistic interpretation. Bayesian approaches provide a compelling alternative to estimate the size of the MHOs, but it is not clear how to interpret the perturbative scales, like the factorisation and renormalisation scales, in a Bayesian framework. Recently, it was proposed that the scales can be incorporated as hidden parameters into a Bayesian model. In this paper, we thoroughly scrutinise Bayesian approaches to MHO estimation and systematically study the performance of different models on an extensive set of high-order calculations. We extend the framework in two significant ways. First, we define a new model that allows for asymmetric probability distributions. Second, we introduce a prescription to incorporate information on perturbative scales without interpreting them as hidden model parameters. We clarify how the two scale prescriptions bias the result towards specific scale choice, and we discuss and compare different Bayesian MHO estimates among themselves and to the traditional scale variation approach. Finally, we provide a practical prescription of how existing perturbative results at the standard scale variation points can be converted to 68%/95% credibility intervals in the Bayesian approach using the new public code MiHO.


title: Detecting and Characterizing Young Quasars II: Four Quasars at $z\sim 6$ with Lifetimes $<10^4$ years

abstract: The extents of proximity zones of high-redshift quasars enable constraints on the timescales of quasar activity, which are fundamental for understanding the growth of the supermassive black holes (SMBHs) that power the quasars' emission. In this study, we obtain precise estimates for the ultraviolet (UV) luminous lifetimes of ten quasars at $5.8< z< 6.5$. These objects were pre-selected to have short lifetimes based on preliminary measurements of their proximity zone sizes, and were then targeted for high quality follow-up sub-mm, optical, and infrared observations required to increase the measurements' precision and securely determine their lifetimes. By comparing these proximity zone sizes to mock quasar spectra generated from radiative transfer simulations at a range of different lifetimes, we deduce extremely short lifetimes $t_{\rm Q}<10^4$ yr for four objects in our sample, whereas the remaining quasars are consistent with longer lifetimes of $t_{\rm Q}\gtrsim 10^5$ yr. These young objects with small proximity zones represent $\lesssim10\%$ of the quasar population as a whole. We compare our results in detail to other studies on timescales of quasar activity, which point towards an average lifetime of $t_{\rm Q}\sim10^6$ yr for the quasar population. This is consistent with finding newly turned on quasars approximately $\sim 1-10\%$ of the time. These young quasars represent an unique opportunity to study triggering and feedback mechanisms of SMBHs, since the onset of their UV luminous quasar phase happened only recently, and therefore traces of this process might still be observable.


title: Anisotropic satellite galaxy quenching modulated by supermassive black hole activity

abstract: The evolution of satellite galaxies is shaped by their constant interaction with the circum galactic medium surrounding central galaxies, which in turn may be affected by gas and energy ejected from the central supermassive black hole. However, the nature of this coupling between black holes and galaxies is highly debated and observational evidence remains scarce. Here we report an analysis of archival data on 124,163 satellite galaxies in the potential wells of 29,631 dark matter halos with masses between 10$^{12}$ and $10^{14}$ solar masses. We find that quiescent satellites are relatively less frequent along the minor axis of their central galaxies. This observation might appear counterintuitive as black hole activity is expected to eject mass and energy preferentially in the direction of the minor axis of the host galaxy. However, we show that the observed signal results precisely from the ejective nature of black hole feedback in massive halos, as active galactic nuclei-powered outflows clear out the circumgalactic medium, reducing the ram pressure and thus preserving star formation. This interpretation is supported by the IllustrisTNG suite of cosmological numerical simulations, where a similar modulation is observed even though the sub-grid implementation of black hole feedback is effectively isotropic. Our results provide compelling observational evidence for the role of black holes in regulating galaxy evolution over spatial scales differing by several orders of magnitude.


title: Mixed dark matter: matter power spectrum and halo mass function

abstract: We investigate and quantify the impact of mixed (cold and warm) dark matter models on large-scale structure observables. In this scenario, dark matter comes in two phases, a cold one (CDM) and a warm one (WDM): the presence of the latter causes a suppression in the matter power spectrum which is allowed by current constraints and may be detected in present-day and upcoming surveys. We run a large set of $N$-body simulations in order to build an efficient and accurate emulator to predict the aforementioned suppression with percent precision over a wide range of values for the WDM mass, $M_\mathrm{wdm}$, and its fraction with respect to the totality of dark matter, $f_\mathrm{wdm}$. The suppression in the matter power spectrum is found to be independent of changes in the cosmological parameters at the 2% level for $k\lesssim 10 \ h/$Mpc and $z\leq 3.5$. In the same ranges, by applying a baryonification procedure on both $\Lambda$CDM and CWDM simulations to account for the effect of feedback, we find a similar level of agreement between the two scenarios. We examine the impact that such suppression has on weak lensing and angular galaxy clustering power spectra. Finally, we discuss the impact of mixed dark matter on the shape of the halo mass function and which analytical prescription yields the best agreement with simulations. We provide the reader with an application to galaxy cluster number counts.


title: The soft drop momentum sharing fraction $z_g$ beyond leading-logarithmic accuracy

abstract: Grooming techniques, such as soft drop, play a central role in reducing sensitivity of jets to e.g. underlying event and hadronization at current collider experiments. The momentum sharing fraction $z_g$, of the two branches in a jet that pass the soft drop condition, is one of the most important observables characterizing a collinear splitting inside the jet, and directly probes the QCD splitting functions. In this work, we present a factorization framework that enables a systematic calculation of the corresponding cross section beyond leading-logarithmic (LL) accuracy, showing that this measurement is not only sensitive to the QCD charge but also the spin of the parton that initiates the jet. Our results at next-to-leading logarithmic (NLL$'$) accuracy include non-global logarithms, and provide a first meaningful assessment of the perturbative uncertainty. We present a comparison to the available experimental data from ALICE, ATLAS, and STAR and find excellent agreement.


title: PEARL: Data Synthesis via Private Embeddings and Adversarial Reconstruction Learning

abstract: We propose a new framework of synthesizing data using deep generative models in a differentially private manner. Within our framework, sensitive data are sanitized with rigorous privacy guarantees in a one-shot fashion, such that training deep generative models is possible without re-using the original data. Hence, no extra privacy costs or model constraints are incurred, in contrast to popular approaches such as Differentially Private Stochastic Gradient Descent (DP-SGD), which, among other issues, causes degradation in privacy guarantees as the training iteration increases. We demonstrate a realization of our framework by making use of the characteristic function and an adversarial re-weighting objective, which are of independent interest as well. Our proposal has theoretical guarantees of performance, and empirical evaluations on multiple datasets show that our approach outperforms other methods at reasonable levels of privacy.


title: Sliding Naturalness

abstract: We present a novel framework to solve simultaneously the electroweak hierarchy problem and the strong-CP problem. A small but finite Higgs vacuum expectation value and a small $\theta$-angle are selected after the QCD phase transition, without relying on the Peccei-Quinn mechanism or other traditional solutions. We predict a distinctive pattern of correlated signals at hadronic EDM, fuzzy dark matter and axion experiments.


title: Systematics of the $\alpha'$ Expansion in F-Theory

abstract: Extracting reliable low-energy information from string compactifications notoriously requires a detailed understanding of the UV sensitivity of the corresponding effective field theories. Despite past efforts in computing perturbative string corrections to the tree-level action, neither a systematic approach nor a unified framework has emerged yet. We make progress in this direction, focusing on the moduli dependence of perturbative corrections to the 4D scalar potential of type IIB Calabi-Yau orientifold compactifications. We proceed by employing two strategies. First, we use two rescaling symmetries of type IIB string theory to infer the dependence of any perturbative correction on both the dilaton and the Calabi-Yau volume. Second, we use F/M-theory duality to conclude that KK reductions on elliptically-fibred Calabi-Yau fourfolds of the M-theory action at any order in the derivative expansion can only generate $(\alpha')^{\rm even}$ corrections to the 4D scalar potential, which, moreover, all vanish for trivial fibrations. We finally give evidence that $(\alpha')^{\rm odd}$ effects arise from integrating out KK and winding modes on the elliptic fibration and argue that the leading no-scale breaking effects at string tree-level arise from $(\alpha')^3$ effects, modulo potential logarithmic corrections.