title: Reinforcement learning for Energies of the future and carbon neutrality: a Challenge Design

abstract: Current rapid changes in climate increase the urgency to change energy production and consumption management, to reduce carbon and other green-house gas production. In this context, the French electricity network management company RTE (R{\'e}seau de Transport d'{\'E}lectricit{\'e}) has recently published the results of an extensive study outlining various scenarios for tomorrow's French power management. We propose a challenge that will test the viability of such a scenario. The goal is to control electricity transportation in power networks, while pursuing multiple objectives: balancing production and consumption, minimizing energetic losses, and keeping people and equipment safe and particularly avoiding catastrophic failures. While the importance of the application provides a goal in itself, this challenge also aims to push the state-of-the-art in a branch of Artificial Intelligence (AI) called Reinforcement Learning (RL), which offers new possibilities to tackle control problems. In particular, various aspects of the combination of Deep Learning and RL called Deep Reinforcement Learning remain to be harnessed in this application domain. This challenge belongs to a series started in 2019 under the name "Learning to run a power network" (L2RPN). In this new edition, we introduce new more realistic scenarios proposed by RTE to reach carbon neutrality by 2050, retiring fossil fuel electricity production, increasing proportions of renewable and nuclear energy and introducing batteries. Furthermore, we provide a baseline using state-of-the-art reinforcement learning algorithm to stimulate the future participants.


title: On the Optimal Pairwise Group Testing Algorithm

abstract: Originally suggested for the blood testing problem by Dorfman in 1943, an idea of Group Testing (GT) has found many applications in other fields as well. Among many (binomial) GT procedures introduced since then, in 1990, Yao and Hwang proposed the Pairwise Testing Algorithm (PTA) and demonstrated that PTA is the \emph{unique} optimal nested GT procedure provided the probability of contamination lies in $\left[1-\frac{\sqrt{2}}{2},\frac{3-\sqrt{5}}{2}\right]$. Despite the fundamental nature of the result, PTA did not receive considerable attention in the literature. In particular, even its basic probabilistic properties remained unexplored. In this paper, we fill the gap by providing an exhaustive characterization of probabilistic PTA properties.


title: Vacuum stability in the Standard Model with vector-like fermions

abstract: The discovery of Standard-Model like Higgs at 125 GeV may raise more questions than the answers it provides. In particular, the hierarchy problem remains unsolved, and the Standard Model Higgs quartic self-coupling becomes negative below the Planck scale, necessitating new physics beyond the Standard Model. In this work we investigate a popular scenario, extensions of the Standard Model with vector-like fermion fields, such as the ones present in models with extra dimensions or in Higgs composite models, using a model independent approach. Since fermions decrease the Higgs quartic coupling at high energies, only exacerbating the self-coupling problem, we introduce first an additional scalar, which by itself is enough to overcome the vacuum stability limit, and then explore the effects of vector-like fermions in singlet, doublet and triplet representations. For each model, we identify the allowed fermion masses and mixing angles with the third family fermions required to satisfy the vacuum stability condition, and compare different representations. Allowed fermion masses emerge at around 1 TeV, raising hope that these will be found at the LHC. We also examine corrections to oblique parameters S and T from additional scalar and vector-like quarks which also impose constraints on mixing and mass splitting of both sectors., but these restrictions are relatively weak compared to the vacuum stability.


title: Jointly Predicting Emotion, Age, and Country Using Pre-Trained Acoustic Embedding

abstract: In this paper, we demonstrated the benefit of using pre-trained model to extract acoustic embedding to jointly predict (multitask learning) three tasks: emotion, age, and native country. The pre-trained model was trained with wav2vec 2.0 large robust model on the speech emotion corpus. The emotion and age tasks were regression problems, while country prediction was a classification task. A single harmonic mean from three metrics was used to evaluate the performance of multitask learning. The classifier was a linear network with two independent layers and shared layers, including the output layers. This study explores multitask learning on different acoustic features (including the acoustic embedding extracted from a model trained on an affective speech dataset), seed numbers, batch sizes, and normalizations for predicting paralinguistic information from speech.


title: Efficient Search of Multiple Neural Architectures with Different Complexities via Importance Sampling

abstract: Neural architecture search (NAS) aims to automate architecture design processes and improve the performance of deep neural networks. Platform-aware NAS methods consider both performance and complexity and can find well-performing architectures with low computational resources. Although ordinary NAS methods result in tremendous computational costs owing to the repetition of model training, one-shot NAS, which trains the weights of a supernetwork containing all candidate architectures only once during the search process, has been reported to result in a lower search cost. This study focuses on the architecture complexity-aware one-shot NAS that optimizes the objective function composed of the weighted sum of two metrics, such as the predictive performance and number of parameters. In existing methods, the architecture search process must be run multiple times with different coefficients of the weighted sum to obtain multiple architectures with different complexities. This study aims at reducing the search cost associated with finding multiple architectures. The proposed method uses multiple distributions to generate architectures with different complexities and updates each distribution using the samples obtained from multiple distributions based on importance sampling. The proposed method allows us to obtain multiple architectures with different complexities in a single architecture search, resulting in reducing the search cost. The proposed method is applied to the architecture search of convolutional neural networks on the CIAFR-10 and ImageNet datasets. Consequently, compared with baseline methods, the proposed method finds multiple architectures with varying complexities while requiring less computational effort.


title: Turbulent Prandtl number from isotropically forced turbulence

abstract: Turbulent motions enhance the diffusion of large-scale flows and temperature gradients. Such diffusion is often parameterized by coefficients of turbulent viscosity ($\nu_{\rm t}$) and turbulent thermal diffusivity ($\chi_{\rm t}$) that are analogous to their microscopic counterparts. We compute the turbulent diffusion coefficients by imposing large-scale velocity and temperature gradients on a turbulent flow and measuring the response of the system. We also confirm our results using experiments where the imposed gradients are allowed to decay. To achieve this, we use weakly compressible three-dimensional hydrodynamic simulations of isotropically forced homogeneous turbulence. We find that the turbulent viscosity and thermal diffusion, as well as their ratio the turbulent Prandtl number, ${\rm Pr}_{\rm t} = \nu_{\rm t}/\chi_{\rm t}$, approach asymptotic values at sufficiently high Reynolds and Pecl\'et numbers. We also do not find a significant dependence of ${\rm Pr}_{\rm t}$ on the microscopic Prandtl number ${\rm Pr} = \nu/\chi$. These findings are in stark contrast to results from the $k-\epsilon$ model which suggests that ${\rm Pr}_{\rm t}$ increases monotonically with decreasing ${\rm Pr}$. The current results are relevant for the ongoing debate of, for example, the nature of the turbulent flows in the very low ${\rm Pr}$ regimes of stellar convection zones.


title: Particle production as a function of underlying-event activity and search for jet-like modifications in pp, p-Pb, and Pb-Pb collisions at $\sqrt{s_{\rm NN}}=5.02$ TeV with ALICE

abstract: The similarity between small- and large-collision systems is explored using the charged-particle multiplicity in the transverse region, $N^{\rm T}_{\rm ch}$, which is sensitive to the underlying event. Measurements of charged-particle production as a function of $N^{\rm T}_{\rm ch}$ in pp, p-Pb and Pb-Pb collisions at $\sqrt{s_{\rm NN}}=5.02$ TeV in the toward, away and transverse regions are discussed. These three regions are defined relative to the track with the largest transverse momentum in the event ($p_{\rm T}^{\rm trig}$). The activity in the transverse region is subtracted from the activity in the toward and the away regions to search for jet-like modifications in small-collision systems. The jet-like signals are studied both as a function of $N^{\rm T}_{\rm ch}$ and $p_{\rm T}^{\rm trig}$. Results are compared with two general purpose Monte Carlo event generators: PYTHIA~8 and EPOS~LHC.


title: Efficient hydrogen evolution reaction due to topological polarization

abstract: Materials carrying topological surface states (TSS) provide a fascinating platform for the hydrogen evolution reaction (HER). Based on systematic first-principles calculations for $A_3 B$ ($A$ = Ni, Pd, Pt; $B$ = Si, Ge, Sn), we propose that topological electric polarization characterized by the Zak phase can be crucial to designing efficient catalysts for the HER. For $A_3 B$, we show that the Zak phase takes a nontrivial value of $\pi$ in the whole (111) projected Brillouin zone, which causes quantized electric polarization charge at the surface. There, depending on the adsorption sites, the hydrogen (H) atom hybridizes with the TSS rather than with the bulk states. When the hybridization has an intermediate character between the covalent and ionic bond, the H states are localized in the energy spectrum, and the change in the Gibbs free energy ($\Delta G$) due to the H adsorption becomes small. Namely, the interaction between the H states and the substrate becomes considerably weak, which is a highly favorable situation for the HER. Notably, we show that $\Delta G$ for Pt$_3$Sn and Pd$_3$Sn are just -0.066 and -0.092 eV, respectively, which are almost half of the value of Pt.


title: Renewal dynamical approach for non-minimal quasi-stationary distributions of one-dimensional diffusions

abstract: We consider quasi-stationary distributions for one-dimensional diffusions via the renewal dynamical approach. We show that convergence of the iterative renewal transform to quasi-stationary distributions is equivalent to a condition on the moment growth rate of the lifetime, which is at the same time a necessary condition for the existence of Yaglom limits.


title: Tunneling Analysis of Regular Black Holes with Cosmic Strings-Like Solution in Newman-Janis Algorithm

abstract: We consider the regular black holes solution with cosmic strings(RBHCS) in the rotation parameter by assuming the Newman-Janis method. After this, we study thermodynamical property (i.e., Hawking temperature $T_H$) for the RBHCS in the presence of spin parameter. Moreover, we study the graphical interpretation of Hawking temperature with event horizon to check the physical and stable form of RBHCS under the effect of Newman-Janis algorithm. We graphically show that the RBHCS in the context of Newman-Janis algorithm are colder than the Schwarzschild black hole. Furthermore, we investigate the quantum corrected temperature for RBHCS in Newman-Janis method by incorporating generalized uncertainty principle. We have also analyzed the graphical interpretation of corrected temperature $T'_{H}$ versus $r_{+}$ and study the stable condition of RBHCS in Newman-Janis method in the presence of gravity parameter effects. Finally, the corrected entropy for RBHCS with rotation parameter is analyzed.


title: Study of the reactions $e^+e^-\to K^+K^-\pi^0\pi^0\pi^0$, $e^+e^-\to K^{0}_{S}K^{\pm}\pi^{\mp}\pi^0\pi^0$, and $e^+e^-\to K^{0}_{S}K^{\pm}\pi^{\mp}\pi^+\pi^-$ at center-of-mass energies from threshold to 4.5 GeV using ISR

abstract: We study the processes $e^+e^-\to K^+K^-\pi^0\pi^0\pi^0\gamma$, $K^{0}_{S}K^{\pm}\pi^{\mp}\pi^0\pi^0\gamma$, and $K^{0}_{S}K^{\pm}\pi^{\mp}\pi^+\pi^-\gamma$ in which an energetic photon is radiated from the initial state. The data were collected with the \babar~ detector at the SLAC National Accelerator Laboratory. About 1200, 2600, and 6000 events, respectively, are selected from a data sample corresponding to an integrated luminosity of 469\invfb. The invariant mass of the hadronic final state defines the effective \epem center-of-mass energy. The center-of-mass energies range from threshold to 4.5\gev. From the mass spectra, the first ever measurements of the $e^+e^-\to K^+K^-\pi^0\pi^0\pi^0$, $e^+e^-\to K^0_SK^{\pm}\pi^{\mp}\pi^0\pi^0$, and $e^+e^-\to K^0_SK^{\pm}\pi^{\mp}\pi^+\pi^-$ cross sections are performed. The contributions from the intermediate states that include $\eta$, $\phi$, $\rho$, $K^*(892)$, and other resonances are presented. We observe the $J/\psi$ and $\psi(2S)$ in most of these final states and measure the corresponding branching fractions, many of them for the first time.


title: UFO: Unified Feature Optimization

abstract: This paper proposes a novel Unified Feature Optimization (UFO) paradigm for training and deploying deep models under real-world and large-scale scenarios, which requires a collection of multiple AI functions. UFO aims to benefit each single task with a large-scale pretraining on all tasks. Compared with the well known foundation model, UFO has two different points of emphasis, i.e., relatively smaller model size and NO adaptation cost: 1) UFO squeezes a wide range of tasks into a moderate-sized unified model in a multi-task learning manner and further trims the model size when transferred to down-stream tasks. 2) UFO does not emphasize transfer to novel tasks. Instead, it aims to make the trimmed model dedicated for one or more already-seen task. With these two characteristics, UFO provides great convenience for flexible deployment, while maintaining the benefits of large-scale pretraining. A key merit of UFO is that the trimming process not only reduces the model size and inference consumption, but also even improves the accuracy on certain tasks. Specifically, UFO considers the multi-task training and brings two-fold impact on the unified model: some closely related tasks have mutual benefits, while some tasks have conflicts against each other. UFO manages to reduce the conflicts and to preserve the mutual benefits through a novel Network Architecture Search (NAS) method. Experiments on a wide range of deep representation learning tasks (i.e., face recognition, person re-identification, vehicle re-identification and product retrieval) show that the model trimmed from UFO achieves higher accuracy than its single-task-trained counterpart and yet has smaller model size, validating the concept of UFO. Besides, UFO also supported the release of 17 billion parameters computer vision (CV) foundation model which is the largest CV model in the industry.


title: Language Model Cascades

abstract: Prompted models have demonstrated impressive few-shot learning abilities. Repeated interactions at test-time with a single model, or the composition of multiple models together, further expands capabilities. These compositions are probabilistic models, and may be expressed in the language of graphical models with random variables whose values are complex data types such as strings. Cases with control flow and dynamic structure require techniques from probabilistic programming, which allow implementing disparate model structures and inference strategies in a unified language. We formalize several existing techniques from this perspective, including scratchpads / chain of thought, verifiers, STaR, selection-inference, and tool use. We refer to the resulting programs as language model cascades.


title: The Morozov's principle applied to data assimilation problems

abstract: This paper is focused on the Morozov's principle applied to an abstract data assimilation framework, with particular attention to three simple examples: the data assimilation problem for the Laplace equation, the Cauchy problem for the Laplace equation and the data assimilation problem for the heat equation. Those ill-posed problems are regularized with the help of a mixed type formulation which is proved to be equivalent to a Tikhonov regularization applied to a well-chosen operator. The main issue is that such operator may not have a dense range, which makes it necessary to extend well-known results related to the Morozov's choice of the regularization parameter to that unusual situation. The solution which satisfies the Morozov's principle is computed with the help of the duality in optimization, possibly by forcing the solution to satisfy given a priori constraints. Some numerical results in two dimensions are proposed in the case of the data assimilation problem for the Laplace equation.


title: Local H\"older stabilities for inverse problems of first-order hyperbolic equations

abstract: In this paper, we consider a Cauchy problem for a first-order hyperbolic equation with time-dependent coefficients. Cauchy data are given on a lateral subboundary and we obtain local H\"older stabilities for inverse source and coefficient problems via a Carleman estimate.


title: CADyQ: Content-Aware Dynamic Quantization for Image Super-Resolution

abstract: Despite breakthrough advances in image super-resolution (SR) with convolutional neural networks (CNNs), SR has yet to enjoy ubiquitous applications due to the high computational complexity of SR networks. Quantization is one of the promising approaches to solve this problem. However, existing methods fail to quantize SR models with a bit-width lower than 8 bits, suffering from severe accuracy loss due to fixed bit-width quantization applied everywhere. In this work, to achieve high average bit-reduction with less accuracy loss, we propose a novel Content-Aware Dynamic Quantization (CADyQ) method for SR networks that allocates optimal bits to local regions and layers adaptively based on the local contents of an input image. To this end, a trainable bit selector module is introduced to determine the proper bit-width and quantization level for each layer and a given local image patch. This module is governed by the quantization sensitivity that is estimated by using both the average magnitude of image gradient of the patch and the standard deviation of the input feature of the layer. The proposed quantization pipeline has been tested on various SR networks and evaluated on several standard benchmarks extensively. Significant reduction in computational complexity and the elevated restoration accuracy clearly demonstrate the effectiveness of the proposed CADyQ framework for SR. Codes are available at https://github.com/Cheeun/CADyQ.


title: Unidirectional Spin Hall Magnetoresistance in Antiferromagnetic Heterostructures

abstract: Unidirectional spin Hall magnetoresistance (USMR) has been widely reported in the heavy metal / ferromagnet (HM/FM) bilayer systems. We observe the USMR in the Pt/{\alpha}-Fe2O3 bilayers where the {\alpha}-Fe2O3 is an antiferromagnetic (AFM) insulator. Systematic field and temperature dependent measurements confirm the magnonic origin of the USMR. The appearance of AFM-USMR is driven by the imbalance of creation and annihilation of AFM magnons by spin orbit torque due to thermal random field. However, unlike its ferromagnetic counterpart, theoretical modeling reveals that the USMR in Pt/{\alpha}-Fe2O3 is determined by the antiferromagtic magnon number, and with a non-monotonic field dependence. Our findings extend the generality of the USMR which pave the ways for the highly sensitive detection of AF spin state.


title: Demystifying Dependency Bugs in Deep Learning Stack

abstract: Deep learning (DL) applications, built upon a heterogeneous and complex DL stack (e.g., Nvidia GPU, Linux, CUDA driver, Python runtime, and TensorFlow), are subject to software and hardware dependencies across the DL stack. One challenge in dependency management across the entire engineering lifecycle is posed by the asynchronous and radical evolution and the complex version constraints among dependencies. Developers may introduce dependency bugs (DBs) in selecting, using and maintaining dependencies. However, the characteristics of DBs in DL stack is still under-investigated, hindering practical solutions to dependency management in DL stack. To bridge this gap, this paper presents the first comprehensive study to characterize symptoms, root causes and fix patterns of DBs across the whole DL stack with 446 DBs collected from StackOverflow posts and GitHub issues. For each DB, we first investigate the symptom as well as the lifecycle stage and dependency where the symptom is exposed. Then, we analyze the root cause as well as the lifecycle stage and dependency where the root cause is introduced. Finally, we explore the fix pattern and the knowledge sources that are used to fix it. Our findings from this study shed light on practical implications on dependency management.


title: Ultra-low noise, bi-polar, programmable current sources

abstract: We present the design process and implementation of fully open-source, ultra-low noise programmable current source systems in two configurations. Although originally designed as coil drivers for Optically Pumped Magnetometers (OPMs), the device specifications make them potentially useful in a range of applications. The devices feature a bi-directional current range of $\pm$~10~mA and $\pm$~250~mA respectively on three independent channels with 16-bit resolution. Both devices feature narrow 1/f noise bandwidth of 1~Hz, enabling magnetic field manipulation for high-performance OPMs. They exhibit low noise of 146.3~pA/$\sqrt{\mathrm{Hz}}$ and 4114~pA/$\sqrt{\mathrm{Hz}}$ which translates to 14.57~ppb/$\sqrt{\mathrm{Hz}}$ and 16.46~ppb/$\sqrt{\mathrm{Hz}}$ noise relative to full scale.


title: Influence of nonuniform magnetization reorientation on spin-orbit torque measurements

abstract: Measurements of spin-orbit torques in a ferromagnetic/nonmagnetic multilayer are typically based on an assumption that the entire ferromagnetic layer uniformly responds to the spin-orbit torque. This assumption breaks down when the thickness of the ferromagnetic layer is comparable to the dynamic exchange coupling length, which can be as short as a few nanometers in certain measurement geometries. The nonuniform magnetization reorientation coupled with nonuniform contribution of each magnetic sublayer to the magnetoresistance or the Kerr effect may impact the accuracy in the extrapolation of spin-orbit torque, particularly if a thick ferromagnetic layer is used. In this paper, we use numerical models to investigate such an impact in three different techniques: the magneto-optic-Kerr-effect method, the second-harmonic method and the spin torque ferromagnetic resonance method. We show that the second-harmonic and magneto-optic-Kerr-effect methods are prone to be influenced by the nonuniform magnetization reorientation, while the spin torque ferromagnetic resonance method is much less impacted.


title: Non-factorisable contributions to $t$-channel single-top production at the LHC and FCC

abstract: Single top quark is mainly produced through the $t$-channel W boson exchange $q + b \rightarrow q' + t$ at LHC. This process probes Wtb vertex directly and can be used to measure the CKM matrix element $V_{tb}$ or to constrain the bottom quark PDF. The non-factorisable contributions are the last missing piece of the NNLO corrections. In these proceedings, we discuss in a first part the ostensible importance of such corrections and the obtention of the different relevant amplitudes. In the second part, recently published results at the energy of the LHC are compared to new results for proton-proton collision at $100 \: {\rm TeV}$, the energy of the FCC.


title: Auto Machine Learning for Medical Image Analysis by Unifying the Search on Data Augmentation and Neural Architecture

abstract: Automated data augmentation, which aims at engineering augmentation policy automatically, recently draw a growing research interest. Many previous auto-augmentation methods utilized a Density Matching strategy by evaluating policies in terms of the test-time augmentation performance. In this paper, we theoretically and empirically demonstrated the inconsistency between the train and validation set of small-scale medical image datasets, referred to as in-domain sampling bias. Next, we demonstrated that the in-domain sampling bias might cause the inefficiency of Density Matching. To address the problem, an improved augmentation search strategy, named Augmented Density Matching, was proposed by randomly sampling policies from a prior distribution for training. Moreover, an efficient automatical machine learning(AutoML) algorithm was proposed by unifying the search on data augmentation and neural architecture. Experimental results indicated that the proposed methods outperformed state-of-the-art approaches on MedMNIST, a pioneering benchmark designed for AutoML in medical image analysis.


title: Evolution of the accelerated charged vortex particle in an inhomogeneous magnetic lens

abstract: We present a detailed analysis of the capture and acceleration of a non-relativistic charged vortex particle (electron, positron, proton, etc.) with an orbital angular momentum in a field of an axisymmetric electromagnetic lens, typical for a linear accelerator. We account for the acceleration as well as for the inhomogeneity of both electric and magnetic fields that may arise from some real-life imperfections. We establish conditions when the wave packet can be captured and successfully transported through the lens. We describe the transition process and explain how a free Laguerre-Gaussian packet could be captured into the Landau state of the lens preserving its structure for all moments in time. Several representative examples are provided to illustrate developed formalism.


title: Secure Lightweight Authentication for Multi User IoT Environment

abstract: The Internet of Things (IoT) is giving a boost to a plethora of new opportunities for the robust and sustainable deployment of cyber physical systems. The cornerstone of any IoT system is the sensing devices. These sensing devices have considerable resource constraints, including insufficient battery capacity, CPU capability, and physical security. Because of such resource constraints, designing lightweight cryptographic protocols is an opportunity. Remote User Authentication ensures that two parties establish a secure and durable session key. This study presents a lightweight and safe authentication strategy for the user-gateway (U GW) IoT network model. The proposed system is designed leveraging Elliptic Curve Cryptography (ECC). We undertake a formal security analysis with both the Automated Validation of Internet Security Protocols (AVISPA) and Burrows Abadi Needham (BAN) logic tools and an information security assessment with the Delev Yao channel. We use publish subscribe based Message Queuing Telemetry Transport (MQTT) protocol for communication. Additionally, the performance analysis and comparison of security features show that the proposed scheme is resilient to well known cryptographic threats.


title: Learning from Data with Noisy Labels Using Temporal Self-Ensemble

abstract: There are inevitably many mislabeled data in real-world datasets. Because deep neural networks (DNNs) have an enormous capacity to memorize noisy labels, a robust training scheme is required to prevent labeling errors from degrading the generalization performance of DNNs. Current state-of-the-art methods present a co-training scheme that trains dual networks using samples associated with small losses. In practice, however, training two networks simultaneously can burden computing resources. In this study, we propose a simple yet effective robust training scheme that operates by training only a single network. During training, the proposed method generates temporal self-ensemble by sampling intermediate network parameters from the weight trajectory formed by stochastic gradient descent optimization. The loss sum evaluated with these self-ensembles is used to identify incorrectly labeled samples. In parallel, our method generates multi-view predictions by transforming an input data into various forms and considers their agreement to identify incorrectly labeled samples. By combining the aforementioned metrics, we present the proposed {\it self-ensemble-based robust training} (SRT) method, which can filter the samples with noisy labels to reduce their influence on training. Experiments on widely-used public datasets demonstrate that the proposed method achieves a state-of-the-art performance in some categories without training the dual networks.


title: Unimodal vs. Multimodal Siamese Networks for Outfit Completion

abstract: The popularity of online fashion shopping continues to grow. The ability to offer an effective recommendation to customers is becoming increasingly important. In this work, we focus on Fashion Outfits Challenge, part of SIGIR 2022 Workshop on eCommerce. The challenge is centered around Fill in the Blank (FITB) task that implies predicting the missing outfit, given an incomplete outfit and a list of candidates. In this paper, we focus on applying siamese networks on the task. More specifically, we explore how combining information from multiple modalities (textual and visual modality) impacts the performance of the model on the task. We evaluate our model on the test split provided by the challenge organizers and the test split with gold assignments that we created during the development phase. We discover that using both visual, and visual and textual data demonstrates promising results on the task. We conclude by suggesting directions for further improvement of our method.


title: Exclusive J/$\psi$ Detection and Physics with ECCE

abstract: Exclusive heavy quarkonium photoproduction is one of the most popular processes in EIC, which has a large cross section and a simple final state. Due to the gluonic nature of the exchange Pomeron, this process can be related to the gluon distributions in the nucleus. The momentum transfer dependence of this process is sensitive to the interaction sites, which provides a powerful tool to probe the spatial distribution of gluons in the nucleus. Recently the problem of the origin of hadron mass has received lots of attention in determining the anomaly contribution $M_{a}$. The trace anomaly is sensitive to the gluon condensate, and exclusive production of quarkonia such as J/$\psi$ and $\Upsilon$ can serve as a sensitive probe to constrain it. In this paper, we present the performance of the ECCE detector for exclusive J/$\psi$ detection and the capability of this process to investigate the above physics opportunities with ECCE.


title: Synthesizing Light Field Video from Monocular Video

abstract: The hardware challenges associated with light-field(LF) imaging has made it difficult for consumers to access its benefits like applications in post-capture focus and aperture control. Learning-based techniques which solve the ill-posed problem of LF reconstruction from sparse (1, 2 or 4) views have significantly reduced the requirement for complex hardware. LF video reconstruction from sparse views poses a special challenge as acquiring ground-truth for training these models is hard. Hence, we propose a self-supervised learning-based algorithm for LF video reconstruction from monocular videos. We use self-supervised geometric, photometric and temporal consistency constraints inspired from a recent self-supervised technique for LF video reconstruction from stereo video. Additionally, we propose three key techniques that are relevant to our monocular video input. We propose an explicit disocclusion handling technique that encourages the network to inpaint disoccluded regions in a LF frame, using information from adjacent input temporal frames. This is crucial for a self-supervised technique as a single input frame does not contain any information about the disoccluded regions. We also propose an adaptive low-rank representation that provides a significant boost in performance by tailoring the representation to each input scene. Finally, we also propose a novel refinement block that is able to exploit the available LF image data using supervised learning to further refine the reconstruction quality. Our qualitative and quantitative analysis demonstrates the significance of each of the proposed building blocks and also the superior results compared to previous state-of-the-art monocular LF reconstruction techniques. We further validate our algorithm by reconstructing LF videos from monocular videos acquired using a commercial GoPro camera.


title: Domain Decomposition Learning Methods for Solving Elliptic Problems

abstract: With recent advancements in computer hardware and software platforms, there has been a surge of interest in solving partial differential equations with deep learning-based methods, and the integration with domain decomposition strategies has attracted considerable attention owing to its enhanced representation and parallelization capacities of the network solution. While there are already several works that substitute the subproblem solver with neural networks for overlapping Schwarz methods, the non-overlapping counterpart has not been extensively explored because of the inaccurate flux estimation at interface that would propagate errors to neighbouring subdomains and eventually hinder the convergence of outer iterations. In this study, a novel learning approach for solving elliptic boundary value problems, i.e., the compensated deep Ritz method using neural network extension operators, is proposed to enable reliable flux transmission across subdomain interfaces, thereby allowing us to construct effective learning algorithms for realizing non-overlapping domain decomposition methods (DDMs) in the presence of erroneous interface conditions. Numerical experiments on a variety of elliptic problems, including regular and irregular interfaces, low and high dimensions, two and four subdomains, and smooth and high-contrast coefficients are carried out to validate the effectiveness of our proposed algorithms.


title: First principles investigations in the carbon silicon system of novel tetragonal C8 (diamond) and Si8 allotropes and binary Si4C4 phase

abstract: Novel extended networks of C8, Si8 and silicon carbide Si4C4 are proposed based on crystal chemistry rationale and optimized structures to ground state energies and derived physical properties within the density functional theory (DFT). The two carbon and silicon allotropes and the silicon carbide belong to primitive tetragonal space group P-4m2 Number 115. C8 allotrope structure made of corner sharing C4 and Si4 tetrahedra is illustrated by charge density projections exhibiting sp3 like carbon hybridization. From careful symmetry analysis, Symmetry analysis of C8 indicated that it is another representation of cubic diamond, space group F-d3m Number 227. C8 is identified as ultra-hard with a similar magnitude of Vickers hardness. The interest in C8 is to serve as template to study Si8 and Si-C binary. Si8 allotrope is found soft with HV =13 GPa alike cubic Si, and Si4C4 is identified with HV =33 GPa close to experimental SiC. All three new phases are mechanically (elastic constants) and dynamically (phonons) stable, and their electronic band structures are characteristic of insulating C8 (diamond) with large band gaps of about 5 eV, and semi-conducting Si8 and Si4C4 with band gaps of about 1 eV.


title: Spin-orbit transitions in the N$^+$($^3P_{J_A}$) + H$_2$ $\rightarrow$ NH$^+$($X^2\Pi$, $^4\Sigma^-$)+ H($^2S$) reaction, using adiabatic and mixed quantum-adiabatic statistical approaches

abstract: The cross section and rate constants for the title reaction are calculated for all the spin-orbit states of N$^+$($^3P_{J_A}$) using two statistical approaches, one purely adiabatic and the other one mixing quantum capture for the entrance channel and adiabatic treatment for the products channel. This is made by using a symmetry adapted basis set combining electronic (spin and orbital) and nuclear angular momenta in the reactants channel. To this aim, accurate {\it ab initio} calculations are performed separately for reactants and products. In the reactants channel, the three lowest electronic states (without spin-orbit couplings) have been diabatized, and the spin-orbit couplings have been introduced through a model localizing the spin-orbit interactions in the N$^+$ atom, which yields accurate results as compared to {\it ab initio} calculations including spin-orbit couplings. For the products, eleven purely adiabatic spin-orbit states have been determined with {\it ab initio} calculations. The reactive rate constants thus obtained are in very good agreement with the available experimental data for several ortho-H$_2$ fractions, assuming a thermal initial distribution of spin-orbit states. The rate constants for selected spin-orbit $J_A$ states are obtained, to provide a proper validation of the spin-orbit effects to obtain the experimental rate constants.


title: A non-equilibrium superradiant phase transition in free space

abstract: A class of systems exists in which dissipation, external drive and interactions compete and give rise to non equilibrium phases that would not exist without the drive. There, phase transitions could occur without the breaking of any symmetry, yet with a local order parameter, in contrast with the Landau theory of phase transitions at equilibrium. One of the simplest driven dissipative quantum systems consists of two-level atoms enclosed in a volume smaller than the wavelength of the atomic transition cubed, driven by a light field. The competition between collective coupling of the atoms to the driving field and their cooperative decay should lead to a transition between a phase where all the atomic dipoles are phaselocked and a phase governed by superradiant spontaneous emission. Here, we realize this model using a pencil-shaped cloud of laser cooled atoms in free space, optically excited along its main axis, and observe the predicted phases. Our demonstration is promising in view of obtaining free-space superradiant lasers or to observe new types of time crystals.


title: LocVTP: Video-Text Pre-training for Temporal Localization

abstract: Video-Text Pre-training (VTP) aims to learn transferable representations for various downstream tasks from large-scale web videos. To date, almost all existing VTP methods are limited to retrieval-based downstream tasks, e.g., video retrieval, whereas their transfer potentials on localization-based tasks, e.g., temporal grounding, are under-explored. In this paper, we experimentally analyze and demonstrate the incompatibility of current VTP methods with localization tasks, and propose a novel Localization-oriented Video-Text Pre-training framework, dubbed as LocVTP. Specifically, we perform the fine-grained contrastive alignment as a complement to the coarse-grained one by a clip-word correspondence discovery scheme. To further enhance the temporal reasoning ability of the learned feature, we propose a context projection head and a temporal aware contrastive loss to perceive the contextual relationships. Extensive experiments on four downstream tasks across six datasets demonstrate that our LocVTP achieves state-of-the-art performance on both retrieval-based and localization-based tasks. Furthermore, we conduct comprehensive ablation studies and thorough analyses to explore the optimum model designs and training strategies.


title: Independence complexes of $(n \times 6)$-grid graphs

abstract: We determine the homotopy types of the independence complexes of the $(n \times 6)$-square grid graphs. In fact, we show that these complexes are homotopy equivalent to wedges of spheres.


title: A physically motivated `charge-exchange method' for measuring electron temperatures within HII regions

abstract: Aims: Temperature uncertainties plague our understanding of abundance variations within the ISM. Using the PHANGS-MUSE large program, we develop and apply a new technique to model the strong emission lines arising from HII regions in 19 nearby spiral galaxies at ~50 pc resolution and infer electron temperatures for the nebulae. Methods: Due to the charge-exchange coupling of the ionization fraction of the atomic oxygen to that of hydrogen, the emissivity of the observed [OI]6300/Ha line ratio can be modeled as a function of gas phase oxygen abundance (O/H), ionization fraction (f_ion) and electron temperature (T_e). We measure (O/H) using a strong line metallicity calibration, and identify a correlation between f_ion and [SIII]9069/[SII]6716,6730, tracing ionization parameter variations. Results: We solve for T_e, and test the method by reproducing direct measurements of T_e([NII]5755) based on auroral line detections to within ~600 K. We apply this charge-exchange method of calculating T_e to 4,129 HII regions across 19 PHANGS-MUSE galaxies. We uncover radial temperature gradients, increased homogeneity on small scales, and azimuthal temperature variations in the disks that correspond to established abundance patterns. This new technique for measuring electron temperatures leverages the growing availability of optical integral field unit spectroscopic maps across galaxy samples, increasing the statistics available compared to direct auroral line detections.


title: A perspective on the fragility of glass-forming liquids

abstract: We discuss possible extraneous effects entering in the conventional measures of "fragility" at atmospheric pressure that may obscure a characterization of the genuine super-Arrhenius slowdown of relaxation. We first consider the role of density, which increases with decreasing temperature at constant pressure, and then the potential influence of the high-temperature dynamical behavior and of the associated activation energy scale. These two effects involve both thermodynamic parameters and the strength of the "bare" activation energy reflecting the specific bonding between neighboring molecules. They vary from system to system with, most likely, little connection with any putative collective behavior associated with glass formation. We show how to scale these effects out by refining the definition of fragility and modifying the celebrated Angell plot. We dedicate this note to our great and so inspiring friend, Austen Angell, and associate in this tribute another dear colleague who died too soon, Daniel Kivelson.


title: Regularity and Neumann problems for operators with real coefficients satisfying Carleson condition

abstract: In this paper, we continue the study of a class of second order elliptic operators of the form $\mathcal L=\mbox{div}(A\nabla\cdot)$ in a domain above a Lipschitz graph in $\mathbb R^n,$ where the coefficients of the matrix $A$ satisfy a Carleson measure condition, expressed as a condition on the oscillation on Whitney balls. For this class of operators, it is known (since 2001) that the $L^q$ Dirichlet problem is solvable for some $1 < q < \infty$. Moreover, further studies completely resolved the range of $L^q$ solvability of the Dirichlet, Regularity, Neumann problems in Lipschitz domains, when the Carleson measure norm of the oscillation is sufficiently small. We show that there exists $p_{reg}>1$ such that for all $1<p<p_{reg}$ the $L^p$ Regularity problem for the operator $\mathcal L=\mbox{div}(A\nabla\cdot)$ is solvable. Furthermore $\frac1{p_{reg}}+\frac1{q_*}=1$ where $q_*>1$ is the number such that the $L^q$ Dirichlet problem for the adjoint operator $\mathcal L^*$ is solvable for all $q>q_*$. Additionally when $n=2$, there exists $p_{neum}>1$ such that for all $1<p<p_{neum}$ the $L^p$ Neumann problem for the operator $\mathcal L=\mbox{div}(A\nabla\cdot)$ is solvable. Furthermore $\frac1{p_{reg}}+\frac1{q^*}=1$ where $q^*>1$ is the number such that the $L^q$ Dirichlet problem for the operator $\mathcal L_1=\mbox{div}(A_1\nabla\cdot)$ with matrix $A_1=A/\det{A}$ is solvable for all $q>q^*$.


title: EC-KitY: Evolutionary Computation Tool Kit in Python with Seamless Machine Learning Integration

abstract: EC-KitY is a comprehensive Python library for doing evolutionary computation (EC), licensed under the BSD 3-Clause License, and compatible with scikit-learn. Designed with modern software engineering and machine learning integration in mind, EC-KitY can support all popular EC paradigms, including genetic algorithms, genetic programming, coevolution, evolutionary multi-objective optimization, and more. This paper provides an overview of the package, including the ease of setting up an EC experiment, the architecture, the main features, and a comparison with other libraries.


title: Land Classification in Satellite Images by Injecting Traditional Features to CNN Models

abstract: Deep learning methods have been successfully applied to remote sensing problems for several years. Among these methods, CNN based models have high accuracy in solving the land classification problem using satellite or aerial images. Although these models have high accuracy, this generally comes with large memory size requirements. On the other hand, it is desirable to have small-sized models for applications, such as the ones implemented on unmanned aerial vehicles, with low memory space. Unfortunately, small-sized CNN models do not provide high accuracy as with their large-sized versions. In this study, we propose a novel method to improve the accuracy of CNN models, especially the ones with small size, by injecting traditional features to them. To test the effectiveness of the proposed method, we applied it to the CNN models SqueezeNet, MobileNetV2, ShuffleNetV2, VGG16, and ResNet50V2 having size 0.5 MB to 528 MB. We used the sample mean, gray level co-occurrence matrix features, Hu moments, local binary patterns, histogram of oriented gradients, and color invariants as traditional features for injection. We tested the proposed method on the EuroSAT dataset to perform land classification. Our experimental results show that the proposed method significantly improves the land classification accuracy especially when applied to small-sized CNN models.


title: Extremal subsets in geodesically complete spaces with curvature bounded above

abstract: We introduce the notion of an extremal subset in a geodesically complete space with curvature bounded above, i.e., a GCBA space. This is an analogue of an extremal subset in an Alexandrov space with curvature bounded below introduced by Perelman and Petrunin. We prove that under an additional assumption the set of topological singularities in a GCBA space forms an extremal subset. We also exhibit some structural properties of extremal subsets in GCBA spaces.


title: Forward start volatility swaps in rough volatility models

abstract: This paper shows the relationship between the forward start volatility swap price and the forward start zero vanna implied volatility of forward start options in rough volatility models. It is shown that in the short time-to-maturity limit the approximation error in the leading term of the correlated case with $H\in(0,\frac12)$ does not depend on the time to forward start date, but only on the difference between the maturity date and forward start date and on the Hurst parameter $H$.


title: UAV Trajectory, User Association and Power Control for Multi-UAV Enabled Energy Harvesting Communications: Offline Design and Online Reinforcement Learning

abstract: In this paper, we consider multiple solar-powered wireless nodes which utilize the harvested solar energy to transmit collected data to multiple unmanned aerial vehicles (UAVs) in the uplink. In this context, we jointly design UAV flight trajectories, UAV-node communication associations, and uplink power control to effectively utilize the harvested energy and manage co-channel interference within a finite time horizon. To ensure the fairness of wireless nodes, the design goal is to maximize the worst user rate. The joint design problem is highly non-convex and requires causal (future) knowledge of the instantaneous energy state information (ESI) and channel state information (CSI), which are difficult to predict in reality. To overcome these challenges, we propose an offline method based on convex optimization that only utilizes the average ESI and CSI. The problem is solved by three convex subproblems with successive convex approximation (SCA) and alternative optimization. We further design an online convex-assisted reinforcement learning (CARL) method to improve the system performance based on real-time environmental information. An idea of multi-UAV regulated flight corridors, based on the optimal offline UAV trajectories, is proposed to avoid unnecessary flight exploration by UAVs and enables us to improve the learning efficiency and system performance, as compared with the conventional reinforcement learning (RL) method. Computer simulations are used to verify the effectiveness of the proposed methods. The proposed CARL method provides 25% and 12% improvement on the worst user rate over the offline and conventional RL methods.


title: Convergence analysis of multi-step one-shot methods for linear inverse problems

abstract: In this work we are interested in general linear inverse problems where the corresponding forward problem is solved iteratively using fixed point methods. Then one-shot methods, which iterate at the same time on the forward problem solution and on the inverse problem unknown, can be applied. We analyze two variants of the so-called multi-step one-shot methods and establish sufficient conditions on the descent step for their convergence, by studying the eigenvalues of the block matrix of the coupled iterations. Several numerical experiments are provided to illustrate the convergence of these methods in comparison with the classical usual and shifted gradient descent. In particular, we observe that very few inner iterations on the forward problem are enough to guarantee good convergence of the inversion algorithm.


title: Sensitivities and Hedging of the Collateral Choice Option

abstract: The collateral choice option allows a collateral-posting party the opportunity to change the type of security in which the collateral is deposited. Due to non-zero collateral basis spreads, this optionality significantly impacts asset valuation. Because of the complexity of valuing the option, many practitioners resort to deterministic assumptions on the collateral rates. In this article, we focus on a valuation model of the collateral choice option based on stochastic dynamics. Intrinsic differences in the resulting collateral choice option valuation and its implications for collateral management are presented. We obtain sensitivities of the collateral choice option price under both the deterministic and the stochastic model, and we show that the stochastic model attributes risks to all involved collateral currencies. Besides an inability to capture volatility effects, the deterministic model exhibits a digital structure in which only the cheapest-to-deliver currency influences the valuation at a given time. We further consider hedging an asset with the collateral choice option by a portfolio of domestic and foreign zero-coupon bonds that do not carry the collateral choice option. We propose static hedging strategies based on the crossing times of the deterministic model and based on variance-minimization under the stochastic model. We show how the weights of this model can be explicitly determined with the semi-analytical common factor approach and we show in numerical experiments that this strategy offers good hedging performance under minimized variance.


title: Thermal Transitions in Domain Wall AdS/QCD

abstract: We study thermal transitions in a Domain Wall AdS/QCD model. The model is based on the D5/probe D7 system with a discontinuous mass profile which restricts chiral fermions to 3+1 dimensional domain walls. Fluctuations on the domain wall are dual to the quark mass and condensate and reveal the relation between domain wall separation and the quark mass. The massive quarks exhibit a second order thermal, meson melting transition. Witten's multi-trace prescription can be used to interpret these configurations as having a dynamical mass from a Nambu-Jona-Lasinio interaction - here the transition is first order. Confinement can be introduced into the gauge sector by compactifying one direction of the D5. Compactification induces chiral symmetry breaking and there is a first order thermal restoration transition. If an NJL interaction is also introduced then the confinement and chiral symmetry breaking scales can be separated.


title: Sato-Tate Distribution of $p$-adic hypergeometric functions

abstract: Recently Ono, Saad and the second author \cite{KHN} initiated a study of value distribution of certain families of Gaussian hypergeometric functions over large finite fields. They investigated two families of Gaussian hypergeometric functions and showed that they satisfy semicircular and Batman distributions. Motivated by their results we aim to study distributions of certain families of hypergeometric functions in the $p$-adic setting over large finite fields. In particular, we consider two and six parameters families of hypergeometric functions in the $p$-adic setting and obtain that their limiting distributions are semicircular over large finite fields. In the process of doing this we also express the traces of $p$th Hecke operators acting on the spaces of cusp forms of even weight $k\geq4$ and levels 4 and 8 in terms of $p$-adic hypergeometric function which is of independent interest. These results can be viewed as $p$-adic analogous of some trace formulas of \cite{ah, ah-ono, fop}.


title: Multi-Asset Closed-Loop Reservoir Management Using Deep Reinforcement Learning

abstract: Closed-loop reservoir management (CLRM), in which history matching and production optimization are performed multiple times over the life of an asset, can provide significant improvement in the specified objective. These procedures are computationally expensive due to the large number of flow simulations required for data assimilation and optimization. Existing CLRM procedures are applied asset by asset, without utilizing information that could be useful over a range assets. Here, we develop a CLRM framework for multiple assets with varying numbers of wells. We use deep reinforcement learning to train a single global control policy that is applicable for all assets considered. The new framework is an extension of a recently introduced control policy methodology for individual assets. Embedding layers are incorporated into the representation to handle the different numbers of decision variables that arise for the different assets. Because the global control policy learns a unified representation of useful features from multiple assets, it is less expensive to construct than asset-by-asset training (we observe about 3x speedup in our examples). The production optimization problem includes a relative-change constraint on the well settings, which renders the results suitable for practical use. We apply the multi-asset CLRM framework to 2D and 3D water-flooding examples. In both cases, four assets with different well counts, well configurations, and geostatistical descriptions are considered. Numerical experiments demonstrate that the global control policy provides objective function values, for both the 2D and 3D cases, that are nearly identical to those from control policies trained individually for each asset. This promising finding suggests that multi-asset CLRM may indeed represent a viable practical strategy.

categories: cs.LG cs.AI math.OC physics.comp-ph physics.geo-ph


title: Normalized solutions to lower critical Choquard equation with a local perturbation

abstract: In this paper, we study the existence and non-existence of normalized solutions to the lower critical Choquard equation with a local perturbation \begin{equation*} \begin{cases} -\Delta u+\lambda u=\gamma (I_{\alpha}\ast|u|^{\frac{N+\alpha}{N}})|u|^{\frac{N+\alpha}{N}-2}u+\mu |u|^{q-2}u,\quad \text{in}\ \mathbb{R}^N, \\ \int_{\mathbb{R}^N}|u|^2dx=c^2, \end{cases} \end{equation*} where $\gamma, \mu, c>0$, $2<q\leq 2+\frac{4}{N}$, and $\lambda\in\mathbb{R}$ is an unknown parameter that appears as a Lagrange multiplier. The results of this paper about this equation answer some questions proposed by Yao, Chen, R\v{a}dulescu and Sun [Siam J. Math. Anal., 54(3) (2022), 3696-3723]. Moreover, based on the results obtained, we study the multiplicity of normalized solutions to the non-autonomous Choquard equation \begin{equation*} \begin{cases} -\Delta u+\lambda u=(I_\alpha\ast [h(\epsilon x)|u|^{\frac{N+\alpha}{N}}])h(\epsilon x)|u|^{\frac{N+\alpha}{N}-2}u+\mu|u|^{q-2}u,\ x\in \mathbb{R}^N, \\ \int_{\mathbb{R}^N}|u|^2dx=c^2, \end{cases} \end{equation*} where $\epsilon>0$, $2<q<2+\frac{4}{N}$, and $h$ is a positive and continuous function. It is proved that the numbers of normalized solutions are at least the numbers of global maximum points of $h$ when $\epsilon$ is small enough.


title: Cosmological prior for the $J$-factor estimation of dwarf spheroidal galaxies

abstract: Dark matter halos of dwarf spheroidal galaxies (dSphs) play important roles in dark matter detection. Generally we estimate the halo profile using a kinematical equation of dSphs but the halo profile has a large uncertainty because we have only a limited number of kinematical dataset. In this paper, we utilize cosmological models of dark matter subhalos to obtain better constraints on halo profile of dSphs. The constraints are realized as two cosmological priors: satellite prior, based on a semi-analytic model of the accretion history of subhalos and their tidal stripping effect, and stellar-to-halo mass relation prior, which estimates halo mass of a galaxy from its stellar mass using empirical correlations. In addition, we adopt a radial dependent likelihood function by considering velocity dispersion profile, which allows us to mitigate the parameter degeneracy in the previous analysis using a radial independent likelihood function with averaged dispersion. Using these priors, we estimate the squared dark matter density integrated over the region-of-interest (so-called $J$-factor) of 8 classical and 27 ultra-faint dSphs. Our method significantly decreases the uncertainty of $J$-factors (upto about $20\%$) compared to the previous radial independent analysis. We confirm the model dependence of $J$-factor estimates by evaluating Bayes factors of different model setups and find that the estimates are still stable even when assuming different cosmological models.


title: Temporal Saliency Query Network for Efficient Video Recognition

abstract: Efficient video recognition is a hot-spot research topic with the explosive growth of multimedia data on the Internet and mobile devices. Most existing methods select the salient frames without awareness of the class-specific saliency scores, which neglect the implicit association between the saliency of frames and its belonging category. To alleviate this issue, we devise a novel Temporal Saliency Query (TSQ) mechanism, which introduces class-specific information to provide fine-grained cues for saliency measurement. Specifically, we model the class-specific saliency measuring process as a query-response task. For each category, the common pattern of it is employed as a query and the most salient frames are responded to it. Then, the calculated similarities are adopted as the frame saliency scores. To achieve it, we propose a Temporal Saliency Query Network (TSQNet) that includes two instantiations of the TSQ mechanism based on visual appearance similarities and textual event-object relations. Afterward, cross-modality interactions are imposed to promote the information exchange between them. Finally, we use the class-specific saliencies of the most confident categories generated by two modalities to perform the selection of salient frames. Extensive experiments demonstrate the effectiveness of our method by achieving state-of-the-art results on ActivityNet, FCVID and Mini-Kinetics datasets. Our project page is at https://lawrencexia2008.github.io/projects/tsqnet .


title: Lower bound for the 2-adic valuations of central $L$-values of elliptic curves with complex multiplication

abstract: Let $E_{-D}$ be the elliptic curve $y^2=x^3+Dx$ defined over $K=\mathbb{Q}(i)$ for $D\in K$ which is coprime to 2. In this paper, we give a lower bound for the 2-adic valuation of the algebraic part of the central value of Hecke $L$-function associated to $E_{-D}$.


title: Minimizing the phase structure of quark mass matrices

abstract: Fritzsch-Xing matrices are a particular class of texture 4 zero hermitian quark mass matrices, known to be successful in accommodating the quark mixing data. In the present work, it is shown that these texture 4-zero matrices with only one phase parameter, unlike the usually considered two phase parameters, are not only consistent with the latest experimental quark mixing data, but also predict the CP violation parameters, $J$ and corresponding phase $\delta$, in agreement with the recent global analyses. We also show that the mass matrix elements do not exhibit a strong hierarchy and there is a strong correlation between some of the mass matrix elements of up and down sector. A precision measurement of $\delta$ as well as small quark masses would have the potential to constrain the phase structure of the matrices further.


title: Canonical Witt formal scheme extensions and p-torsion groups

abstract: We study the $n$-th arithmetic jet space of the $p$-torsion subgroup attached to a smooth commutative formal group scheme. We show that the $n$-th jet space above fits in the middle of a canonical short exact sequence between a power of the formal scheme of Witt vectors of length $n$ and the $p$-torsion subgroup we started with. This result generalizes a result of Buium on roots of unity.


title: Optimal locally recoverable codes with hierarchy from nested $F$-adic expansions

abstract: In this paper we construct new optimal hierarchical locally recoverable codes. Our construction is based on a combination of the ideas of \cite{ballentine2019codes,sasidharan2015codes} with an algebraic number theoretical approach that allows to give a finer tuning of the minimum distance of the intermediate code (allowing larger dimension of the final code), and to remove restrictions on the arithmetic properties of $q$ compared with the size of the locality sets in the hierarchy. In turn, we manage to obtain codes with a wide set of parameters both for the size $q$ of the base field, and for the hierarchy size, while keeping the optimality of the codes we construct.


title: Detecting Shortcut Learning for Fair Medical AI using Shortcut Testing

abstract: Machine learning (ML) holds great promise for improving healthcare, but it is critical to ensure that its use will not propagate or amplify health disparities. An important step is to characterize the (un)fairness of ML models - their tendency to perform differently across subgroups of the population - and to understand its underlying mechanisms. One potential driver of algorithmic unfairness, shortcut learning, arises when ML models base predictions on improper correlations in the training data. However, diagnosing this phenomenon is difficult, especially when sensitive attributes are causally linked with disease. Using multi-task learning, we propose the first method to assess and mitigate shortcut learning as a part of the fairness assessment of clinical ML systems, and demonstrate its application to clinical tasks in radiology and dermatology. Finally, our approach reveals instances when shortcutting is not responsible for unfairness, highlighting the need for a holistic approach to fairness mitigation in medical AI.


title: Integrating Terrestrial and Non-terrestrial Networks: 3D Opportunities and Challenges

abstract: Integrating terrestrial and non-terrestrial networks has the potential of connecting the unconnected and enhancing the user experience for the already-connected, with technological and societal implications of the greatest long-term significance. A convergence of ground, air, and space wireless communications also represents a formidable endeavor for the mobile and satellite communications industries alike, as it entails defining and intelligently orchestrating a new 3D wireless network architecture. In this article, we present the key opportunities and challenges arising from this (r)evolution by presenting some of its disruptive use-cases and key building blocks, reviewing the relevant standardization activities, and pointing to open research problems. By considering two multi-operator paradigms, we also showcase how terrestrial networks could be efficiently re-engineered to cater for aerial services, or opportunistically complemented by non-terrestrial infrastructure to augment their current capabilities.


title: Temporal Verification with Answer-Effect Modification

abstract: Type-and-effect systems are a widely-used approach to program verification, verifying the result of a computation using types, and the behavior using effects. This paper extends an effect system for verifying temporal, value-dependent properties on event sequences yielded by programs to the delimited control operators shift0/reset0. While these delimited control operators enable useful and powerful programming techniques, they hinder reasoning about the behavior of programs because of their ability to suspend, resume, discard, and duplicate delimited continuations. This problem is more serious in effect systems for temporal properties because these systems must be capable of identifying what event sequences are yielded by captured continuations. Our key observation for achieving effective reasoning in the presence of the delimited control operators is that their use modifies answer effects, which are temporal effects of the continuations. Based on this observation, we extend an effect system for temporal verification to accommodate answer-effect modification. Allowing answer-effect modification enables easily reasoning about traces that captured continuations yield. Another novel feature of our effect system is the support for dependently-typed continuations, which allows us to reason about programs more precisely. We prove soundness of the effect system for finite event sequences via type safety and that for infinite event sequences using a logical relation.


title: Pose for Everything: Towards Category-Agnostic Pose Estimation

abstract: Existing works on 2D pose estimation mainly focus on a certain category, e.g. human, animal, and vehicle. However, there are lots of application scenarios that require detecting the poses/keypoints of the unseen class of objects. In this paper, we introduce the task of Category-Agnostic Pose Estimation (CAPE), which aims to create a pose estimation model capable of detecting the pose of any class of object given only a few samples with keypoint definition. To achieve this goal, we formulate the pose estimation problem as a keypoint matching problem and design a novel CAPE framework, termed POse Matching Network (POMNet). A transformer-based Keypoint Interaction Module (KIM) is proposed to capture both the interactions among different keypoints and the relationship between the support and query images. We also introduce Multi-category Pose (MP-100) dataset, which is a 2D pose dataset of 100 object categories containing over 20K instances and is well-designed for developing CAPE algorithms. Experiments show that our method outperforms other baseline approaches by a large margin. Codes and data are available at https://github.com/luminxu/Pose-for-Everything.


title: NSNet: Non-saliency Suppression Sampler for Efficient Video Recognition

abstract: It is challenging for artificial intelligence systems to achieve accurate video recognition under the scenario of low computation costs. Adaptive inference based efficient video recognition methods typically preview videos and focus on salient parts to reduce computation costs. Most existing works focus on complex networks learning with video classification based objectives. Taking all frames as positive samples, few of them pay attention to the discrimination between positive samples (salient frames) and negative samples (non-salient frames) in supervisions. To fill this gap, in this paper, we propose a novel Non-saliency Suppression Network (NSNet), which effectively suppresses the responses of non-salient frames. Specifically, on the frame level, effective pseudo labels that can distinguish between salient and non-salient frames are generated to guide the frame saliency learning. On the video level, a temporal attention module is learned under dual video-level supervisions on both the salient and the non-salient representations. Saliency measurements from both two levels are combined for exploitation of multi-granularity complementary information. Extensive experiments conducted on four well-known benchmarks verify our NSNet not only achieves the state-of-the-art accuracy-efficiency trade-off but also present a significantly faster (2.4~4.3x) practical inference speed than state-of-the-art methods. Our project page is at https://lawrencexia2008.github.io/projects/nsnet .


title: Geometric quadratic Chabauty and $p$-adic heights

abstract: Let $X$ be a curve of genus $g>1$ over $\mathbb{Q}$ whose Jacobian $J$ has Mordell--Weil rank $r$ and N\'eron--Severi rank $\rho$. When $r < g+ \rho - 1$, the geometric quadratic Chabauty method determines a finite set of $p$-adic points containing the rational points of $X$. We describe algorithms for geometric quadratic Chabauty that translate the geometric quadratic Chabauty method into the language of $p$-adic heights and $p$-adic (Coleman) integrals. This translation also allows us to give a comparison to the (original) cohomological method for quadratic Chabauty. We show that the finite set of $p$-adic points produced by the geometric method is contained in the finite set produced by the cohomological method, and give a description of their difference.


title: On the Implementation of a Reinforcement Learning-based Capacity Sharing Algorithm in O-RAN

abstract: The capacity sharing problem in Radio Access Network (RAN) slicing deals with the distribution of the capacity available in each RAN node among various RAN slices to satisfy their traffic demands and efficiently use the radio resources. While several capacity sharing algorithmic solutions have been proposed in the literature, their practical implementation still remains as a gap. In this paper, the implementation of a Reinforcement Learning-based capacity sharing algorithm over the O-RAN architecture is discussed, providing insights into the operation of the involved interfaces and the containerization of the solution. Moreover, the description of the testbed implemented to validate the solution is included and some performance and validation results are presented.


title: Error Compensation Framework for Flow-Guided Video Inpainting

abstract: The key to video inpainting is to use correlation information from as many reference frames as possible. Existing flow-based propagation methods split the video synthesis process into multiple steps: flow completion -> pixel propagation -> synthesis. However, there is a significant drawback that the errors in each step continue to accumulate and amplify in the next step. To this end, we propose an Error Compensation Framework for Flow-guided Video Inpainting (ECFVI), which takes advantage of the flow-based method and offsets its weaknesses. We address the weakness with the newly designed flow completion module and the error compensation network that exploits the error guidance map. Our approach greatly improves the temporal consistency and the visual quality of the completed videos. Experimental results show the superior performance of our proposed method with the speed up of x6, compared to the state-of-the-art methods. In addition, we present a new benchmark dataset for evaluation by supplementing the weaknesses of existing test datasets.


title: FADE: Fusing the Assets of Decoder and Encoder for Task-Agnostic Upsampling

abstract: We consider the problem of task-agnostic feature upsampling in dense prediction where an upsampling operator is required to facilitate both region-sensitive tasks like semantic segmentation and detail-sensitive tasks such as image matting. Existing upsampling operators often can work well in either type of the tasks, but not both. In this work, we present FADE, a novel, plug-and-play, and task-agnostic upsampling operator. FADE benefits from three design choices: i) considering encoder and decoder features jointly in upsampling kernel generation; ii) an efficient semi-shift convolutional operator that enables granular control over how each feature point contributes to upsampling kernels; iii) a decoder-dependent gating mechanism for enhanced detail delineation. We first study the upsampling properties of FADE on toy data and then evaluate it on large-scale semantic segmentation and image matting. In particular, FADE reveals its effectiveness and task-agnostic characteristic by consistently outperforming recent dynamic upsampling operators in different tasks. It also generalizes well across convolutional and transformer architectures with little computational overhead. Our work additionally provides thoughtful insights on what makes for task-agnostic upsampling. Code is available at: http://lnkiy.in/fade_in


title: New CuSO4-related high-temperature polymorph of AgIISO4

abstract: Silver(II) compounds exhibit powerful oxidizing properties and strong magnetic superexchange. AgSO4 is a rare fluorine-free salt of Ag(II) which found some application in organic chemistry. Here, we report a discovery of a new AgSO4 polymorph (\b{eta}). The distinct nature of the two polytypes of AgSO4 is established using powder x-ray diffraction, vibrational spectroscopy and theoretical calculations. The \b{eta} polymorph crystallizes in the monoclinic system (P21/n) and shows structural similarities with CuSO4. DFT calculations indicate very small differences in the energy of the two polymorphs AgSO4, but the relative stability of the \b{eta} polymorph should increase with temperature. The monoclinic distortion of the orthorhombic CuSO4 prototype originates from an unprecedented strong antiferromagnetic interaction between Ag sites along the unit cell diagonal.


title: Primordial Black-Hole Dark Matter via Warm Natural Inflation

abstract: We report on a study of the natural warm inflationary paradigm (WNI). We show two important new results arise in this model. One is that the observational constraints on the primordial power spectrum from the cosmic microwave background (CMB) can be satisfied without going beyond the Planck scale of the effective field theory. The second is that WNI can inevitably provide perfect conditions for the production of primordial black holes (PBHs) in the golden window of black-hole mass range ($10^{-16} -10^{-11}M_{\odot}$) where it can account for all of the the dark matter content of the universe while satisfying observational constraints.


title: Sobolev Training for Implicit Neural Representations with Approximated Image Derivatives

abstract: Recently, Implicit Neural Representations (INRs) parameterized by neural networks have emerged as a powerful and promising tool to represent different kinds of signals due to its continuous, differentiable properties, showing superiorities to classical discretized representations. However, the training of neural networks for INRs only utilizes input-output pairs, and the derivatives of the target output with respect to the input, which can be accessed in some cases, are usually ignored. In this paper, we propose a training paradigm for INRs whose target output is image pixels, to encode image derivatives in addition to image values in the neural network. Specifically, we use finite differences to approximate image derivatives. We show how the training paradigm can be leveraged to solve typical INRs problems, i.e., image regression and inverse rendering, and demonstrate this training paradigm can improve the data-efficiency and generalization capabilities of INRs. The code of our method is available at \url{https://github.com/megvii-research/Sobolev_INRs}.


title: Modified defect relation of Gauss maps on annular ends of minimal surfaces for hypersuraces of projective varieties in subgeneral position

abstract: Let $A$ be an annular end of a complete minimal surface $S$ in $\mathbb R^m$ and let $V$ be a $k$-dimension projective subvariety of $\mathbb P^n(\mathbb C)\ (n=m-1)$. Let $g$ be the generalized Gauss map of $S$ into $V\subset\mathbb P^n(\mathbb C)$. In this paper, we establish a modified defect relation of $g$ on the annular end $A$ for $q$ hypersurfaces $\{Q_i\}_{i=1}^q$ of $\mathbb P^n(\mathbb C)$ in $N$-subgeneral position with respect to $V$. Our result implies that the image $g(A)$ cannot omit all $q$ hypersurfaces $Q_1,\ldots,Q_q$ if $g$ is nondegenerate over $I_d(V)$ and $q>\frac{(2N-k+1)(M+1)(M+2d)}{2d(k+1)}$, where $M=H_V(d)-1$ and $d$ is the least of common multiple of ${\rm deg} Q_1,\ldots,{\rm deg}Q_q$.


title: CodeT: Code Generation with Generated Tests

abstract: The task of generating code solutions for a given programming problem can benefit from the use of pre-trained language models such as Codex, which can produce multiple diverse samples. However, a major challenge for this task is to select the most appropriate solution from the multiple samples generated by the pre-trained language models. A natural way to evaluate the quality and correctness of a code solution is to run it against a set of test cases, but the manual creation of such test cases is often costly and time-consuming. In this paper, we propose a novel method, CodeT, that leverages the same pre-trained language models to automatically generate test cases for the code samples, thus reducing the human effort and increasing the coverage of the test scenarios. CodeT then executes the code samples using the generated test cases, and performs a dual execution agreement, which considers both the consistency of the outputs against the generated test cases and the agreement of the outputs with other code samples. We conduct comprehensive experiments on four benchmarks, HumanEval, MBPP, APPS and CodeContests, using five different pre-trained language models with varying sizes and capabilities. Our results show that CodeT can significantly improve the performance of code solution selection over previous methods, achieving remarkable and consistent gains across different models and benchmarks. For instance, CodeT improves the pass@1 metric on HumanEval to 65.8%, which represents an absolute improvement of 18.8% over the code-davinci-002 model, and an absolute improvement of more than 20% over the previous state-of-the-art results.


title: D2-TPred: Discontinuous Dependency for Trajectory Prediction under Traffic Lights

abstract: A profound understanding of inter-agent relationships and motion behaviors is important to achieve high-quality planning when navigating in complex scenarios, especially at urban traffic intersections. We present a trajectory prediction approach with respect to traffic lights, D2-TPred, which uses a spatial dynamic interaction graph (SDG) and a behavior dependency graph (BDG) to handle the problem of discontinuous dependency in the spatial-temporal space. Specifically, the SDG is used to capture spatial interactions by reconstructing sub-graphs for different agents with dynamic and changeable characteristics during each frame. The BDG is used to infer motion tendency by modeling the implicit dependency of the current state on priors behaviors, especially the discontinuous motions corresponding to acceleration, deceleration, or turning direction. Moreover, we present a new dataset for vehicle trajectory prediction under traffic lights called VTP-TL. Our experimental results show that our model achieves more than {20.45% and 20.78% }improvement in terms of ADE and FDE, respectively, on VTP-TL as compared to other trajectory prediction algorithms. The dataset and code are available at: https://github.com/VTP-TL/D2-TPred.


title: Extension of the Uhlenbeck-Ford Model with an Attraction

abstract: The Uhlenbeck-Ford model for soft repulsion, which has only a repulsive interaction, is extended by inclusion of an attraction. This extension still allows an analytical evaluation of the virial coefficients. The integrals over the graph contributions are reduced to a combinatorial problem. We have calculated the virial coefficients to order 6 in the density. A link is made between this model and more common interactions, like the 12-6 Lennard-Jones potential.


title: Correspondence Matters for Video Referring Expression Comprehension

abstract: We investigate the problem of video Referring Expression Comprehension (REC), which aims to localize the referent objects described in the sentence to visual regions in the video frames. Despite the recent progress, existing methods suffer from two problems: 1) inconsistent localization results across video frames; 2) confusion between the referent and contextual objects. To this end, we propose a novel Dual Correspondence Network (dubbed as DCNet) which explicitly enhances the dense associations in both the inter-frame and cross-modal manners. Firstly, we aim to build the inter-frame correlations for all existing instances within the frames. Specifically, we compute the inter-frame patch-wise cosine similarity to estimate the dense alignment and then perform the inter-frame contrastive learning to map them close in feature space. Secondly, we propose to build the fine-grained patch-word alignment to associate each patch with certain words. Due to the lack of this kind of detailed annotations, we also predict the patch-word correspondence through the cosine similarity. Extensive experiments demonstrate that our DCNet achieves state-of-the-art performance on both video and image REC benchmarks. Furthermore, we conduct comprehensive ablation studies and thorough analyses to explore the optimal model designs. Notably, our inter-frame and cross-modal contrastive losses are plug-and-play functions and are applicable to any video REC architectures. For example, by building on top of Co-grounding, we boost the performance by 1.48% absolute improvement on Accu.@0.5 for VID-Sentence dataset.


title: Detection and Mitigation of Corrupted Information in Distributed Model Predictive Control Based on Resource Allocation

abstract: In distributed predictive control structures, communication among agents is required to achieve a consensus and approach an optimal global behavior. Such negotiation mechanisms are sensitive to attacks on these exchanges. This paper proposes a monitoring scheme that detects and mitigates these attacks' effects in a resource allocation framework. The performance of the proposed method is illustrated through simulations of the temperature control of multiple rooms under power scarcity.


title: Detecting Deepfake by Creating Spatio-Temporal Regularity Disruption

abstract: Despite encouraging progress in deepfake detection, generalization to unseen forgery types remains a significant challenge due to the limited forgery clues explored during training. In contrast, we notice a common phenomenon in deepfake: fake video creation inevitably disrupts the statistical regularity in original videos. Inspired by this observation, we propose to boost the generalization of deepfake detection by distinguishing the "regularity disruption" that does not appear in real videos. Specifically, by carefully examining the spatial and temporal properties, we propose to disrupt a real video through a Pseudo-fake Generator and create a wide range of pseudo-fake videos for training. Such practice allows us to achieve deepfake detection without using fake videos and improves the generalization ability in a simple and efficient manner. To jointly capture the spatial and temporal disruptions, we propose a Spatio-Temporal Enhancement block to learn the regularity disruption across space and time on our self-created videos. Through comprehensive experiments, our method exhibits excellent performance on several datasets.


title: Quantum graphs: Coulomb-type potentials and exactly solvable models

abstract: We study the Schr\"{o}dinger operators on a non-compact star graph with the Coulomb-type potentials having singularities at the vertex. The convergence of regularized Hamiltonians $H_\varepsilon$ with cut-off Coulomb potentials coupled with $(\alpha \delta+\beta\delta')$-like ones is investigated.The 1D Coulomb potential and the $\delta'$-potential are very sensitive to their regularization method. The conditions of the norm resolvent convergence of $H_\varepsilon$ depending on the regularization are established. The limit Hamiltonians give the Schr\"{o}dinger operators with the Coulomb-type potentials a mathematically precise meaning, ensuring the correct choice of vertex conditions. We also describe all self-adjoint realizations of the formal Coulomb Hamiltonians on the star graph.


title: Semantic-aware Modular Capsule Routing for Visual Question Answering

abstract: Visual Question Answering (VQA) is fundamentally compositional in nature, and many questions are simply answered by decomposing them into modular sub-problems. The recent proposed Neural Module Network (NMN) employ this strategy to question answering, whereas heavily rest with off-the-shelf layout parser or additional expert policy regarding the network architecture design instead of learning from the data. These strategies result in the unsatisfactory adaptability to the semantically-complicated variance of the inputs, thereby hindering the representational capacity and generalizability of the model. To tackle this problem, we propose a Semantic-aware modUlar caPsulE Routing framework, termed as SUPER, to better capture the instance-specific vision-semantic characteristics and refine the discriminative representations for prediction. Particularly, five powerful specialized modules as well as dynamic routers are tailored in each layer of the SUPER network, and the compact routing spaces are constructed such that a variety of customizable routes can be sufficiently exploited and the vision-semantic representations can be explicitly calibrated. We comparatively justify the effectiveness and generalization ability of our proposed SUPER scheme over five benchmark datasets, as well as the parametric-efficient advantage. It is worth emphasizing that this work is not to pursue the state-of-the-art results in VQA. Instead, we expect that our model is responsible to provide a novel perspective towards architecture learning and representation calibration for VQA.


title: Adaptive phototaxis of Chlamydomonas and the evolutionary transition to multicellularity in Volvocine green algae

abstract: A fundamental issue in biology is the nature of evolutionary transitions from unicellular to multicellular organisms. Volvocine algae are models for this transition, as they span from the unicellular biflagellate Chlamydomonas to multicellular species of Volvox with up to 50,000 Chlamydomonas-like cells on the surface of a spherical extracellular matrix. The mechanism of phototaxis in these species is of particular interest since they lack a nervous system and intercellular connections; steering is a consequence of the response of individual cells to light. Studies of Volvox and Gonium, a 16-cell organism with a plate-like structure, have shown that the flagellar response to changing illumination of the cellular photosensor is adaptive, with a recovery time tuned to the rotation period of the colony around its primary axis. Here, combining high-resolution studies of the flagellar photoresponse with 3D tracking of freely-swimming cells, we show that such tuning also underlies phototaxis of Chlamydomonas. A mathematical model is developed based on the rotations around an axis perpendicular to the flagellar beat plane that occur through the adaptive response to oscillating light levels as the organism spins. Exploiting a separation of time scales between the flagellar photoresponse and phototurning, we develop an equation of motion that accurately describes the observed photoalignment. In showing that the adaptive time scale is tuned to the organisms' rotational period across three orders of magnitude in cell number, our results suggest a unified picture of phototaxis in green algae in which the asymmetry in torques that produce phototurns arise from the individual flagella of Chlamydomonas, the flagellated edges of Gonium and the flagellated hemispheres of Volvox.


title: Advice on describing Bayesian analysis of neutron and X-ray reflectometry

abstract: Driven by the availability of modern software and hardware, Bayesian analysis is becoming more popular in neutron and X-ray reflectometry analysis. The understandability and replicability of these analyses may be harmed by inconsistencies in how the probability distributions central to Bayesian methods are represented in the literature. Herein, we provide advice on how to report the results of Bayesian analysis as applied to neutron and X-ray reflectometry. This includes the clear reporting of initial starting conditions, the prior probabilities, and results of any analysis, and the posterior probabilities that are the Bayesian equivalent of the error bar, to enable replicability and improve understanding. We believe that this advice, grounded in our experience working in the field, will enable greater analytical reproducibility among the reflectometry community, as well as improve the quality and usability of results.


title: Radiatively generated fermion mass hierarchy from flavour non-universal gauge symmetries

abstract: A framework based on a class of abelian gauge symmetries is proposed in which the masses of only the third generation quarks and leptons arise at the tree level. The fermions of the first and second families receive their masses through radiative corrections induced by the new gauge bosons in the loops. It is shown that the class of abelian symmetries which can viably implement this mechanism are flavour non-universal in nature. Taking the all-fermion generalization of the well-known leptonic $L_\mu-L_\tau$ and $L_e - L_\mu$ symmetries, we construct an explicit renormalizable model based on two $U(1)$ which is shown to reproduce the observed fermion mass spectrum of the Standard Model. The first and second generation fermion masses are loop suppressed while the hierarchy between these two generations results from a gap between the masses of two vector bosons of the extended gauge symmetries. Several phenomenological aspects of the flavourful new physics are discussed and lower limits on the masses of the vector bosons are derived.


title: Dzyaloshinskii-Moriya interaction in Nd$_{2}$Fe$_{14}$B as the origin of spin reorientation and rotating magnetocaloric effect

abstract: The mechanism of spin reorientation in Nd$_{2}$Fe$_{14}$B, which is a host crystal of a well-known neodymium permanent magnet, is studied by combining first-principles calculations and Monte Carlo simulations. The spin reorientation is thought to be derived from crystal field effects and gets less attention because of the undesirable property for hard magnet application. Dzyaloshinskii-Moriya interactions are usually less attractive or often ignored in rare-earth bulk systems, including permanent magnets such as Nd$_{2}$Fe$_{14}$B since people believe that the magnetic anisotropy is more dominant than the Dzyaloshinskii-Moriya interactions. However, in this study, we have found, for the first time, that the spin reorientation in Nd$_{2}$Fe$_{14}$B is attributed to Dzyaloshinskii-Moriya interactions. We have found, furthermore, the spin reorientation in Nd$_{2}$Fe$_{14}$B yields a great stage of rotating magnetocaloric effect at practical application level. We have found that the Dzyaloshinskii-Moriya interactions definitely contributes to the physical properties as a non-negligible effect in magnetic materials.


title: Sequence Models for Drone vs Bird Classification

abstract: Drone detection has become an essential task in object detection as drone costs have decreased and drone technology has improved. It is, however, difficult to detect distant drones when there is weak contrast, long range, and low visibility. In this work, we propose several sequence classification architectures to reduce the detected false-positive ratio of drone tracks. Moreover, we propose a new drone vs. bird sequence classification dataset to train and evaluate the proposed architectures. 3D CNN, LSTM, and Transformer based sequence classification architectures have been trained on the proposed dataset to show the effectiveness of the proposed idea. As experiments show, using sequence information, bird classification and overall F1 scores can be increased by up to 73% and 35%, respectively. Among all sequence classification models, R(2+1)D-based fully convolutional model yields the best transfer learning and fine-tuning results.


title: Beyond general relativity: designing a template-based search for exotic gravitational wave signals

abstract: Accurate waveform models describing the complete evolution of compact binaries are crucial for the maximum likelihood detection framework, testing the predictions of General Relativity (GR) and investigating the possibility of an alternative theory of gravity. Deviations from GR could manifest in subtle variations of the numerical value of the GW signal's post-Newtonian (PN) phasing coefficients. Once the search pipelines confirm an unambiguous signal detection, deviations of the signal phasing coefficients at various PN orders are routinely measured and reported. As the search templates themselves do not incorporate any deviations from GR, they may miss astrophysical signals carrying a significant departure from general relativity. We present a parametrized template-based search for exotic gravitational-wave signals beyond General Relativity by incorporating deviations to the signal's phasing coefficients at different post-Newtonian orders in the search templates. We present critical aspects of the new search, such as improvements in search volume and its effect on various parts of the parameter space. In particular, we demonstrate a factor x2 increase in search sensitivity (at a fixed false-alarm rate) to beyond-GR exotic signals by using search templates that admit a range of departures from general relativity. We also present the results from a re-analysis of the 10-days long duration of LIGO's O1 data, including the epoch of the GW150914 event, highlighting the differences from a standard search. We indicate several directions for future research, including ways of making the proposed new search computationally more efficient.


title: Cosmic Ray Rejection with Attention Augmented Deep Learning

abstract: Cosmic Ray (CR) hits are the major contaminants in astronomical imaging and spectroscopic observations involving solid-state detectors. Correctly identifying and masking them is a crucial part of the image processing pipeline, since it may otherwise lead to spurious detections. For this purpose, we have developed and tested a novel Deep Learning based framework for the automatic detection of CR hits from astronomical imaging data from two different imagers: Dark Energy Camera (DECam) and Las Cumbres Observatory Global Telescope (LCOGT). We considered two baseline models namely deepCR and Cosmic-CoNN, which are the current state-of-the-art learning based algorithms that were trained using Hubble Space Telescope (HST) ACS/WFC and LCOGT Network images respectively. We have experimented with the idea of augmenting the baseline models using Attention Gates (AGs) to improve the CR detection performance. We have trained our models on DECam data and demonstrate a consistent marginal improvement by adding AGs in True Positive Rate (TPR) at 0.01% False Positive Rate (FPR) and Precision at 95% TPR over the aforementioned baseline models for the DECam dataset. We demonstrate that the proposed AG augmented models provide significant gain in TPR at 0.01% FPR when tested on previously unseen LCO test data having images from three distinct telescope classes. Furthermore, we demonstrate that the proposed baseline models with and without attention augmentation outperform state-of-the-art models such as Astro-SCRAPPY, Maximask (that is trained natively on DECam data) and pre-trained ground-based Cosmic-CoNN. This study demonstrates that the AG module augmentation enables us to get a better deepCR and Cosmic-CoNN models and to improve their generalization capability on unseen data.