title: Using Program Synthesis and Inductive Logic Programming to solve Bongard Problems

abstract: The ability to recognise and make analogies is often used as a measure or test of human intelligence. The ability to solve Bongard problems is an example of such a test. It has also been postulated that the ability to rapidly construct novel abstractions is critical to being able to solve analogical problems. Given an image, the ability to construct a program that would generate that image is one form of abstraction, as exemplified in the Dreamcoder project. In this paper, we present a preliminary examination of whether programs constructed by Dreamcoder can be used for analogical reasoning to solve certain Bongard problems. We use Dreamcoder to discover programs that generate the images in a Bongard problem and represent each of these as a sequence of state transitions. We decorate the states using positional information in an automated manner and then encode the resulting sequence into logical facts in Prolog. We use inductive logic programming (ILP), to learn an (interpretable) theory for the abstract concept involved in an instance of a Bongard problem. Experiments on synthetically created Bongard problems for concepts such as 'above/below' and 'clockwise/counterclockwise' demonstrate that our end-to-end system can solve such problems. We study the importance and completeness of each component of our approach, highlighting its current limitations and pointing to directions for improvement in our formulation as well as in elements of any Dreamcoder-like program synthesis system used for such an approach.


title: Analysis of False Data Injection Impact on AI based Solar Photovoltaic Power Generation Forecasting

abstract: The use of solar photovoltaics (PV) energy provides additional resources to the electric power grid. The downside of this integration is that the solar power supply is unreliable and highly dependent on the weather condition. The predictability and stability of forecasting are critical for the full utilization of solar power. This study reviews and evaluates various machine learning-based models for solar PV power generation forecasting using a public dataset. Furthermore, The root mean squared error (RMSE), mean squared error (MSE), and mean average error (MAE) metrics are used to evaluate the results. Linear Regression, Gaussian Process Regression, K-Nearest Neighbor, Decision Trees, Gradient Boosting Regression Trees, Multi-layer Perceptron, and Support Vector Regression algorithms are assessed. Their responses against false data injection attacks are also investigated. The Multi-layer Perceptron Regression method shows robust prediction on both regular and noise injected datasets over other methods.


title: Towards Polarization-Insensitive Coherent Coded Phase OTDR

abstract: We explore the alternatives for interrogating a fiber sensor from the polarization point of view, and demonstrate a better accuracy with dual polarization probing for coherent phi-OTDR compared with single polarization probing.


title: Describing the hierarchical gravitational three-body problem with force and torque vectors

abstract: We investigate the hierarchical gravitational three-body problem, in which a binary is perturbed by a distant object that orbits on a Keplerian ellipse around the binary itself. This phenomenon, known as Kozai-Lidov mechanism in the literature, results in large-amplitude oscillations of the orbital elements, like eccentricity, which may significantly influence the evolution of many astrophysical systems: from minor bodies and planets to even supermassive black holes. The standard approach found in the literature describes this phenomenon in the framework of Hamiltonian mechanics. Here we derive the long term evolution of the triple with elementary tools, treating the binary as a dipole interacting with the gravitational field of the tertiary and describe the dynamics using forces and torques instead of the usual Hamiltonian formalism. This highlights another aspect of the problem and is likely an easier way to introduce the problem at the undergraduate level.


title: Talking Head Generation with Audio and Speech Related Facial Action Units

abstract: The task of talking head generation is to synthesize a lip synchronized talking head video by inputting an arbitrary face image and audio clips. Most existing methods ignore the local driving information of the mouth muscles. In this paper, we propose a novel recurrent generative network that uses both audio and speech-related facial action units (AUs) as the driving information. AU information related to the mouth can guide the movement of the mouth more accurately. Since speech is highly correlated with speech-related AUs, we propose an Audio-to-AU module in our system to predict the speech-related AU information from speech. In addition, we use AU classifier to ensure that the generated images contain correct AU information. Frame discriminator is also constructed for adversarial training to improve the realism of the generated face. We verify the effectiveness of our model on the GRID dataset and TCD-TIMIT dataset. We also conduct an ablation study to verify the contribution of each component in our model. Quantitative and qualitative experiments demonstrate that our method outperforms existing methods in both image quality and lip-sync accuracy.


title: On improving a Schur-type theorem in shifted primes

abstract: We show that if $N \geq \exp(\exp(\exp (k^{O(1)})))$, then any $k$-colouring of the primes that are less than $N$ contains a monochromatic solution to $p_1 - p_2 = p_3 -1$.


title: Minimal Compression of a Radio-Frequency Pulse

abstract: Quadrature amplitude modulation (QAM) and a complementary representation of a causal waveform have been used to develop a sidelobe-free pulse-compression technique. Envelopes of radio-frequency (RF) pulses under study include both unimodal (Laplacian, Gaussian, rectangular) and bimodal (Hermite-Gaussian) shapes. Although the achievable compression gain is small (~2), the generation and phase-invariant correlation processing of such created compressible pulses can be accomplished with the use of low-complexity systems.


title: Revisiting identification concepts in Bayesian analysis

abstract: This paper studies the role played by identification in the Bayesian analysis of statistical and econometric models. First, for unidentified models we demonstrate that there are situations where the introduction of a non-degenerate prior distribution can make a parameter that is nonidentified in frequentist theory identified in Bayesian theory. In other situations, it is preferable to work with the unidentified model and construct a Markov Chain Monte Carlo (MCMC) algorithms for it instead of introducing identifying assumptions. Second, for partially identified models we demonstrate how to construct the prior and posterior distributions for the identified set parameter and how to conduct Bayesian analysis. Finally, for models that contain some parameters that are identified and others that are not we show that marginalizing out the identified parameter from the likelihood with respect to its conditional prior, given the nonidentified parameter, allows the data to be informative about the nonidentified and partially identified parameter. The paper provides examples and simulations that illustrate how to implement our techniques.


title: Positional-Spectral-Temporal Attention in 3D Convolutional Neural Networks for EEG Emotion Recognition

abstract: Recognizing the feelings of human beings plays a critical role in our daily communication. Neuroscience has demonstrated that different emotion states present different degrees of activation in different brain regions, EEG frequency bands and temporal stamps. In this paper, we propose a novel structure to explore the informative EEG features for emotion recognition. The proposed module, denoted by PST-Attention, consists of Positional, Spectral and Temporal Attention modules to explore more discriminative EEG features. Specifically, the Positional Attention module is to capture the activate regions stimulated by different emotions in the spatial dimension. The Spectral and Temporal Attention modules assign the weights of different frequency bands and temporal slices respectively. Our method is adaptive as well as efficient which can be fit into 3D Convolutional Neural Networks (3D-CNN) as a plug-in module. We conduct experiments on two real-world datasets. 3D-CNN combined with our module achieves promising results and demonstrate that the PST-Attention is able to capture stable patterns for emotion recognition from EEG.


title: Food Odor Recognition via Multi-step Classification

abstract: Predicting food labels and freshness from its odor remains a decades-old task that requires a complicated algorithm combined with high sensitivity sensors. In this paper, we initiate a multi-step classifier, which firstly clusters food into four categories, then classifies the food label concerning the predicted category, and finally identifies the freshness. We use BME688 gas sensors packed with BME AI studio for data collection and feature extraction. The normalized dataset was preprocessed with PCA and LDA. We evaluated the effectiveness of algorithms such as tree methods, MLP, and CNN through assessment indexes at each stage. We also carried out an ablation experiment to show the necessity and feasibility of the multi-step classifier. The results demonstrated the robustness and adaptability of the multi-step classifier.


title: Plasma environment effects on K lines of astrophysical interest. V. Universal formulae for ionization potential and K-threshold shifts

abstract: Aims. We calculate the plasma environment effects on the ionization potentials (IPs) and K-thresholds used in the modeling of K lines for all the ions belonging to the isonuclear sequences of abundant elements apart from oxygen and iron, namely: carbon, silicon, calcium, chromium, and nickel. These calculations are used to extend the data points for the fits of the universal formulae, first proposed in our fourth paper of this series, to predict the IP and K-threshold lowerings in any elemental ion. Methods. We used the fully relativistic multi-configuration Dirac-Fock (MCDF) method and approximated the plasma electron-nucleus and electron-electron screenings with a time-averaged Debye-Huckel potential. Results. We report the modified ionization potentials and K-threshold energies for plasmas characterized by electron temperatures and densities in the ranges of 10^5-10^7 K and 10^18-10^22 cm^-3 . In addition, the improved universal fitting formulae are obtained. Conclusions. We conclude that since explicit calculations of the atomic structures for each ion of each element under different plasma conditions is impractical, the use of these universal formulae for predicting the IP and K-threshold lowerings in plasma modeling codes is still recommended. However, their comparatively moderate to low accuracies may affect the predicted opacities with regard to certain cases under extreme plasma conditions that are characterized by a plasma screening parameter of \mu > 0.2 a.u., especially for the K-thresholds.


title: The Cocktail Fork Problem: Three-Stem Audio Separation for Real-World Soundtracks

abstract: The cocktail party problem aims at isolating any source of interest within a complex acoustic scene, and has long inspired audio source separation research. Recent efforts have mainly focused on separating speech from noise, speech from speech, musical instruments from each other, or sound events from each other. However, separating an audio mixture (e.g., movie soundtrack) into the three broad categories of speech, music, and sound effects (understood to include ambient noise and natural sound events) has been left largely unexplored, despite a wide range of potential applications. This paper formalizes this task as the cocktail fork problem, and presents the Divide and Remaster (DnR) dataset to foster research on this topic. DnR is built from three well-established audio datasets (LibriSpeech, FMA, FSD50k), taking care to reproduce conditions similar to professionally produced content in terms of source overlap and relative loudness, and made available at CD quality. We benchmark standard source separation algorithms on DnR, and further introduce a new multi-resolution model to better address the variety of acoustic characteristics of the three source types. Our best model produces SI-SDR improvements over the mixture of 11.0 dB for music, 11.2 dB for speech, and 10.8 dB for sound effects.


title: Large-scale dynamics of event-chain Monte Carlo

abstract: Event-chain Monte Carlo (ECMC) accelerates the sampling of hard-sphere systems, and has been generalized to the potentials used in classical molecular simulation. Rather than imposing detailed balance on transition probabilities, the method enforces a weaker global-balance condition in order to guarantee convergence to equilibrium. In this paper we generalize the factor-field variant of ECMC to higher space dimensions. In the two-dimensional fluid phase, factor-field ECMC saturates the lower bound $z=0$ for the dynamical scaling exponent for local dynamics, whereas molecular dynamics is characterized by $z=1$ and local Metropolis Monte Carlo by $z=2$. In the presence of hexatic order, factor fields are not found to speed up the convergence. We indicate applications to the physics of glasses, and note that generalizations of factor fields could couple to orientational order.


title: Extending Bekenstein's theorem in order to search exact solutions of Einstein-Maxwell-conformal-scalar equations

abstract: The Bekenstein's theorem allows us to generate a Einstein-conformal scalar solution from a single Einstein-ordinary scalar solution. In this article, we extend this theorem to Einstein-Maxwell-scalar (EMS) theory with a non-minimal coupling between the scalar and Maxwell field. As applications of this extended theorem, the well-known static dilaton solution and rotating solution with a specific coupling between dilaton and Maxwell field are considered, and new conformal dilaton black hole solutions are found. The Noether charges such as the mass, electric charge, angular momentum are compared between the old and new black hole solutions connected by conformal transformations, and they are found conformally invariant. We speculate that the theorem may be helpful in the computations of metric perturbations and spontaneous scalarization of black holes in the Einstein-Maxwell-conformal-scalar theory since they can be mapped to the corresponding EMS theories, which have been investigated in detail.


title: One Source, Two Source(s): Ribs and Tethers

abstract: We present the unique and challenging case of a radio galaxy in Abell 3266 observed as part of the MeerKAT Galaxy Cluster Legacy Survey. It has quasi-periodic bright patches along the tail which connect to never-before-seen thin transverse extensions, which we call `ribs', reaching up to approx. 50 kpc from the central axis of the tail. At a distance of approx. 400 kpc from the host (assuming the z=0.0594 redshift of Abell 3266) we find what appears to be a triple source with its own apparent host at a photometric redshift of 0.78. Mysteriously, the part of the tail far from the host and the triple are connected by a series of thin filaments, which we call "tethers." The far tail, tethers and triple also have similar spectra and Faraday rotation measures, suggesting that there is only one -- quite complicated -- source, with a serendipitous background AGN in the triple. We look at possible causes for the "rib" and "tether" structures, and the emerging phenomena of intracluster medium filaments associated with radio galaxies.


title: PR-CIM: a Variation-Aware Binary-Neural-Network Framework for Process-Resilient Computation-in-memory

abstract: Binary neural networks (BNNs) that use 1-bit weights and activations have garnered interest as extreme quantization provides low power dissipation. By implementing BNNs as computing-in-memory (CIM), which computes multiplication and accumulations on memory arrays in an analog fashion, namely analog CIM, we can further improve the energy efficiency to process neural networks. However, analog CIMs suffer from the potential problem that process variation degrades the accuracy of BNNs. Our Monte-Carlo simulations show that in an SRAM-based analog CIM of VGG-9, the classification accuracy of CIFAR-10 is degraded even below 20% under process variations of 65nm CMOS. To overcome this problem, we present a variation-aware BNN framework. The proposed framework is developed for SRAM-based BNN CIMs since SRAM is most widely used as on-chip memory, however easily extensible to BNN CIMs based on other memories. Our extensive experimental results show that under process variation of 65nm CMOS, our framework significantly improves the CIFAR-10 accuracies of SRAM-based BNN CIMs, from 10% and 10.1% to 87.76% and 77.74% for VGG-9 and RESNET-18 respectively.


title: Absorption of hybrid fibre modes by Cs atoms in quadrupole transitions

abstract: We evaluate the rate of the absorption of an optical nanofiber mode by a Cs atom in an electric quadrupole transition. With the Cs atom localized near the outer surface of the optical nano-fiber, an interaction occurs between the atomic quadrupole tensor components and the gradients of the vector components of the electric field of a hybrid fiber mode. The absorption rate is evaluated as a function of the radial position of the atom from the fiber axis, assuming a specific value of the laser power and we use experimentally accessible parameters. We find that the absorption of the hybrid modes by the Cs atom decreases as the atom recedes away from the fiber axis and formally vanishes at sufficiently large radial distances. Close to the fiber, however, the absorption rate for the input power chosen can be two orders of magnitude larger than the quadrupole de-excitation rate despite the moderate power used.


title: Droplet plume emission during plasmonic bubble growth in ternary liquids

abstract: Plasmonic bubbles are of great relevance in numerous applications, including catalytic reactions, micro/nanomanipulation of molecules or particles dispersed in liquids, and cancer therapeutics. So far, studies have been focused on bubble nucleation in pure liquids. Here we investigate plasmonic bubble nucleation in ternary liquids consisting of ethanol, water, and trans-anethole oil which can show the so-called ouzo-effect. We find that oil (trans-anethole) droplet plumes are produced around the growing plasmonic bubbles. The nucleation of the microdroplets and their organization in droplet plumes is due to the symmetry breaking of the ethanol concentration field during the selective evaporation of ethanol from the surrounding ternary liquids into the growing plasmonic bubbles. Numerical simulations show the existence of a critical Marangoni number Ma (the ratio between solutal advection rate and the diffusion rate), above which the symmetry breaking of the ethanol concentration field occurs, leading to the emission of the droplet plumes. The numerical results agree with the experimental observation that more plumes are emitted with increasing ethanol-water relative weight ratios and hence Ma. Our findings on the droplet plume formation reveal the rich phenomena of plasmonic bubble nucleation in multicomponent liquids and help to pave the way to achieve enhanced mixing in multicomponent liquids in chemical, pharmaceutical, and cosmetic industries.


title: Updating the SiD Detector concept

abstract: The SiD Detector is one of two detector designs for the future International Linear Collider (ILC) that were validated in 2012 SiD features a compact, cost-constrained design for precision Higgs and other measurements, and sensitivity to a wide range of possible new phenomena. A robust silicon vertex and tracking system, combined with a five Tesla central solenoidal field, provides excellent momentum resolution. The highly granular calorimeter system is optimized for Particle Flow application to achieve very good jet energy resolution over a wide range of energies. With a potential construction date of the ILC moving closer, it is now the time to review the design and technology decision that have been made during the DBD phase and reconsider them in the light of the recent technological advances. For each area of SiD development R&D topics and opportunities for participation will be discussed.


title: SleepPriorCL: Contrastive Representation Learning with Prior Knowledge-based Positive Mining and Adaptive Temperature for Sleep Staging

abstract: The objective of this paper is to learn semantic representations for sleep stage classification from raw physiological time series. Although supervised methods have gained remarkable performance, they are limited in clinical situations due to the requirement of fully labeled data. Self-supervised learning (SSL) based on contrasting semantically similar (positive) and dissimilar (negative) pairs of samples have achieved promising success. However, existing SSL methods suffer the problem that many semantically similar positives are still uncovered and even treated as negatives. In this paper, we propose a novel SSL approach named SleepPriorCL to alleviate the above problem. Advances of our approach over existing SSL methods are two-fold: 1) by incorporating prior domain knowledge into the training regime of SSL, more semantically similar positives are discovered without accessing ground-truth labels; 2) via investigating the influence of the temperature in contrastive loss, an adaptive temperature mechanism for each sample according to prior domain knowledge is further proposed, leading to better performance. Extensive experiments demonstrate that our method achieves state-of-the-art performance and consistently outperforms baselines.


title: Space-borne atom interferometric gravitational wave detections. Part II. Dark sirens and finding the one

abstract: In this paper, we investigate the potential of dark sirens by the space-borne atom interferometric gravitational-wave detectors to probe the Hubble constant. In the mid-frequency band, the sources live a long time. The motion of a detector around the Sun as well as in Earth orbit would induce large Doppler and reorientation effects, providing a precise angular resolution. Such precise localization for the GW sources makes it possible to observe the dark sirens with only one potential host galaxy, which are dubbed "golden dark sirens". We construct the catalogs of golden dark sirens and estimate that there are around 79 and 35 golden dark sirens of binary neutron stars (BNS) and binary black holes (BBH) that would be pass the detection threshold of AEDGE in 5 years. Our results show that with 5, 10, and all 79 golden dark BNS tracked by AEDGE one can constrain $H_0$ at 5.5\%, 4.1\%, and 1.8\% precision levels. With 5, 10, and all 35 golden dark BBH one can constrain $H_0$ at 2.2\%, 1.8\%, and 1.5\% precision levels, respectively. It suggests that only 5-10 golden dark BBH by AEDGE are sufficient to arbitrate the current tension between local and high-$z$ measurements of $H_0$.


title: Can Dynamic TDD Enabled Half-Duplex Cell-Free Massive MIMO Outperform Full-Duplex Cellular Massive MIMO?

abstract: We consider a dynamic time division duplex (DTDD) enabled cell-free massive multiple-input multiple-output (CF-mMIMO) system, where each half-duplex (HD) access point (AP) is scheduled to operate in the uplink (UL) or downlink (DL) mode based on the data demands of the user equipments (UEs), with the goal of maximizing the sum UL-DL spectral efficiency (SE). We develop a new, low complexity, greedy algorithm for the combinatorial AP scheduling problem, with an optimality guarantee theoretically established via showing that a lower bound of the sum UL-DL SE is sub-modular. We also consider pilot sequence reuse among the UEs to limit the channel estimation overhead. In CF systems, all the APs estimate the channel from every UE, making pilot allocation problem different from the cellular case. We develop a novel algorithm that iteratively minimizes the maximum pilot contamination across the UEs. We compare the performance of our solutions, both theoretically and via simulations, against a full duplex (FD) multi-cell mMIMO system. Our results show that, due to the joint processing of the signals at the central processing unit, CF-mMIMO with dynamic HD AP-scheduling significantly outperforms cellular FD-mMIMO in terms of the sum SE and 90% likely SE. Thus, DTDD enabled HD CF-mMIMO is a promising alternative to cellular FD-mMIMO, without the cost of hardware for self-interference suppression.


title: Degenerate elliptic solutions of the quintic complex one-dimensional Ginzburg-Landau equation

abstract: A subset of traveling wave solutions of the quintic complex Ginzburg-Landau equation (QCGLE) is presented in compact form. The approach consists of the following parts. - Reduction of the QCGLE to a system of two ordinary differential equations (ODEs) by a traveling wave ansatz. - Solution of the system for two (ad hoc) cases relating phase and amplitude. - Presentation of the solution for both cases in compact form. - Presentation of constraints for bounded and for singular positive solutions by analyzing the analytical properties of the solution by means of a phase diagram approach. The results are exemplified numerically


title: Graphs with all holes the same length

abstract: A graph is "$\ell$-holed" if all its induced cycles of length at least four have length exactly $\ell$. We give a complete description of the $\ell$-holed graphs for each $\ell\ge 7$.


title: Fully Three-dimensional Radial Visualization

abstract: We develop methodology for three-dimensional (3D) radial visualization (RadViz) of multidimensional datasets. The classical two-dimensional (2D) RadViz visualizes multivariate data in the 2D plane by mapping every observation to a point inside the unit circle. Our tool, RadViz3D, distributes anchor points uniformly on the 3D unit sphere. We show that this uniform distribution provides the best visualization with minimal artificial visual correlation for data with uncorrelated variables. However, anchor points can be placed exactly equi-distant from each other only for the five Platonic solids, so we provide equi-distant anchor points for these five settings, and approximately equi-distant anchor points via a Fibonacci grid for the other cases. Our methodology, implemented in the R package $radviz3d$, makes fully 3D RadViz possible and is shown to improve the ability of this nonlinear technique in more faithfully displaying simulated data as well as the crabs, olive oils and wine datasets. Additionally, because radial visualization is naturally suited for compositional data, we use RadViz3D to illustrate (i) the chemical composition of Longquan celadon ceramics and their Jingdezhen imitation over centuries, and (ii) US regional SARS-Cov-2 variants' prevalence in the Covid-19 pandemic during the summer 2021 surge of the Delta variant.


title: Exploring the Gap between Tolerant and Non-tolerant Distribution Testing

abstract: The framework of distribution testing is currently ubiquitous in the field of property testing. In this model, the input is a probability distribution accessible via independently drawn samples from an oracle. The testing task is to distinguish a distribution that satisfies some property from a distribution that is far from satisfying it in the $\ell_1$ distance. The task of tolerant testing imposes a further restriction, that distributions close to satisfying the property are also accepted. This work focuses on the connection of the sample complexities of non-tolerant ("traditional") testing of distributions and tolerant testing thereof. When limiting our scope to label-invariant (symmetric) properties of distribution, we prove that the gap is at most quadratic. Conversely, the property of being the uniform distribution is indeed known to have an almost-quadratic gap. When moving to general, not necessarily label-invariant properties, the situation is more complicated, and we show some partial results. We show that if a property requires the distributions to be non-concentrated, then it cannot be non-tolerantly tested with $o(\sqrt{n})$ many samples, where $n$ denotes the universe size. Clearly, this implies at most a quadratic gap, because a distribution can be learned (and hence tolerantly tested against any property) using $\mathcal{O}(n)$ many samples. Being non-concentrated is a strong requirement on the property, as we also prove a close to linear lower bound against their tolerant tests. To provide evidence for other general cases (where the properties are not necessarily label-invariant), we show that if an input distribution is very concentrated, in the sense that it is mostly supported on a subset of size $s$ of the universe, then it can be learned using only $\mathcal{O}(s)$ many samples. The learning procedure adapts to the input, and works without knowing $s$ in advance.


title: Charge asymmetry of new stable quarks in baryon asymmetrical Universe

abstract: Effects of electroweak phase transition (EWPT) in balance between baryon excess and the excess of stable quarks of new generation is studied. With the conservation of SU(2) symmetry and other quantum numbers, it makes possible sphaleron transitions between baryons, leptons and new of leptons and quarks. A definite relationship between the excess relative to baryon asymmetry is established. In passing by we also show the small, yet negligible dilution in the pre-existing dark matter density due the sphaleron transition.


title: UniFed: A Unified Framework for Federated Learning on Non-IID Image Features

abstract: How to tackle non-iid data is a crucial topic in federated learning. This challenging problem not only affects training process, but also harms performance of clients not participating in training. Existing literature mainly focuses on either side, yet still lacks a unified solution to handle these two types (internal and external) of clients in a joint way. In this work, we propose a unified framework to tackle the non-iid issues for internal and external clients together. Firstly, we propose to use client-specific batch normalization in either internal or external clients to alleviate feature distribution shifts incurred by non-iid data. Then we present theoretical analysis to demonstrate the benefits of client-specific batch normalization. Specifically, we show that our approach promotes convergence speed for federated training and yields lower generalization error bound for external clients. Furthermore, we use causal reasoning to form a causal view to explain the advantages of our framework. At last, we conduct extensive experiments on natural and medical images to evaluate our method, where our method achieves state-of-the-art performance, faster convergence, and shows good compatibility. We also performed comprehensive analytical studies on a real-world medical dataset to demonstrate the effectiveness.


title: The role of asymmetries in coronal rain formation during thermal non-equilibrium cycles

abstract: Context: Thermal non-equilibrium (TNE) produces several observables that can be used to constrain the spatial and temporal distribution of solar coronal heating. Its manifestations include prominence formation, coronal rain, and long-period intensity pulsations in coronal loops. The recent observation of abundant periodic coronal rain associated with intensity pulsations by Auch\`ere et al. allows to unify these two phenomena as the result of TNE condensation and evaporation cycles. On the other hand, many intensity pulsation events observed by Froment et al. show little to no coronal rain formation. Aims: Our goal is to understand why some TNE cycles produce such abundant coronal rain, while others produce little to no rain. Methods: We reconstruct the geometry of the event reported by Auch\`ere et al., using images from STEREO/SECCHI/EUVI and magnetograms from SDO/HMI. We then perform 1D hydrodynamic simulations of this event, for different heating parameters and variations of the loop geometry (9000 simulations in total). We compare the resulting behaviour to simulations of TNE cycles by Froment et al. that do not produce coronal rain. Results: Our simulations show that both prominences and TNE cycles (with and without coronal rain) can form within the same magnetic structure. We show that the formation of coronal rain during TNE cycles depends on the asymmetry of the loop and of the heating. Asymmetric loops are overall less likely to produce coronal rain, regardless of the heating. In symmetric loops, coronal rain forms when the heating is also symmetric. In asymmetric loops, rain forms only when the heating compensates the asymmetry.


title: A geometric model for syzygies over 2-Calabi-Yau tilted algebras II

abstract: In this article, we continue the study of a certain family of 2-Calabi-Yau tilted algebras, called dimer tree algebras. The terminology comes from the fact that these algebras can also be realized as quotients of dimer algebras on a disc. They are defined by a quiver with potential whose dual graph is a tree, and they are generally of wild representation type. Given such an algebra $B$, we construct a polygon $\mathcal{S}$ with a checkerboard pattern in its interior, that defines a category $\text{Diag}(\mathcal{S})$. The indecomposable objects of $\text{Diag}(\mathcal{S})$ are the 2-diagonals in $\mathcal{S}$, and its morphisms are certain pivoting moves between the 2-diagonals. We prove that the category $\text{Diag}(\mathcal{S})$ is equivalent to the stable syzygy category of the algebra $B$. This result was conjectured by the authors in an earlier paper, where it was proved in the special case where every chordless cycle is of length three. As a consequence, we conclude that the number of indecomposable syzygies is finite, and moreover the syzygy category is equivalent to the 2-cluster category of type $\mathbb{A}$. In addition, we obtain an explicit description of the projective resolutions, which are periodic. Finally, the number of vertices of the polygon $\mathcal{S}$ is a derived invariant and a singular invariant for dimer tree algebras, which can be easily computed form the quiver.


title: An Ultra-Reliable Low-Latency Non-Binary Polar Coded SCMA Scheme

abstract: The joint transmission scheme of polar codes and sparse code multiple access (SCMA) has been regarded as a promising technology for future wireless communication systems. However, most of the existing polar-coded SCMA (PC-SCMA) systems suffer from high latency caused by the feedback iteration and list decoding. In addition, the error performance of PC-SCMA systems is unsatisfactory for ultra-reliable transmission. Inspired by the compelling benefits of non-binary polar codes, in this paper, we design a non-binary polar-coded SCMA (NB-PC-SCMA) system with a free order matching strategy to address the issues of delay and reliability. Specifically, we first formulate a joint factor graph for NB-PC-SCMA and propose a non-binary successive cancellation list (NB-SCL) and damping based joint iterative detection and decoding (NSD-JIDD) multiuser receiver to improve the BER and latency performance. Then, a lazy-search based NB-SCL (L-NB-SCL) decoding is proposed to reduce the computational complexity by simplifying the path search pattern of the list decoder. After that, we modify the update of user nodes for SCMA detection to improve the convergence error and finally propose the improved NSD-JIDD (ISD-JIDD) algorithm, which can avoid redundant operations by exploiting L-NB-SCL decoding. Simulation results show that the proposed NB-PC-SCMA system achieves better bit error rate (BER) performance and considerable latency gain when compared to its counterparts. In particular, the proposed ISD-JIDD can achieve similar BER performance of NSD-JIDD with less complexity.


title: What is Learned in Knowledge Graph Embeddings?

abstract: A knowledge graph (KG) is a data structure which represents entities and relations as the vertices and edges of a directed graph with edge types. KGs are an important primitive in modern machine learning and artificial intelligence. Embedding-based models, such as the seminal TransE [Bordes et al., 2013] and the recent PairRE [Chao et al., 2020] are among the most popular and successful approaches for representing KGs and inferring missing edges (link completion). Their relative success is often credited in the literature to their ability to learn logical rules between the relations. In this work, we investigate whether learning rules between relations is indeed what drives the performance of embedding-based methods. We define motif learning and two alternative mechanisms, network learning (based only on the connectivity of the KG, ignoring the relation types), and unstructured statistical learning (ignoring the connectivity of the graph). Using experiments on synthetic KGs, we show that KG models can learn motifs and how this ability is degraded by non-motif (noise) edges. We propose tests to distinguish the contributions of the three mechanisms to performance, and apply them to popular KG benchmarks. We also discuss an issue with the standard performance testing protocol and suggest an improvement. To appear in the proceedings of Complex Networks 2021.


title: Divergence error based $p$-adaptive discontinuous Galerkin solution of time-domain Maxwell's equations

abstract: A $p$-adaptive discontinuous Galerkin time-domain method is developed to obtain high-order solutions to electromagnetic scattering problems. A novel feature of the proposed method is the use of divergence error to drive the $p$-adaptive method. The nature of divergence error is explored and that it is a direct consequence of the act of discretization is established. Its relation with relative truncation error is formed which enables the use of divergence error as an inexpensive proxy to truncation error. Divergence error is used as an indicator to dynamically identify and assign spatial operators of varying accuracy to substantial regions in the computational domain. This results in a reduced computational cost than a comparable discontinuous Galerkin time-domain solution using uniform degree piecewise polynomial bases throughout.


title: Study of the inter-species interactions in an ultracold dipolar mixture

abstract: We experimentally and theoretically investigate the influence of the dipole-dipole interactions (DDIs) on the total inter-species interaction in an erbium-dysprosium mixture. By rotating the dipole orientation we are able to tune the effect of the long-range and anisotropic DDI, and therefore the in-trap clouds displacement. We present a theoretical description for our binary system based on an extended Gross-Pitaevskii (eGP) theory, including the single-species beyond mean-field terms, and we predict a lower and an upper bound for the inter-species scattering length $a_{12}$. Our work is a first step towards the investigation of the experimentally unexplored dipolar miscibility-immiscibility phase diagram and the realization of quantum droplets and supersolid states with heteronuclear dipolar mixtures.


title: How to Guide Decisions with Bayes Factors

abstract: Some scientific research questions ask to guide decisions and others do not. By their nature frequentist hypothesis-tests yield a dichotomous test decision as result, rendering them rather inappropriate for latter types of research questions. Bayes factors, however, are argued to be both able to refrain from making decisions and to be employed in guiding decisions. This paper elaborates on how to use a Bayes factor for guiding a decision. In this regard, its embedding within the framework of Bayesian decision theory is delineated, in which a (hypothesis-based) loss function needs to be specified. Typically, such a specification is difficult for an applied scientist as relevant information might be scarce, vague, partial, and ambiguous. To tackle this issue, a robust, interval-valued specification of this loss function shall be allowed, such that the essential but partial information can be included into the analysis as is. Further, the restriction of the prior distributions to be proper distributions (which is necessary to calculate Bayes factors) can be alleviated if a decision is of interest. Both the resulting framework of hypothesis-based Bayesian decision theory with robust loss function and how to derive optimal decisions from already existing Bayes factors are depicted by user-friendly and straightforward step-by-step guides.


title: Pedal coordinates and free double linkage

abstract: Using the technique of pedal coordinates we investigate the orbits of a free double linkage. We provide a geometrical construction for them and also show a surprising connection between this mechanical system and orbits around a Black Hole and solutions of Dark Kepler problem.


title: ECG-ATK-GAN: Robustness against Adversarial Attacks on ECGs using Conditional Generative Adversarial Networks

abstract: Automating arrhythmia detection from ECG requires a robust and trusted system that retains high accuracy under electrical disturbances. Many machine learning approaches have reached human-level performance in classifying arrhythmia from ECGs. However, these architectures are vulnerable to adversarial attacks, which can misclassify ECG signals by decreasing the model's accuracy. Adversarial attacks are small crafted perturbations injected in the original data which manifest the out-of-distribution shifts in signal to misclassify the correct class. Thus, security concerns arise for false hospitalization and insurance fraud abusing these perturbations. To mitigate this problem, we introduce the first novel Conditional Generative Adversarial Network (GAN), robust against adversarial attacked ECG signals and retaining high accuracy. Our architecture integrates a new class-weighted objective function for adversarial perturbation identification and new blocks for discerning and combining out-of-distribution shifts in signals in the learning process for accurately classifying various arrhythmia types. Furthermore, we benchmark our architecture on six different white and black-box attacks and compare them with other recently proposed arrhythmia classification models on two publicly available ECG arrhythmia datasets. The experiment confirms that our model is more robust against such adversarial attacks for classifying arrhythmia with high accuracy.


title: Robust automated radiation therapy treatment planning using scenario-specific dose prediction and robust dose mimicking

abstract: Purpose: We present a framework for robust automated treatment planning using machine learning, comprising scenario-specific dose prediction and robust dose mimicking. Methods: The scenario dose prediction pipeline is divided into the prediction of nominal dose from input image and the prediction of scenario dose from nominal dose, each using a deep learning model with U-net architecture. By using a specially developed dose-volume histogram-based loss function, the predicted scenario doses are ensured sufficient target coverage despite the possibility of the training data being non-robust. Deliverable plans may then be created by solving a robust dose mimicking problem with the predictions as scenario-specific reference doses. Results: Numerical experiments are performed using a dataset of 52 intensity-modulated proton therapy plans for prostate patients. We show that the predicted scenario doses resemble their respective ground truth well, in particular while having target coverage comparable to that of the nominal scenario. The deliverable plans produced by the subsequent robust dose mimicking were showed to be robust against the same scenario set considered for prediction. Conclusions: We demonstrate the feasibility and merits of the proposed methodology for incorporating robustness into automated treatment planning algorithms.


title: Peterson-Lam-Shimozono's theorem is an affine analogue of quantum Chevalley formula

abstract: We give a new proof of an unpublished result of Dale Peterson, proved by Lam and Shimozono, which identifies explicitly the structure constants, with respect to the quantum Schubert basis, for the $T$-equivariant quantum cohomology $QH^{\bullet}_T(G/P)$ of any flag variety $G/P$ with the structure constants, with respect to the affine Schubert basis, for the $T$-equivariant Pontryagin homology $H^T_{\bullet}(\mathcal{G}r)$ of the affine Grassmannian $\mathcal{G}r$ of $G$, where $G$ is any simple simply-connected complex algebraic group. Our approach is to construct an $H_T^{\bullet}(pt)$-algebra homomorphism by Gromov-Witten theory and show that it is equal to Peterson's map. More precisely, the map is defined via Savelyev's generalized Seidel representations which can be interpreted as certain Gromov-Witten invariants with input $H^T_{\bullet}(\mathcal{G}r)\otimes QH_T^{\bullet}(G/P)$. We determine these invariants completely, in a way similar to how Fulton and Woodward did in their proof of quantum Chevalley formula.


title: Dimensional preimage entropies

abstract: Let $X$ be a compact complex manifold of dimension $k$ and $f:X \longrightarrow X$ be a dominating meromorphic map. We generalize the notion of topological entropy, by defining a quantity $h_{(m,l)}^{top}(f)$ which measures the action of $f$ on local analytic sets $W$ of dimension $l$ with $W \subset f^{-n}(\Delta)$ where $\Delta$ is a local analytic set of dimension $m$. We give then inequalities between $h_{(m,l)}^{top}(f)$ and Lyapounov exponents of suitable invariant measures.


title: Energy-based Accounting Model for Heterogeneous Supercomputers

abstract: In this paper we present a new accounting model for heterogeneous supercomputers. An increasing number of supercomputing centres adopt heterogeneous architectures consisting of CPUs and hardware accelerators for their systems. Accounting models using the core hour as unit of measure are redefined to provide an appropriate charging rate based on the computing performance of different processing elements, as well as their energy efficiency and purchase price. In this paper we provide an overview of existing models and define a new model that, while retaining the core hour as a fundamental concept, takes into account the interplay among resources such as CPUs and RAM, and that bases the GPU charging rate on energy consumption. We believe that this model, designed for Pawsey Supercomputing Research Centre's next supercomputer Setonix, has a lot of advantages compared to other models, introducing carbon footprint as a primary driver in determining the allocation of computational workflow on heterogeneous resources.


title: Cosmological radiation density with non-standard neutrino-electron interactions

abstract: Non-standard interactions (NSI) between neutrinos and electrons can significantly modify the decoupling of neutrinos from the plasma. These interactions have two effects on the overall picture: (i) they alter neutrino oscillations though matter effects and (ii) they modify the scattering and annihilation processes involving neutrinos and electrons and positrons. We study the role of non-universal and flavour-changing NSI in the decoupling and how they impact the determination of the effective number of neutrinos, $N_{eff}$. We examine the degeneracies between NSI parameters and we compare the expected sensitivity from future cosmological surveys with the current limits from terrestrial experiments. We outline the complementarity between both approaches.


title: Identification of the invariant manifolds of the LiCN molecule using Lagrangian descriptors

abstract: In this paper, we apply Lagrangian descriptors to study the invariant manifolds that emerge from the top of two barriers existing in the LiCN<->LiNC isomerization reaction. We demonstrate that the integration times must be large enough compared with the characteristic stability exponents of the periodic orbit under study. The invariant manifolds manifest as singularities in the Lagrangian descriptors. Furthermore, we develop an equivalent potential energy surface with 2 degrees of freedom, which reproduces with a great accuracy previous results [Phys. Rev. E 99, 032221 (2019)]. This surface allows the use of an adiabatic approximation to develop a more simplified potential energy with solely 1 degree of freedom. The reduced dimensional model is still able to qualitatively describe the results observed with the original 2-degrees-of-freedom potential energy landscape. Likewise, it is also used to study in a more simple manner the influence on the Lagrangian descriptors of a bifurcation, where some of the previous invariant manifolds emerge, even before it takes place.


title: New small gaps between squarefree numbers

abstract: In this paper, we show that, for some constant $C > 0$, the interval $(x, x + C x^{5/26}]$ always contains a squarefree number when $x$ is sufficiently large (in terms of $C$). Our improvement comes from establishing asymptotic relations between the shifts $a$ and $b$ when $m n^2 \approx (m - a) (n + b)^2$ We apply them to study quadruples $(m + a_1) (n - b_1)^2 \approx m n^2 \approx (m - a_2)(n + b_2)^2 \approx (m - a_2 - a_3)(n + b_2 + b_3)^2$ and generalize Roth differencing and Filaseta-Trifonov differencing by allowing $b_1$ to be different from $b_3$. We also introduce a new differencing and exploit the interplay among these three differencings.


title: Towards Optimal Correlational Object Search

abstract: In realistic applications of object search, robots will need to locate target objects in complex environments while coping with unreliable sensors, especially for small or hard-to-detect objects. In such settings, correlational information can be valuable for planning efficiently. Previous approaches that consider correlational information typically resort to ad-hoc, greedy search strategies. We introduce the Correlational Object Search POMDP (COS-POMDP), which models correlations while preserving optimal solutions with a reduced state space. We propose a hierarchical planning algorithm to scale up COS-POMDPs for practical domains. Our evaluation, conducted with the AI2-THOR household simulator and the YOLOv5 object detector, shows that our method finds objects more successfully and efficiently compared to baselines,particularly for hard-to-detect objects such as srub brush and remote control.


title: ERQA: Edge-Restoration Quality Assessment for Video Super-Resolution

abstract: Despite the growing popularity of video super-resolution (VSR), there is still no good way to assess the quality of the restored details in upscaled frames. Some SR methods may produce the wrong digit or an entirely different face. Whether a method's results are trustworthy depends on how well it restores truthful details. Image super-resolution can use natural distributions to produce a high-resolution image that is only somewhat similar to the real one. VSR enables exploration of additional information in neighboring frames to restore details from the original scene. The ERQA metric, which we propose in this paper, aims to estimate a model's ability to restore real details using VSR. On the assumption that edges are significant for detail and character recognition, we chose edge fidelity as the foundation for this metric. Experimental validation of our work is based on the MSU Video Super-Resolution Benchmark, which includes the most difficult patterns for detail restoration and verifies the fidelity of details from the original frame. Code for the proposed metric is publicly available at https://github.com/msu-video-group/ERQA.


title: A Unified and Refined Convergence Analysis for Non-Convex Decentralized Learning

abstract: We study the consensus decentralized optimization problem where the objective function is the average of $n$ agents private non-convex cost functions; moreover, the agents can only communicate to their neighbors on a given network topology. The stochastic learning setting is considered in this paper where each agent can only access a noisy estimate of its gradient. Many decentralized methods can solve such problem including EXTRA, Exact-Diffusion/D$^2$, and gradient-tracking. Unlike the famed DSGD algorithm, these methods have been shown to be robust to the heterogeneity across the local cost functions. However, the established convergence rates for these methods indicate that their sensitivity to the network topology is worse than DSGD. Such theoretical results imply that these methods can perform much worse than DSGD over sparse networks, which, however, contradicts empirical experiments where DSGD is observed to be more sensitive to the network topology. In this work, we study a general stochastic unified decentralized algorithm (SUDA) that includes the above methods as special cases. We establish the convergence of SUDA under both non-convex and the Polyak-Lojasiewicz condition settings. Our results provide improved network topology dependent bounds for these methods (such as Exact-Diffusion/D$^2$ and gradient-tracking) compared with existing literature. Moreover, our results show that these methods are often less sensitive to the network topology compared to DSGD, which agrees with numerical experiments.


title: DPFM: Deep Partial Functional Maps

abstract: We consider the problem of computing dense correspondences between non-rigid shapes with potentially significant partiality. Existing formulations tackle this problem through heavy manifold optimization in the spectral domain, given hand-crafted shape descriptors. In this paper, we propose the first learning method aimed directly at partial non-rigid shape correspondence. Our approach uses the functional map framework, can be trained in a supervised or unsupervised manner, and learns descriptors directly from the data, thus both improving robustness and accuracy in challenging cases. Furthermore, unlike existing techniques, our method is also applicable to partial-to-partial non-rigid matching, in which the common regions on both shapes are unknown a priori. We demonstrate that the resulting method is data-efficient, and achieves state-of-the-art results on several benchmark datasets. Our code and data can be found online: https://github.com/pvnieo/DPFM


title: Design of AoI-Aware 5G Uplink Scheduler UsingReinforcement Learning

abstract: Age of Information (AoI) reflects the time that is elapsed from the generation of a packet by a 5G user equipment(UE) to the reception of the packet by a controller. A design of an AoI-aware radio resource scheduler for UEs via reinforcement learning is proposed in this paper. In this paper, we consider a remote control environment in which a number of UEs are transmitting time-sensitive measurements to a remote controller. We consider the AoI minimization problem and formulate the problem as a trade-off between minimizing the sum of the expected AoI of all UEs and maximizing the throughput of the network. Inspired by the success of machine learning in solving large networking problems at low complexity, we develop a reinforcement learning-based method to solve the formulated problem. We used the state-of-the-art proximal policy optimization algorithm to solve this problem. Our simulation results showthat the proposed algorithm outperforms the considered baselines in terms of minimizing the expected AoI while maintaining the network throughput.


title: Switched Control Applied to a Totem-Pole Bridgeless Rectifier for Power Factor Correction

abstract: The wide range of operation of bridgeless rectifiers requires a control technique that guarantee robustness. Linear Power Factor Correction (PFC) control techniques, although effective, cannot guarantee such robustness. Nonlinear techniques such as one cycle control are more robust, but other options should be explored. In this work, an affine model is obtained for a Totem-Pole Bridgeless Rectifier (TPBR). An extension to an existing switched control design technique is presented in order to achieve PFC in a robust fashion for the TPBR. Simulations with nonideal components and distorted grid voltage show a precise, fast and robust performance of the switched controller. The effective reference following of the proposed method allows the user to define a current reference waveform that prioritize THD or power factor, depending on the application and norm requirements.


title: Hybrid-Layers Neural Network Architectures for Modeling the Self-Interference in Full-Duplex Systems

abstract: Full-duplex (FD) systems have been introduced to provide high data rates for beyond fifth-generation wireless networks through simultaneous transmission of information over the same frequency resources. However, the operation of FD systems is practically limited by the self-interference (SI), and efficient SI cancelers are sought to make the FD systems realizable. Typically, polynomial-based cancelers are employed to mitigate the SI; nevertheless, they suffer from high complexity. This article proposes two novel hybrid-layers neural network (NN) architectures to cancel the SI with low complexity. The first architecture is referred to as hybrid-convolutional recurrent NN (HCRNN), whereas the second is termed as hybrid-convolutional recurrent dense NN (HCRDNN). In contrast to the state-of-the-art NNs that employ dense or recurrent layers for SI modeling, the proposed NNs exploit, in a novel manner, a combination of different hidden layers (e.g., convolutional, recurrent, and/or dense) in order to model the SI with lower computational complexity than the polynomial and the state-of-the-art NN-based cancelers. The key idea behind using hybrid layers is to build an NN model, which makes use of the characteristics of the different layers employed in its architecture. More specifically, in the HCRNN, a convolutional layer is employed to extract the input data features using a reduced network scale. Moreover, a recurrent layer is then applied to assist in learning the temporal behavior of the input signal from the localized feature map of the convolutional layer. In the HCRDNN, an additional dense layer is exploited to add another degree of freedom for adapting the NN settings in order to achieve the best compromise between the cancellation performance and computational complexity. Complexity analysis and numerical simulations are provided to prove the superiority of the proposed architectures.


title: Watch out for the risky actors: Assessing risk in dynamic environments for safe driving

abstract: Driving in a dynamic environment that consists of other actors is inherently a risky task as each actor influences the driving decision and may significantly limit the number of choices in terms of navigation and safety plan. The risk encountered by the Ego actor depends on the driving scenario and the uncertainty associated with predicting the future trajectories of the other actors in the driving scenario. However, not all objects pose a similar risk. Depending on the object's type, trajectory, position, and the associated uncertainty with these quantities; some objects pose a much higher risk than others. The higher the risk associated with an actor, the more attention must be directed towards that actor in terms of resources and safety planning. In this paper, we propose a novel risk metric to calculate the importance of each actor in the world and demonstrate its usefulness through a case study.


title: Duality,Hidden Symmetry and Dynamic Isomerism in 2D Hinge Structures

abstract: Recently, a new type of duality was reported in some deformable mechanical networks which exhibit Kramers-like degeneracy in phononic spectrum at the self-dual point. In this work, we clarify the origin of this duality and propose a design principle of 2D self-dual structures with arbitrary complexity. We find that this duality originates from the (PCI) symmetry of the hinge, which belongs to a more general end-fixed scaling transformation. This symmetry gives the structure an extra degree of freedom without modifying its dynamics. This results in , i.e., dissimilar 2D mechanical structures, either periodic or aperiodic, having identical dynamic modes, based on which we demonstrate a new type of wave-guide without reflection or loss. Moreover, the PCI symmetry allows us to design various 2D periodic isostatic networks with hinge duality. At last, by further studying a 2D non-mechanical magnonic system, we show that the duality and the associated hidden symmetry should exist in a broad range of Hamiltonian systems.

categories: cond-mat.soft cond-mat.mes-hall cond-mat.mtrl-sci physics.app-ph


title: The interval posets of permutations seen from the decomposition tree perspective

abstract: The interval poset of a permutation is the set of intervals of a permutation, ordered with respect to inclusion. It has been introduced and studied recently in [B. Tenner, arXiv:2007.06142]. We study this poset from the perspective of the decomposition trees of permutations, describing a procedure to obtain the former from the latter. We then give alternative proofs of some of the results in [B. Tenner, arXiv:2007.06142], and we solve the open problems that it posed (and some other enumerative problems) using techniques from symbolic and analytic combinatorics. Finally, we compute the M\"obius function on such posets.


title: Observation of Geometric Heat Pump Effect in Periodic Driven Thermal Diffusion

abstract: The concept of geometry works as an overarching framework underlying a wide range of transport phenomena. Particularly, the geometric phase effect in classical and quantum heat pump has been attracting much attention in microscopic systems. Here, we formulate theoretically the geometric heat pump effect in macroscopic driven diffusive systems. Upon modulation protocols, the nontrivial geometric curvature in the parameter space universally induces an additional pumped heat, beyond the constraint of hot-to-cold flowing. Furthermore, we set up a minimum experiment and indeed observe a non-vanishing directional heat flow across the driven system, despite keeping zero thermal bias between two time-dependent thermal reservoirs at every instant. We verify that in analogy to the geometric phase effect, the geometric pumped heat during each driving cycle is independent of driving periods in the adiabatic limit and coincides with theoretical predictions, thus validating its geometric origin. These results about geometric heat pump effect could have potential implications for designing and implementing nonreciprocal and topological thermal meta-devices under spatiotemporal modulations.


title: New light rings from multiple critical curves as observational signatures of black hole mimickers

abstract: We argue that the appearance of additional light rings in a shadow observation - beyond the infinite sequence of exponentially demagnified self-similar rings foreseen in the Kerr solution - would make a compelling case for the existence of black hole mimickers having multiple critical curves. We support this claim by discussing three different scenarios of spherically symmetric wormhole geometries having two such critical curves, and explicitly work out the optical appearance of one such object when surrounded by an optically and geometrically thin accretion disk.


title: Analytical Estimations of the Chromaticity and Corrections to the Spin Precession Frequency in Weak Focusing Magnetic Storage Rings

abstract: Understanding beam and spin dynamics are fundamental in accelerator physics, and there has been growing interest in having more precise estimations of the beam and spin dynamics variables, as more high precision particle physics experiments in the Intensity Frontier appear. The present paper provides analytical estimations of some of the important variables such as beam transverse chromaticities and the spin precession frequency bias in the simplest type of particle accelerator: a circular magnetic storage ring with weak vertical focusing. We attempt to precisely obtain the next order approximations from the small betatron oscillations or the momentum dispersion, verified by high precision spin tracking simulation. We also discuss a potential way to suppress the spin precession frequency bias which relevant experiments may find beneficial.


title: Scalable Learning Environments for Teaching Cybersecurity Hands-on

abstract: This Innovative Practice full paper describes a technical innovation for scalable teaching of cybersecurity hands-on classes using interactive learning environments. Hands-on experience significantly improves the practical skills of learners. However, the preparation and delivery of hands-on classes usually do not scale. Teaching even small groups of students requires a substantial effort to prepare the class environment and practical assignments. Further issues are associated with teaching large classes, providing feedback, and analyzing learning gains. We present our research effort and practical experience in designing and using learning environments that scale up hands-on cybersecurity classes. The environments support virtual networks with full-fledged operating systems and devices that emulate real-world systems. (...) Using the presented environments KYPO Cyber Range Platform and Cyber Sandbox Creator, we delivered the classes on-site or remotely for various target groups of learners (K-12, university students, and professional learners). The learners value the realistic nature of the environments that enable exercising theoretical concepts and tools. The instructors value time-efficiency when preparing and deploying the hands-on activities. Engineering and computing educators can freely use our software, which we have released under an open-source license. We also provide detailed documentation and exemplary hands-on training to help other educators adopt our teaching innovations and enable sharing of reusable components within the community.


title: Data-driven and Automatic Surface Texture Analysis Using Persistent Homology

abstract: Surface roughness plays an important role in analyzing engineering surfaces. It quantifies the surface topography and can be used to determine whether the resulting surface finish is acceptable or not. Nevertheless, while several existing tools and standards are available for computing surface roughness, these methods rely heavily on user input thus slowing down the analysis and increasing manufacturing costs. Therefore, fast and automatic determination of the roughness level is essential to avoid costs resulting from surfaces with unacceptable finish, and user-intensive analysis. In this study, we propose a Topological Data Analysis (TDA) based approach to classify the roughness level of synthetic surfaces using both their areal images and profiles. We utilize persistent homology from TDA to generate persistence diagrams that encapsulate information on the shape of the surface. We then obtain feature matrices for each surface or profile using Carlsson coordinates, persistence images, and template functions. We compare our results to two widely used methods in the literature: Fast Fourier Transform (FFT) and Gaussian filtering. The results show that our approach yields mean accuracies as high as 97%. We also show that, in contrast to existing surface analysis tools, our TDA-based approach is fully automatable and provides adaptive feature extraction.


title: Measurement of prompt $\rm{D_{s}^{+}}$-meson production and azimuthal anisotropy in Pb-Pb collisions at $\sqrt{s_{\rm NN}} = 5.02$ TeV

abstract: The production yield and angular anisotropy of prompt ${D_s^+}$ mesons were measured as a function of transverse momentum ($p_{ T}$) in Pb-Pb collisions at a centre-of-mass energy per nucleon pair $\sqrt{s_{ NN}} = 5.02$ TeV collected with the ALICE detector at the LHC. ${D_s^+}$ mesons and their charge conjugates were reconstructed at midrapidity ($|y|<0.5$) from their hadronic decay channel ${D_s^+ \to \phi \pi^+}$, with ${\phi \to K^-K^+}$, in the $p_{ T}$ intervals $2<p_{ T}<50$ GeV/$c$ and $2<p_{ T}<36$ GeV/$c$ for the 0-10% and 30-50% centrality intervals. For $p_{ T}>10$ GeV/$c$, the measured ${D_s^+}$-meson nuclear modification factor $R_{ AA}$ is consistent with the one of non-strange D mesons within uncertainties, while at lower $p_{ T}$ a hint for a ${D_s^+}$-meson $R_{ AA}$ larger than that of non-strange D mesons is seen. The enhanced production of ${D_s^+}$ relative to non-strange D mesons is also studied by comparing the $p_{ T}$-dependent ${D_s^+/D^0}$ production yield ratios in Pb-Pb and in pp collisions. The ratio measured in Pb-Pb collisions is found to be on average higher than that in pp collisions in the interval $2<p_{ T} <8$ GeV/$c$ with a significance of 2.3$\sigma$ and 2.4$\sigma$ for the 0-10% and 30-50% centrality intervals. The azimuthal anisotropy coefficient $v_2$ of prompt ${D_s^+}$ mesons was measured in Pb-Pb collisions in the 30-50% centrality interval and is found to be compatible with that of non-strange D mesons. The main features of the measured $R_{ AA}$, ${D_s^+/D^0}$ ratio, and $v_2$ as a function of $p_{ T}$ are described by theoretical calculations of charm-quark transport in a hydrodynamically expanding quark-gluon plasma including hadronisation via charm-quark recombination with light quarks from the medium. The $p_{ T}$-integrated production yield of ${D_s^+}$ mesons is compatible with the prediction of the statistical hadronisation model.


title: Gradient-Based Mixed Planning with Symbolic and Numeric Action Parameters

abstract: Dealing with planning problems with both logical relations and numeric changes in real-world dynamic environments is challenging. Existing numeric planning systems for the problem often discretize numeric variables or impose convex constraints on numeric variables, which harms the performance when solving problems. In this paper, we propose a novel algorithm framework to solve numeric planning problems mixed with logical relations and numeric changes based on gradient descent. We cast the numeric planning with logical relations and numeric changes as an optimization problem. Specifically, we extend syntax to allow parameters of action models to be either objects or real-valued numbers, which enhances the ability to model real-world numeric effects. Based on the extended modeling language, we propose a gradient-based framework to simultaneously optimize numeric parameters and compute appropriate actions to form candidate plans. The gradient-based framework is composed of an algorithmic heuristic module based on propositional operations to select actions and generate constraints for gradient descent, an algorithmic transition module to update states to next ones, and a loss module to compute loss. We repeatedly minimize loss by updating numeric parameters and compute candidate plans until it converges into a valid plan for the planning problem. In the empirical study, we exhibit that our algorithm framework is both effective and efficient in solving planning problems mixed with logical relations and numeric changes, especially when the problems contain obstacles and non-linear numeric effects.


title: Non-local gravity in bouncing cosmology scenarios

abstract: In this work, we analyzed the improved Deser-Woodard non-local gravity over the background of five different bouncing cosmologies, whose premise is avoid the initial singular state of the universe. We developed the numerical solution for the non-local distortion function, which encompass the modifications to the Einstein-Hilbert action, using the reconstruction procedure and we have found that they have a viable cosmological solution. Afterwards, we discussed the physical aspects and outcomes of the evolution of the distortion function throughout the bouncing point for these models, specifically: the symmetric bounce, oscillatory bounce, the matter bounce, finite time singularity model, and the pre-inflationary asymmetrical bounce.


title: EEGminer: Discovering Interpretable Features of Brain Activity with Learnable Filters

abstract: Patterns of brain activity are associated with different brain processes and can be used to identify different brain states and make behavioral predictions. However, the relevant features are not readily apparent and accessible. To mine informative latent representations from multichannel recordings of ongoing EEG activity, we propose a novel differentiable decoding pipeline consisting of learnable filters and a pre-determined feature extraction module. Specifically, we introduce filters parameterized by generalized Gaussian functions that offer a smooth derivative for stable end-to-end model training and allow for learning interpretable features. For the feature module, we use signal magnitude and functional connectivity estimates. We demonstrate the utility of our model towards emotion recognition from EEG signals on the SEED dataset, as well as on a new EEG dataset of unprecedented size (i.e., 761 subjects), where we identify consistent trends of music perception and related individual differences. The discovered features align with previous neuroscience studies and offer new insights, such as marked differences in the functional connectivity profile between left and right temporal areas during music listening. This agrees with the respective specialisation of the temporal lobes regarding music perception proposed in the literature.


title: Temporal separation of whale vocalizations from background oceanic noise using a power calculation

abstract: The process of analyzing audio signals in search of cetacean vocalizations is in many cases a very arduous task, requiring many complex computations, a plethora of digital processing techniques and the scrutinization of an audio signal with a fine comb to determine where the vocalizations are located. To ease this process, a computationally efficient and noise-resistant method for determining whether an audio segment contains a potential cetacean call is developed here with the help of a robust power calculation for stationary Gaussian noise signals and a recursive method for determining the mean and variance of a given sample frame. The resulting detector is tested on audio recordings containing southern right whale sounds and its performance is compared to a contemporary energy detector and a popular deep learning method. The detector exhibits good performance at moderate-to-high signal-to-noise ratio values. The detector succeeds in being easy to implement, computationally efficient to use and robust enough to accurately detect whale vocalizations in a noisy underwater environment.


title: Riemannian classification of EEG signals with missing values

abstract: This paper proposes a strategy to handle missing data for the classification of electroencephalograms using covariance matrices. It relies on the observed-data likelihood within an expectation-maximization algorithm. This approach is compared to two existing state-of-the-art methods: (i) covariance matrices computed with imputed data; (ii) Riemannian averages of partially observed covariance matrix. All approaches are combined with the minimum distance to Riemannian mean classifier and applied to a classification task of two widely known paradigms of brain-computer interfaces. In addition to be applicable for a wider range of missing data scenarios, the proposed strategy generally performs better than other methods on the considered real EEG data.


title: Decimetric type U solar radio bursts and associated EUV phenomena on 2011 February 9

abstract: A GOES M1.9 flare took place in active region AR 11153 on February 9,2011. With the resolution of 200 kHz and a time cadence of 80 ms, the reverse-drifting (RS) type III bursts, intermittent sequence of type U bursts, drifting pulsation structure (DPS), and fine structures were observed by the Yunnan Observatories Solar Radio Spectrometer(YNSRS). Combined information revealed by the multi-wavelength data indicated that after the DPS which observed by YNSRS, the generation rate of type U bursts suddenly increased 5 times than before. In this event, the generation rate of type U bursts may depend on the magnetic reconnection rate. Our observations are consistent with previous numerical simulations results. After the first plasmoid produced (plasma instability occurred), the magnetic reconnection rate increased suddenly 5-8 times than before. Furthermore, after the DPS, the frequency range of turnover frequency of type U bursts is obviously broadened 3 times than before, which indicates the fluctuation amplitude of the density in the loop-top. Our observations also support the numerical simulations during the flare impulsive phase. The turbulence occurs at the top of the flare loop, the plasmoids can trap the non-thermal particles and cause the density fluctuation at the loop-top. The observations are generally consistent with the results of numerical simulations, helping us to better understand the characteristics of the whole physical process of eruption.


title: Updated Studies on Exomoons in the HD 23079 System

abstract: We re-evaluate the outer edge of orbital stability for possible exomoons orbiting the radial velocity planet discovered in the HD 23079 system. In this system, a solar-type star hosts a Jupiter-mass planet in a nearly circular orbit in the outer stellar habitable zone. The outer stability limit of exomoons is deduced using $N$-body and tidal migration simulations considering a large range of initial conditions, encompassing both prograde and retrograde orbits. In particular, we extend previous works by evaluating many values in the satellite mean anomaly to identify and exclude regions of quasi-stability. Future observations of this system can make use of our results through a scale factor relative to the currently measured minimum mass. Using a constant time lag tidal model (Hut 1981), we find that plausible tidal interactions within the system are insufficient to induce significant outward migration toward the theoretical stability limit. While current technologies are incapable of detecting exomoons in this system, we comment on the detectability of putative moons through Doppler monitoring within direct imaging observations in view of future research capacities.


title: The emergence of scale-free fires in Australia

abstract: Between 2019 and 2020, during the country's hottest and driest year on record, Australia experienced a dramatic bushfire season, with catastrophic ecological and environmental consequences. Several studies highlighted how such abrupt changes in fire regimes may have been in large part a consequence of climate change and other anthropogenic transformations. Here, we analyze the monthly evolution of the burned area in Australia from 2000 to 2020, obtained via satellite imaging through the MODIS platform. We find that the 2019-2020 peak is associated with signatures typically found near critical points. We introduce a modeling framework based on forest-fire models to study the properties of these emergent fire outbreaks, showing that the behavior observed during the 2019-2020 fire season matches the one of a percolation transition, where system-size outbreaks appear. Our model also highlights the existence of an absorbing phase transition that might be eventually crossed, after which the vegetation cannot recover.


title: DEEPAG\'E: Answering Questions in Portuguese about the Brazilian Environment

abstract: The challenge of climate change and biome conservation is one of the most pressing issues of our time - particularly in Brazil, where key environmental reserves are located. Given the availability of large textual databases on ecological themes, it is natural to resort to question answering (QA) systems to increase social awareness and understanding about these topics. In this work, we introduce multiple QA systems that combine in novel ways the BM25 algorithm, a sparse retrieval technique, with PTT5, a pre-trained state-of-the-art language model. Our QA systems focus on the Portuguese language, thus offering resources not found elsewhere in the literature. As training data, we collected questions from open-domain datasets, as well as content from the Portuguese Wikipedia and news from the press. We thus contribute with innovative architectures and novel applications, attaining an F1-score of 36.2 with our best model.


title: Comparison of the measured atmospheric muon rate with Monte Carlo simulations and sensitivity study for detection of prompt atmospheric muons with KM3NeT

abstract: The KM3NeT Collaboration has successfully deployed the first detection units of the next generation undersea neutrino telescopes in the Mediterranean Sea at the two sites in Italy and in France. A sample of the data collected between December 2016 and January 2020 has been used to measure the atmospheric muon rate at two different depths under the sea level: 3.5 km with KM3NeT-ARCA and 2.5 km with KM3NeT-ORCA. Atmospheric muons represent an abundant signal in a neutrino telescope and can be used to test the reliability of the Monte Carlo simulation chain and to study the physics of extensive air showers caused by highly-energetic primary nuclei impinging the Earth's atmosphere. At energies above PeV the contribution from prompt muons, created right after the first interaction in the shower, is expected to become dominant, however its existence has not yet been experimentally confirmed. In this work, data collected with the first detection units of KM3NeT are compared to Monte Carlo simulations based on MUPAGE and CORSIKA codes. The main features of the simulation and reconstruction chains are presented. Additionally, the first results of the simulated signal from the prompt muon component for KM3NeT-ARCA and KM3NeT-ORCA obtained with CORSIKA are discussed.


title: Neural Network Compatible Off-Policy Natural Actor-Critic Algorithm

abstract: Learning optimal behavior from existing data is one of the most important problems in Reinforcement Learning (RL). This is known as "off-policy control" in RL where an agent's objective is to compute an optimal policy based on the data obtained from the given policy (known as the behavior policy). As the optimal policy can be very different from the behavior policy, learning optimal behavior is very hard in the "off-policy" setting compared to the "on-policy" setting where new data from the policy updates will be utilized in learning. This work proposes an off-policy natural actor-critic algorithm that utilizes state-action distribution correction for handling the off-policy behavior and the natural policy gradient for sample efficiency. The existing natural gradient-based actor-critic algorithms with convergence guarantees require fixed features for approximating both policy and value functions. This often leads to sub-optimal learning in many RL applications. On the other hand, our proposed algorithm utilizes compatible features that enable one to use arbitrary neural networks to approximate the policy and the value function and guarantee convergence to a locally optimal policy. We illustrate the benefit of the proposed off-policy natural gradient algorithm by comparing it with the vanilla gradient actor-critic algorithm on benchmark RL tasks.


title: Dynamic pricing and assortment under a contextual MNL demand

abstract: We consider dynamic multi-product pricing and assortment problems under an unknown demand over T periods, where in each period, the seller decides on the price for each product or the assortment of products to offer to a customer who chooses according to an unknown Multinomial Logit Model (MNL). Such problems arise in many applications, including online retail and advertising. We propose a randomized dynamic pricing policy based on a variant of the Online Newton Step algorithm (ONS) that achieves a $O(d\sqrt{T}\log(T))$ regret guarantee under an adversarial arrival model. We also present a new optimistic algorithm for the adversarial MNL contextual bandits problem, which achieves a better dependency than the state-of-the-art algorithms in a problem-dependent constant $\kappa_2$ (potentially exponentially small). Our regret upper bound scales as $\tilde{O}(d\sqrt{\kappa_2 T}+ \log(T)/\kappa_2)$, which gives a stronger bound than the existing $\tilde{O}(d\sqrt{T}/\kappa_2)$ guarantees.


title: BNPdensity: Bayesian nonparametric mixture modeling in R

abstract: Robust statistical data modelling under potential model mis-specification often requires leaving the parametric world for the nonparametric. In the latter, parameters are infinite dimensional objects such as functions, probability distributions or infinite vectors. In the Bayesian nonparametric approach, prior distributions are designed for these parameters, which provide a handle to manage the complexity of nonparametric models in practice. However, most modern Bayesian nonparametric models seem often out of reach to practitioners, as inference algorithms need careful design to deal with the infinite number of parameters. The aim of this work is to facilitate the journey by providing computational tools for Bayesian nonparametric inference. The article describes a set of functions available in the \R package BNPdensity in order to carry out density estimation with an infinite mixture model, including all types of censored data. The package provides access to a large class of such models based on normalized random measures, which represent a generalization of the popular Dirichlet process mixture. One striking advantage of this generalization is that it offers much more robust priors on the number of clusters than the Dirichlet. Another crucial advantage is the complete flexibility in specifying the prior for the scale and location parameters of the clusters, because conjugacy is not required. Inference is performed using a theoretically grounded approximate sampling methodology known as the Ferguson & Klass algorithm. The package also offers several goodness of fit diagnostics such as QQ-plots, including a cross-validation criterion, the conditional predictive ordinate. The proposed methodology is illustrated on a classical ecological risk assessment method called the Species Sensitivity Distribution (SSD) problem, showcasing the benefits of the Bayesian nonparametric framework.


title: Control and stabilization for the dispersion generalized Benjamin equation on the circle

abstract: This paper is concerned with controllability and stabilization properties of the dispersion generalized Benjamin equation on the periodic domain $\mathbb{T}.$ First, by assuming the control input acts on all the domain, the system is proved to be globally exactly controllable in the Sobolev space $H^{s}_{p}(\mathbb{T}),$ with $s\geq 0.$ Second, by providing a locally-damped term added to the equation as a feedback law, it is shown that the resulting equation is globally well-posed and locally exponentially stabilizable in the space $L^{2}_{p}(\mathbb{T}).$ The main ingredient to prove the global well-posedness is the introduction of the dissipation-normalized Bourgain spaces which allows one to gain smoothing properties simultaneously from the dissipation and dispersion present in the equation. Finally, the local exponential stabilizability result is accomplished taking into account the decay of the associated semigroup combined with the fixed point argument.


title: Fast Sausage Oscillations in Coronal Loops with Fine Structures

abstract: Fast sausage modes (FSMs) in flare loops have long been invoked to account for rapid quasi-periodic pulsations (QPPs) with periods of order seconds in flare lightcurves. However, most theories of FSMs in solar coronal cylinders assume a perfectly axisymmetric equilibrium, an idealized configuration apparently far from reality. In particular, it remains to examine whether FSMs exist in coronal cylinders with fine structures. Working in the framework of ideal magnetohydrodynamics (MHD), we numerically follow the response to an axisymmetric perturbation of a coronal cylinder for which a considerable number of randomly distributed fine structures are superposed on an axisymmetric background. The parameters for the background component are largely motivated by the recent IRIS identification of a candidate FSM in Fe XXI 1354 \AA~observations. We find that the composite cylinder rapidly settles to an oscillatory behavior largely compatible with a canonical trapped FSM. This happens despite that kink-like motions develop in the fine structures. We further synthesize the Fe XXI 1354 \AA~emissions, finding that the transverse Alfv\'en time characterizes the periodicities in the intensity, Doppler shift, and Doppler width signals. Distinct from the case without fine structuring, a non-vanishing Doppler shift is seen even at the apex. We conclude that density-enhanced equilibria need not be strictly axisymmetric to host FSM-like motions in general, and FSMs remain a candidate interpretation for rapid QPPs in solar flares.


title: Robust Control of a Multi-Axis Shape Memory Alloy-Driven Soft Manipulator

abstract: Control of soft robotic manipulators remains a challenge for designs with advanced capabilities and novel actuation. Two significant limitations are multi-axis, three-dimensional motion of soft bodies alongside actuator dynamics and constraints, both of which are present in shape-memory-alloy (SMA)-powered soft robots. This article addresses both concerns with a robust feedback control scheme, demonstrating state tracking control for a soft robot manipulator of this type. Our controller uses a static beam bending model to approximate the soft limb as an LTI system, alongside a singular-value-decomposition compensator approach to decouple the multi-axial motion and an anti-windup element for the actuator saturation. We prove stability and verify robustness of our controller, with robustness intended to account for the unmodeled dynamics. Our implementation is verified in hardware tests of a soft SMA-powered limb, showing low tracking error, with promising results for future multi-limbed robots.


title: Predictions from extra dimensions

abstract: By representing the electroweak gauge symmetry group $SU(2) \times U(1)$ by a hypertorus $S_2 \times S_1$, the electroweak mixing angle and the fine structure constant are predicted. By representing neutrinos as oscillating spheroid perturbations on the same hypertorus, the number of neutrino families and the neutrino mixing matrix are predicted.


title: Risks of AI Foundation Models in Education

abstract: If the authors of a recent Stanford report (Bommasani et al., 2021) on the opportunities and risks of "foundation models" are to be believed, these models represent a paradigm shift for AI and for the domains in which they will supposedly be used, including education. Although the name is new (and contested (Field, 2021)), the term describes existing types of algorithmic models that are "trained on broad data at scale" and "fine-tuned" (i.e., adapted) for particular downstream tasks, and is intended to encompass large language models such as BERT or GPT-3 and computer vision models such as CLIP. Such technologies have the potential for harm broadly speaking (e.g., Bender et al., 2021), but their use in the educational domain is particularly fraught, despite the potential benefits for learners claimed by the authors. In section 3.3 of the Stanford report, Malik et al. argue that achieving the goal of providing education for all learners requires more efficient computational approaches that can rapidly scale across educational domains and across educational contexts, for which they argue foundation models are uniquely well-suited. However, evidence suggests that not only are foundation models not likely to achieve the stated benefits for learners, but their use may also introduce new risks for harm.


title: Abelian invariants and a reduction theorem for the modular isomorphism problem

abstract: We show that elementary abelian direct factors can be disregarded in the study of the modular isomorphism problem. Moreover, we obtain four new series of abelian invariants of the group base in the modular group algebra of a finite $p$-group. Finally, we apply our results to new classes of groups.


title: Private Language Model Adaptation for Speech Recognition

abstract: Speech model adaptation is crucial to handle the discrepancy between server-side proxy training data and actual data received on local devices of users. With the use of federated learning (FL), we introduce an efficient approach on continuously adapting neural network language models (NNLMs) on private devices with applications on automatic speech recognition (ASR). To address the potential speech transcription errors in the on-device training corpus, we perform empirical studies on comparing various strategies of leveraging token-level confidence scores to improve the NNLM quality in the FL settings. Experiments show that compared with no model adaptation, the proposed method achieves relative 2.6% and 10.8% word error rate (WER) reductions on two speech evaluation datasets, respectively. We also provide analysis in evaluating privacy guarantees of our presented procedure.


title: Clinical Trial Information Extraction with BERT

abstract: Natural language processing (NLP) of clinical trial documents can be useful in new trial design. Here we identify entity types relevant to clinical trial design and propose a framework called CT-BERT for information extraction from clinical trial text. We trained named entity recognition (NER) models to extract eligibility criteria entities by fine-tuning a set of pre-trained BERT models. We then compared the performance of CT-BERT with recent baseline methods including attention-based BiLSTM and Criteria2Query. The results demonstrate the superiority of CT-BERT in clinical trial NLP.


title: Scission configuration in the self-consistent calculations with neck constraint

abstract: The calculations of the potential energy surface are essential in the theoretical description of the fission process. In the constrained self-consistent approach, the smooth evolution of nuclear shape is described from the ground state until a very elongated one with a narrow neck. In all microscopic calculations, the rupture of the neck at scission is associated with a substantial change of nuclear matter density distribution and rapid energy decrease. In this paper, we show that there is no discontinuity of the potential energy surface at scission when multi-constrained calculations are applied with the neck constraint. An early rupture of the neck at lower quadrupole and octupole moments is discussed as competitive with the conventional fission path. We discuss the neck properties in the scission configuration. We find that the neck radius in the asymmetric fission mode cannot decrease below 2 fm, and the nuclear matter density cannot decrease below the saturation density. In the compact fission mode, nuclear density may go down to half of the saturation density before the rupture of the neck.


title: Localization properties of Dirac modes at the Roberge-Weiss phase transition

abstract: We study the localization properties of the low-lying Dirac eigenmodes in QCD at imaginary chemical potential $\hat{\mu}_I=\pi$ at temperatures above the Roberge-Weiss transition temperature $T_{\rm RW}$. We find that modes are localized up to a temperature-dependent "mobility edge" and delocalized above it, and that the mobility edge extrapolates to zero at a temperature compatible with $T_{\rm RW}$. This supports the existence of a strong connection between localization of the low Dirac modes and deconfinement, studied here for the first time in a model with a genuine deconfinement transition in the continuum limit in the presence of dynamical fermions.


title: Accelerating Framework of Transformer by Hardware Design and Model Compression Co-Optimization

abstract: State-of-the-art Transformer-based models, with gigantic parameters, are difficult to be accommodated on resource constrained embedded devices. Moreover, with the development of technology, more and more embedded devices are available to run a Transformer model. For a Transformer model with different constraints (tight or loose), it can be deployed onto devices with different computing power. However, in previous work, designers did not choose the best device among multiple devices. Instead, they just used an existing device to deploy model, which was not necessarily the best fit and may lead to underutilization of resources. To address the deployment challenge of Transformer and the problem to select the best device, we propose an algorithm & hardware closed-loop acceleration framework. Given a dataset, a model, latency constraint LC and accuracy constraint AC, our framework can provide a best device satisfying both constraints. In order to generate a compressed model with high sparsity ratio, we propose a novel pruning technique, hierarchical pruning (HP). We optimize the sparse matrix storage format for HP matrix to further reduce memory usage for FPGA implementation. We design a accelerator that takes advantage of HP to solve the problem of concurrent random access. Experiments on Transformer and TinyBert model show that our framework can find different devices for various LC and AC, covering from low-end devices to high-end devices. Our HP can achieve higher sparsity ratio and is more flexible than other sparsity pattern. Our framework can achieve 37x, 1.9x, 1.7x speedup compared to CPU, GPU and FPGA, respectively.


title: Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime Inference

abstract: Despite rapid advances in continual learning, a large body of research is devoted to improving performance in the existing setups. While a handful of work do propose new continual learning setups, they still lack practicality in certain aspects. For better practicality, we first propose a novel continual learning setup that is online, task-free, class-incremental, of blurry task boundaries and subject to inference queries at any moment. We additionally propose a new metric to better measure the performance of the continual learning methods subject to inference queries at any moment. To address the challenging setup and evaluation protocol, we propose an effective method that employs a new memory management scheme and novel learning techniques. Our empirical validation demonstrates that the proposed method outperforms prior arts by large margins. Code and data splits are available at https://github.com/naver-ai/i-Blurry.