title: Stellar winds and metal enrichment from fast-rotating Population III stars

abstract: Stellar winds from fast-rotating Population III (Pop III) stars have long been suspected to make important contributions to early metal enrichment, as features in the nucleosynthesis of such `spinstars' are consistent with the chemical abundance patterns of some metal-poor stars in the local Universe. Particularly, stellar winds rich in light elements can provide another pathway towards explaining the carbon enhancement in carbon-enhanced metal-poor (CEMP) stars. In this work, we focus on the feedback of Pop III stellar winds combined with supernovae (SNe), and derive the resulting chemical signatures in the enriched medium. We explore a large parameter space of Pop III star formation, feedback, yields from winds and SNe with a semi-analytical model. The predicted pattern of carbon and iron abundances of second-generation stars agrees well with observations of CEMP-no stars ($[\rm Ba/Fe]<0$) at $[\rm Fe/H]\lesssim -3$ and $A(\mathrm{C})\lesssim 7$, under the optimistic assumption of significant mass loss by winds from massive ($\gtrsim 25\ \rm M_{\odot}$) stars that collapse into BHs without SNe. In this scenario, carbon-rich but iron-free second-generation stars can form in systems dominated by enrichment from winds, gaining trace amounts of iron by accretion from the interstellar medium, to become the most iron-poor and carbon-enhanced stars seen in observations ($[\rm Fe/H]\lesssim -4$, $[\rm C/Fe]\gtrsim 2$). We conclude that the observed CEMP-no stars can be explained by both our winds + ISM accretion channel as well as the well-studied faint SN scenario. Wind feedback from Pop~III spinstars deserves more detailed modelling in early cosmic structure formation.


title: Geometric Deep Learning on Anatomical Meshes for the Prediction of Alzheimer's Disease

abstract: Geometric deep learning can find representations that are optimal for a given task and therefore improve the performance over pre-defined representations. While current work has mainly focused on point representations, meshes also contain connectivity information and are therefore a more comprehensive characterization of the underlying anatomical surface. In this work, we evaluate four recent geometric deep learning approaches that operate on mesh representations. These approaches can be grouped into template-free and template-based approaches, where the template-based methods need a more elaborate pre-processing step with the definition of a common reference template and correspondences. We compare the different networks for the prediction of Alzheimer's disease based on the meshes of the hippocampus. Our results show advantages for template-based methods in terms of accuracy, number of learnable parameters, and training speed. While the template creation may be limiting for some applications, neuroimaging has a long history of building templates with automated tools readily available. Overall, working with meshes is more involved than working with simplistic point clouds, but they also offer new avenues for designing geometric deep learning architectures.


title: Magnetic dipolar modes in magnon-polariton condensates

abstract: For dipole-carrying excitations observed in a high-quality resonator, strong-coupling modes can appear as composite bosons with the spontaneous formation of quantized vortices in the condensed phase of a polariton fluid. In exciton-polaritons, in particular, it leads to sustained trapping of the emitted photon. In this paper, we show that magnon-polaritons can be realized due to magnon condensation caused by magnetic dipole-dipole interaction. In a quasi-2D ferrite disk placed in a microwave cavity, one observes quantum confinement effects of magnetic-dipolar-mode (MDM) oscillations. These modes, characterized by energy eigenstates with rotational superflows and quantized vortices, are exhibited as spinor condensates. Along with the condensation of MDM magnons in the quasi-2D disk of the magnetic insulator, electric dipole condensation is also observed. At the MDM resonances, transfer between angular momenta in the magnetic insulator and in the vacuum cavity, demonstrates generation of vortex flows with fixed handedness. This indicates unique topological properties of polariton wavefronts. One observes curved wavefronts and effects of supperradiance in microwave structures. In an environment of scattering states of microwave waveguide, EM waves can carry the topological phases of MDM resonances.


title: Approximation of fractional harmonic maps

abstract: This paper addresses the approximation of fractional harmonic maps. Besides a unit-length constraint, one has to tackle the difficulty of nonlocality. We establish weak compactness results for critical points of the fractional Dirichlet energy on unit-length vector fields. We devise and analyze numerical methods for the approximation of various partial differential equations related to fractional harmonic maps. The compactness results imply the convergence of numerical approximations. Numerical examples on spin chain dynamics and point defects are presented to demonstrate the effectiveness of the proposed methods.


title: Nonexistence of exact Lagrangian tori in affine conic bundles over $\mathbb{C}^n$

abstract: Let $M\subset\mathbb{C}^{n+1}$ be a smooth affine hypersurface defined by the equation $xy+p(z_1,\cdots,z_{n-1})=1$, where $p$ is a Brieskorn-Pham polynomial and $n\geq2$. We prove that if $L\subset M$ is an orientable exact Lagrangian submanifold, then $L$ does not admit a Riemannian metric with non-positive sectional curvature. The key point of the proof is to establish a version of homological mirror symmetry for the wrapped Fukaya category of $M$, from which the finite-dimensionality of the symplectic cohomology group $\mathit{SH}^0(M)$ follows by a Hochschild cohomology computation.


title: Semantic similarity metrics for learned image registration

abstract: We propose a semantic similarity metric for image registration. Existing metrics like Euclidean Distance or Normalized Cross-Correlation focus on aligning intensity values, giving difficulties with low intensity contrast or noise. Our approach learns dataset-specific features that drive the optimization of a learning-based registration model. We train both an unsupervised approach using an auto-encoder, and a semi-supervised approach using supplemental segmentation data to extract semantic features for image registration. Comparing to existing methods across multiple image modalities and applications, we achieve consistently high registration accuracy. A learned invariance to noise gives smoother transformations on low-quality images.


title: Quantitative Age Estimation of Supernova Remnants and Associated Pulsars

abstract: The age of a supernova remnant (SNR) is, though undoubtedly one of the most important properties for study of its evolution, difficult to estimate reliably in most cases. In this study, we compare the dynamical and plasma ages of the SNRs and characteristic ages of their associated pulsars with the corresponding SNRs' ages that are generally thought to be reliable ($t_{\rm r}$): historical and light-echo ages of the SNRs, kinematic ages of the ejecta knots and kinematic ages of the associated neutron stars (NS). The kinematic age of ejecta knots or a NS is the time that they have taken to reach the current positions from the explosion center. We use all of the available 24 systems for which $t_{\rm r}$ is already available (historical, light-echo, and ejecta kinematic ages) or measurable (NS kinematic age). We estimate the NS kinematic ages for eight SNR-NS systems by determining quantitatively the geometric centers of the SNR shells. The obtained $t_{\rm r}$ ranges from 33 yr to $\approx 400$ kyr. We find that the two SNR ages, dynamical and plasma ages, are consistent with $t_{\rm r}$ within a factor of four, whereas the characteristic ages of the pulsars differ from $t_{\rm r}$ by more than a factor of four in some systems. Using the $t_{\rm r}$ summarized in this work, we present the initial spin periods of the associated pulsars, which are more strictly constrained than the previous works, as well.


title: The large amplitude solution of the Boltzmann equation with soft potential

abstract: In this paper, we deal with (angular cut-off) Boltzmann equation with soft potential ($-3<\gamma<0$). In particular, we construct a unique global solution in $L^\infty_{x,v}$ which converges to global equilibrium asymptotically provided that initial data has a large amplitude but with sufficiently small relative entropy. Because frequency multiplier is not uniformly positive anymore, unlike hard potential case, time-involved velocity weight will be used to derive sub-exponential decay of the solution. Motivated by recent development of $L^2\mbox{-}L^\infty$ approach also, we introduce some modified estimates of quadratic nonlinear terms. Linearized collision kernel will be treated in a subtle manner to control singularity of soft potential kernel.


title: T2VLAD: Global-Local Sequence Alignment for Text-Video Retrieval

abstract: Text-video retrieval is a challenging task that aims to search relevant video contents based on natural language descriptions. The key to this problem is to measure text-video similarities in a joint embedding space. However, most existing methods only consider the global cross-modal similarity and overlook the local details. Some works incorporate the local comparisons through cross-modal local matching and reasoning. These complex operations introduce tremendous computation. In this paper, we design an efficient global-local alignment method. The multi-modal video sequences and text features are adaptively aggregated with a set of shared semantic centers. The local cross-modal similarities are computed between the video feature and text feature within the same center. This design enables the meticulous local comparison and reduces the computational cost of the interaction between each text-video pair. Moreover, a global alignment method is proposed to provide a global cross-modal measurement that is complementary to the local perspective. The global aggregated visual features also provide additional supervision, which is indispensable to the optimization of the learnable semantic centers. We achieve consistent improvements on three standard text-video retrieval benchmarks and outperform the state-of-the-art by a clear margin.


title: Divisors of Fourier coefficients of two newforms

abstract: For a pair of distinct non-CM newforms of weights at least 2, having rational integral Fourier coefficients $a_{1}(n)$ and $a_{2}(n)$, under GRH, we obtain an estimate for the set of primes $p$ such that $$ \omega(a_1(p)-a_2(p)) \le [ 7k+{1}/{2}+k^{1/5}],$$ where $\omega(n)$ denotes the number of distinct prime divisors of an integer $n$ and $k$ is the maximum of their weights. As an application, under GRH, we show that the number of primes giving congruences between two such newforms is bounded by $[7k+{1}/{2}+k^{1/5} ]$. We also obtain a multiplicity one result for newforms via congruences.


title: Optimal boundary regularity for some singular Monge-Amp\`ere equations on bounded convex domains

abstract: By constructing explicit supersolutions, we obtain the optimal global H\"older regularity for several singular Monge-Amp\`ere equations on general bounded open convex domains including those related to complete affine hyperbolic spheres, and proper affine hyperspheres. Our analysis reveals that certain singular-looking equations, such as $ \det D^2 u = |u|^{-n-2-k} (x\cdot Du -u)^{-k} $ with zero boundary data, have unexpected degenerate nature.


title: Unusual spin dynamics in the low-temperature magnetically ordered state of Ag$_{3}$LiIr$_{2}$O$_{6}$

abstract: Recently, there have been contrary claims of Kitaev spin-liquid behaviour and ordered behavior in the honeycomb compound Ag$_3$LiIr$_2$O$_6$ based on various experimental signatures. Our investigations on this system reveal a low-temperature ordered state with persistent dynamics down to the lowest temperatures. Magnetic order is confirmed by clear oscillations in the muon spin relaxation ($\mu$SR) time spectrum below 9 K till 52 mK. Coincidentally in $^7$Li nuclear magnetic resonance, a wipe-out of the signal is observed below $\sim$ 10 K which again strongly indicates magnetic order in the low temperature regime. This is supported by our density functional theory calculations which show an appreciable Heisenberg exchange term in the spin Hamiltonian that favors magnetic ordering. The $^7$Li shift and spin-lattice relaxation rate also show anomalies at $\sim$ 50 K. They are likely related to the onset of dynamic magnetic correlations, but their origin is not completely clear. Detailed analysis of our $\mu$SR data is consistent with a co-existence of incommensurate N\'eel and striped environments. A significant and undiminished dynamical relaxation rate ($\sim 5$ MHz) as seen in $\mu$SR deep into the ordered phase indicates enhanced quantum fluctuations in the ordered state.


title: More Indications for Lepton Nonuniversality in $b \to s \ell^+ \ell^-$

abstract: Recently the LHCb collaboration has confirmed the evidence for lepton flavour nonuniversality at the $3.1\sigma$ level via an updated measurement of $R_K$. In this work we analyse this evidence within a model-independent approach. We make projections for future measurements which indicate that LHCb will be in the position to discover lepton nonuniversality with the Run 3 data in a single observable. We analyse other ratios based on our analysis of the present measurements of the ratios $R_{K^{(*)}}$ and analyse if they are able to differentiate between various new physics options within the effective field theory at present or in the near future. We also compare the present deviations in the ratios with NP indications in the angular observables of exclusive $b \to s \ell\ell$ transitions. Finally, we update our global analysis considering all $b \to s \ell\ell$ observables altogether, including a 20-parameter fit in connection of a Wilks' test.


title: Chiral Anomaly Trapped in Weyl Metals: Nonequilibrium Valley Polarization at Zero Magnetic Field

abstract: In Weyl semimetals the application of parallel electric and magnetic fields leads to valley polarization -- an occupation disbalance of valleys of opposite chirality -- a direct consequence of the chiral anomaly. In this work, we present numerical tools to explore such nonequilibrium effects in spatially confined three-dimensional systems with a variable disorder potential, giving exact solutions to leading order in the disorder potential and the applied electric field. Application to a Weyl-metal slab shows that valley polarization also occurs without an external magnetic field as an effect of chiral anomaly "trapping": Spatial confinement produces chiral bulk states, which enable the valley polarization in a similar way as the chiral states induced by a magnetic field. Despite its finite-size origin, the valley polarization can persist up to macroscopic length scales if the disorder potential is sufficiently long ranged, so that direct inter-valley scattering is suppressed and the relaxation then goes via the Fermi-arc surface states.


title: Jumps in the height of the Ceresa cycle

abstract: We study the jumps in the archimedean height of the Ceresa cycle, as introduced by R. Hain in his work on normal functions on moduli spaces of curves, and as further analyzed by P. Brosnan and G. Pearlstein in terms of asymptotic Hodge theory. Our work is based on a study of the asymptotic behavior of the Hain-Reed beta-invariant in degenerating families of curves. We show that the height jump of the Ceresa cycle at a given stable curve is equal to the so-called "slope" of the dual graph of the curve, and we characterize those stable curves for which the height jump vanishes. We also obtain an analytic formula for the height of the Ceresa cycle for a curve over a function field over the complex numbers, and characterize in analytic terms when the height of the Ceresa cycle vanishes.


title: Asymmetric compressive learning guarantees with applications to quantized sketches

abstract: The compressive learning framework reduces the computational cost of training on large-scale datasets. In a sketching phase, the data is first compressed to a lightweight sketch vector, obtained by mapping the data samples through a well-chosen feature map, and averaging those contributions. In a learning phase, the desired model parameters are then extracted from this sketch by solving an optimization problem, which also involves a feature map. When the feature map is identical during the sketching and learning phases, formal statistical guarantees (excess risk bounds) have been proven. However, the desirable properties of the feature map are different during sketching and learning (e.g. quantized outputs, and differentiability, respectively). We thus study the relaxation where this map is allowed to be different for each phase. First, we prove that the existing guarantees carry over to this asymmetric scheme, up to a controlled error term, provided some Limited Projected Distortion (LPD) property holds. We then instantiate this framework to the setting of quantized sketches, by proving that the LPD indeed holds for binary sketch contributions. Finally, we further validate the approach with numerical simulations, including a large-scale application in audio event classification.


title: Pseudo-Boolean Functions for Optimal Z-Complementary Code Sets with Flexible Lengths

abstract: This paper aims to construct optimal Z-complementary code set (ZCCS) with non-power-of-two (NPT) lengths to enable interference-free multicarrier code-division multiple access (MC-CDMA) systems. The existing ZCCSs with NPT lengths, which are constructed from generalized Boolean functions (GBFs), are sub-optimal only with respect to the set size upper bound. For the first time in the literature, we advocate the use of pseudo-Boolean functions (PBFs) (each of which transforms a number of binary variables to a real number as a natural generalization of GBF) for direct constructions of optimal ZCCSs with NPT lengths.


title: Kalman-based interacting multiple-model wind speed estimator for wind turbines

abstract: The use of state estimation technique offers a means of inferring the rotor-effective wind speed based upon solely standard measurements of the turbine. For the ease of design and computational concerns, such estimators are typically built based upon simplified turbine models that characterise the turbine with rigid blades. Large model mismatch, particularly in the power coefficient, could lead to degradation in estimation performance. Therefore, in order to effectively reduce the adverse impact of parameter uncertainties in the estimator model, this paper develops a wind sped estimator based on the concept of interacting multiple-model adaptive estimation. The proposed estimator is composed of a bank of extended Kalman filters and each filter model is developed based on different power coefficient mapping to match the operating turbine parameter. Subsequently, the algorithm combines the wind speed estimates provided by each filter based on their statistical properties. In addition, the proposed estimator not only can infer the rotor-effective wind speed, but also the uncertain system parameters, namely, the power coefficient. Simulation results demonstrate the proposed estimator achieved better improvement in estimating the rotor-effective wind speed and power coefficient compared to the standard Kalman filter approach.


title: Style-Aware Normalized Loss for Improving Arbitrary Style Transfer

abstract: Neural Style Transfer (NST) has quickly evolved from single-style to infinite-style models, also known as Arbitrary Style Transfer (AST). Although appealing results have been widely reported in literature, our empirical studies on four well-known AST approaches (GoogleMagenta, AdaIN, LinearTransfer, and SANet) show that more than 50% of the time, AST stylized images are not acceptable to human users, typically due to under- or over-stylization. We systematically study the cause of this imbalanced style transferability (IST) and propose a simple yet effective solution to mitigate this issue. Our studies show that the IST issue is related to the conventional AST style loss, and reveal that the root cause is the equal weightage of training samples irrespective of the properties of their corresponding style images, which biases the model towards certain styles. Through investigation of the theoretical bounds of the AST style loss, we propose a new loss that largely overcomes IST. Theoretical analysis and experimental results validate the effectiveness of our loss, with over 80% relative improvement in style deception rate and 98% relatively higher preference in human evaluation.


title: Learning-based Compression for Material and Texture Recognition

abstract: Learning-based image compression was shown to achieve a competitive performance with state-of-the-art transform-based codecs. This motivated the development of new learning-based visual compression standards such as JPEG-AI. Of particular interest to these emerging standards is the development of learning-based image compression systems targeting both humans and machines. This paper is concerned with learning-based compression schemes whose compressed-domain representations can be utilized to perform visual processing and computer vision tasks directly in the compressed domain. Such a characteristic has been incorporated as part of the scope and requirements of the new emerging JPEG-AI standard. In our work, we adopt the learning-based JPEG-AI framework for performing material and texture recognition using the compressed-domain latent representation at varing bit-rates. For comparison, performance results are presented using compressed but fully decoded images in the pixel domain as well as original uncompressed images. The obtained performance results show that even though decoded images can degrade the classification performance of the model trained with original images, retraining the model with decoded images will largely reduce the performance gap for the adopted texture dataset. It is also shown that the compressed-domain classification can yield a competitive performance in terms of Top-1 and Top-5 accuracy while using a smaller reduced-complexity classification model.


title: EarthNet2021: A large-scale dataset and challenge for Earth surface forecasting as a guided video prediction task

abstract: Satellite images are snapshots of the Earth surface. We propose to forecast them. We frame Earth surface forecasting as the task of predicting satellite imagery conditioned on future weather. EarthNet2021 is a large dataset suitable for training deep neural networks on the task. It contains Sentinel 2 satellite imagery at 20m resolution, matching topography and mesoscale (1.28km) meteorological variables packaged into 32000 samples. Additionally we frame EarthNet2021 as a challenge allowing for model intercomparison. Resulting forecasts will greatly improve (>x50) over the spatial resolution found in numerical models. This allows localized impacts from extreme weather to be predicted, thus supporting downstream applications such as crop yield prediction, forest health assessments or biodiversity monitoring. Find data, code, and how to participate at www.earthnet.tech


title: Spherical Multi-Modal Place Recognition for Heterogeneous Sensor Systems

abstract: In this paper, we propose a robust end-to-end multi-modal pipeline for place recognition where the sensor systems can differ from the map building to the query. Our approach operates directly on images and LiDAR scans without requiring any local feature extraction modules. By projecting the sensor data onto the unit sphere, we learn a multi-modal descriptor of partially overlapping scenes using a spherical convolutional neural network. The employed spherical projection model enables the support of arbitrary LiDAR and camera systems readily without losing information. Loop closure candidates are found using a nearest-neighbor lookup in the embedding space. We tackle the problem of correctly identifying the closest place by correlating the candidates' power spectra, obtaining a confidence value per prospect. Our estimate for the correct place corresponds then to the candidate with the highest confidence. We evaluate our proposal w.r.t. state-of-the-art approaches in place recognition using real-world data acquired using different sensors. Our approach can achieve a recall that is up to 10% and 5% higher than for a LiDAR- and vision-based system, respectively, when the sensor setup differs between model training and deployment. Additionally, our place selection can correctly identify up to 95% matches from the candidate set.


title: Contrastive Learning for Sports Video: Unsupervised Player Classification

abstract: We address the problem of unsupervised classification of players in a team sport according to their team affiliation, when jersey colours and design are not known a priori. We adopt a contrastive learning approach in which an embedding network learns to maximize the distance between representations of players on different teams relative to players on the same team, in a purely unsupervised fashion, without any labelled data. We evaluate the approach using a new hockey dataset and find that it outperforms prior unsupervised approaches by a substantial margin, particularly for real-time application when only a small number of frames are available for unsupervised learning before team assignments must be made. Remarkably, we show that our contrastive method achieves 94% accuracy after unsupervised training on only a single frame, with accuracy rising to 97% within 500 frames (17 seconds of game time). We further demonstrate how accurate team classification allows accurate team-conditional heat maps of player positioning to be computed.


title: Genuine multipartite nonlocality with causal-diagram postselection

abstract: The generation and verification of genuine multipartite nonlocality (GMN) is of central interest for both fundamental research and quantum technological applications, such as quantum privacy. To demonstrate GMN in measurement data, the statistics are commonly postselected by neglecting undesired data. Until now, valid postselection strategies have been restricted to local postselection. A general postselection that is decided after communication between parties can mimic nonlocality, even though the complete data are local. Here, we establish conditions under which GMN is demonstrable even if observations are postselected collectively. Intriguingly, certain postselection strategies that require communication among several parties still offer a demonstration of GMN shared between all parties. The results are derived using the causal structure of the experiment and the no-signalling condition imposed by relativity. Finally, we apply our results to show that genuine three-partite nonlocality can be created with independent particle sources.


title: Cross-population coupling of neural activity based on Gaussian process current source densities

abstract: Because local field potentials (LFPs) arise from multiple sources in different spatial locations, they do not easily reveal coordinated activity across neural populations on a trial-to-trial basis. As we show here, however, once disparate source signals are decoupled, their trial-to-trial fluctuations become more accessible, and cross-population correlations become more apparent. To decouple sources we introduce a general framework for estimation of current source densities (CSDs). In this framework, the set of LFPs result from noise being added to the transform of the CSD by a biophysical forward model, while the CSD is considered to be the sum of a zero-mean, stationary, spatiotemporal Gaussian process, having fast and slow components, and a mean function, which is the sum of multiple time-varying functions distributed across space, each varying across trials. We derived biophysical forward models relevant to the data we analyzed. In simulation studies this approach improved identification of source signals compared to existing CSD estimation methods. Using data recorded from primate auditory cortex, we analyzed trial-to-trial fluctuations in both steady-state and task-evoked signals. We found cortical layer-specific phase coupling between two probes and showed that the same analysis applied directly to LFPs did not recover these patterns. We also found task-evoked CSDs to be correlated across probes, at specific cortical depths. Using data from Neuropixels probes in mouse visual areas, we again found evidence for depth-specific phase coupling of primary visual area and lateromedial area based on the CSDs.


title: Fourth-neighbour two-point functions of the XXZ chain and the Fermionic basis approach

abstract: We give a descriptive review of the Fermionic basis approach to the theory of correlation functions of the XXZ quantum spin chain. The emphasis is on explicit formulae for short-range correlation functions which will be presented in a way that allows for their direct implementation on a computer. Within the Fermionic basis approach a huge class of stationary reduced density matrices, compatible with the integrable structure of the model, assumes a factorized form. This means that all expectation values of local operators and all two-point functions, in particular, can be represented as multivariate polynomials in only two functions $\rho$ and $\omega$ and their derivatives with coefficients that are rational in the deformation parameter $q$ of the model. These coefficients are of `algebraic origin'. They do not depend on the choice of the density matrix, which only impacts the form of $\rho$ and $\omega$. As an example we work out in detail the case of the grand canonical ensemble at temperature $T$ and magnetic field $h$ for $q$ in the critical regime. We compare our exact results for the fourth-neighbour two-point functions with asymptotic formulae for $h, T = 0$ and for finite $h$ and $T$.

categories: cond-mat.stat-mech hep-th math-ph math.MP


title: Conditions for strict dissipativity of infinite-dimensional generalized linear-quadratic problems

abstract: We derive sufficient conditions for strict dissipativity for optimal control of linear evolution equations on Hilbert spaces with a cost functional including linear and quadratic terms. We show that strict dissipativity with a particular storage function is equivalent to ellipticity of a Lyapunov-like operator. Further we prove under a spectral decomposition assumption of the underlying generator and an orthogonality condition of the resulting subspaces that this ellipticity property holds under a detectability assumption. We illustrate our result by means of an example involving a heat equation on a one-dimensional domain.


title: ZMCintegral-v5.1: Support for Multi-function Integrations on GPUs

abstract: In this new version of ZMCintegral, we have added the functionality of multi-function integrations, i.e. the ability to integrate more than $10^{3}$ different functions on GPUs. The Python API remains the similar as the previous versions. For integrands less than 5 dimensions, it usually takes less than 10 minutes to finish the evaluation of $10^{3}$ integrations on one Tesla v100 card. The performance scales linearly with the increasing of the GPUs.


title: Fibonacci identities and Fibonacci pairs

abstract: A Fibonacci pair $F_s(w,x)$ of rank $s$ is a pair $s \times s$ nonsingular matrices such that $wx=xw$ and that the entries of $aw^n$ and $axw^m$ are polynomials of Fibonacci or Lucas numbers for some nonzero $a$. We construct identities systematically by the study of $F_2(w, x)$ and $F_3(w, x)$.


title: A new anomaly observed in $^4$He supports the existence of the hypothetical X17 particle

abstract: Energy-sum and angular correlation spectra of $e^+e^-$ pairs produced in the $^{3}$H(p,$\gamma$)$^{4}$He nuclear reaction have been studied at $E_p$=510, 610 and 900 keV proton energies. The main features of the spectra can be understood by taking into account the internal and external pair creations following the direct proton radiative capture by $^{3}$H. However, these processes cannot account for the observed peak around 115$^\circ$ in the angular correlation spectra. This anomalous excess of $e^+e^-$ pairs can be described by the creation and subsequent decay of a light particle during the direct capture process. The derived mass of the particle is $m_\mathrm{X}c^2$=16.94$\pm0.12 (stat) \pm 0.21 (syst)$~MeV. According to the mass and branching ratio ($B_x=5.1(13)\times10^{-6}$), this is likely the same X17 particle, which we recently suggested [Phys. Rev. Lett. 116, 052501 (2016)] for describing the anomaly observed in the decay of $^8$Be.


title: MixDefense: A Defense-in-Depth Framework for Adversarial Example Detection Based on Statistical and Semantic Analysis

abstract: Machine learning with deep neural networks (DNNs) has become one of the foundation techniques in many safety-critical systems, such as autonomous vehicles and medical diagnosis systems. DNN-based systems, however, are known to be vulnerable to adversarial examples (AEs) that are maliciously perturbed variants of legitimate inputs. While there has been a vast body of research to defend against AE attacks in the literature, the performances of existing defense techniques are still far from satisfactory, especially for adaptive attacks, wherein attackers are knowledgeable about the defense mechanisms and craft AEs accordingly. In this work, we propose a multilayer defense-in-depth framework for AE detection, namely MixDefense. For the first layer, we focus on those AEs with large perturbations. We propose to leverage the `noise' features extracted from the inputs to discover the statistical difference between natural images and tampered ones for AE detection. For AEs with small perturbations, the inference result of such inputs would largely deviate from their semantic information. Consequently, we propose a novel learning-based solution to model such contradictions for AE detection. Both layers are resilient to adaptive attacks because there do not exist gradient propagation paths for AE generation. Experimental results with various AE attack methods on image classification datasets show that the proposed MixDefense solution outperforms the existing AE detection techniques by a considerable margin.


title: Resolved Neutral Outflow from a Lensed Dusty Star Forming Galaxy at z=2.09

abstract: We report the detection of a massive neutral gas outflow in the z=2.09 gravitationally lensed Dusty Star-Forming Galaxy HATLASJ085358.9+015537 (G09v1.40), seen in absorption with the OH+(1_1-1_0) transition using spatially resolved (0.5"x0.4") Atacama Large Millimeter/submillimeter Array (ALMA) observations. The blueshifted OH+ line is observed simultaneously with the CO(9-8) emission line and underlying dust continuum. These data are complemented by high angular resolution (0.17"x0.13") ALMA observations of CH+(1-0) and underlying dust continuum, and Keck 2.2 micron imaging tracing the stellar emission. The neutral outflow, dust, dense molecular gas and stars all show spatial offsets from each other. The total atomic gas mass of the observed outflow is 6.7x10^9 M_sun, >25% as massive as the gas mass of the galaxy. We find that a conical outflow geometry best describes the OH+ kinematics and morphology and derive deprojected outflow properties as functions of possible inclination (0.38 deg-64 deg). The neutral gas mass outflow rate is between 83-25400 M_sun/yr, exceeding the star formation rate (788+/-300 M_sun/yr) if the inclination is >3.6 deg (mass-loading factor = 0.3-4.7). Kinetic energy and momentum fluxes span 4.4-290x10^9 L_sun and 0.1-3.7x10^37 dyne, respectively (energy-loading factor = 0.013-16), indicating that the feedback mechanisms required to drive the outflow depend on the inclination assumed. We derive a gas depletion time between 29 and 1 Myr, but find that the neutral outflow is likely to remain bound to the galaxy, unless the inclination is small, and may be re-accreted if additional feedback processes do not occur.


title: UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction

abstract: Neural implicit 3D representations have emerged as a powerful paradigm for reconstructing surfaces from multi-view images and synthesizing novel views. Unfortunately, existing methods such as DVR or IDR require accurate per-pixel object masks as supervision. At the same time, neural radiance fields have revolutionized novel view synthesis. However, NeRF's estimated volume density does not admit accurate surface reconstruction. Our key insight is that implicit surface models and radiance fields can be formulated in a unified way, enabling both surface and volume rendering using the same model. This unified perspective enables novel, more efficient sampling procedures and the ability to reconstruct accurate surfaces without input masks. We compare our method on the DTU, BlendedMVS, and a synthetic indoor dataset. Our experiments demonstrate that we outperform NeRF in terms of reconstruction quality while performing on par with IDR without requiring masks.


title: Development of an accessible 10-year Digital CArdioVAscular (DiCAVA) risk assessment: a UK Biobank study

abstract: Background: Cardiovascular diseases (CVDs) are among the leading causes of death worldwide. Predictive scores providing personalised risk of developing CVD are increasingly used in clinical practice. Most scores, however, utilise a homogenous set of features and require the presence of a physician. Objective: The aim was to develop a new risk model (DiCAVA) using statistical and machine learning techniques that could be applied in a remote setting. A secondary goal was to identify new patient-centric variables that could be incorporated into CVD risk assessments. Methods: Across 466,052 participants, Cox proportional hazards (CPH) and DeepSurv models were trained using 608 variables derived from the UK Biobank to investigate the 10-year risk of developing a CVD. Data-driven feature selection reduced the number of features to 47, after which reduced models were trained. Both models were compared to the Framingham score. Results: The reduced CPH model achieved a c-index of 0.7443, whereas DeepSurv achieved a c-index of 0.7446. Both CPH and DeepSurv were superior in determining the CVD risk compared to Framingham score. Minimal difference was observed when cholesterol and blood pressure were excluded from the models (CPH: 0.741, DeepSurv: 0.739). The models show very good calibration and discrimination on the test data. Conclusion: We developed a cardiovascular risk model that has very good predictive capacity and encompasses new variables. The score could be incorporated into clinical practice and utilised in a remote setting, without the need of including cholesterol. Future studies will focus on external validation across heterogeneous samples.


title: Independence equivalence classes of cycles

abstract: The independence equivalence class of a graph $G$ is the set of graphs that have the same independence polynomial as $G$. Beaton, Brown and Cameron (arXiv:1810.05317) found the independence equivalence classes of even cycles, and raised the problem of finding the independence equivalence class of odd cycles. The problem is completely solved in this paper.


title: Exploring Evolved Multicellular Life Histories in a Open-Ended Digital Evolution System

abstract: Evolutionary transitions occur when previously-independent replicating entities unite to form more complex individuals. Such transitions have profoundly shaped natural evolutionary history and occur in two forms: fraternal transitions involve lower-level entities that are kin (e.g., transitions to multicellularity or to eusocial colonies), while egalitarian transitions involve unrelated individuals (e.g., the origins of mitochondria). The necessary conditions and evolutionary mechanisms for these transitions to arise continue to be fruitful targets of scientific interest. Here, we examine a range of fraternal transitions in populations of open-ended self-replicating computer programs. These digital cells were allowed to form and replicate kin groups by selectively adjoining or expelling daughter cells. The capability to recognize kin-group membership enabled preferential communication and cooperation between cells. We repeatedly observed group-level traits that are characteristic of a fraternal transition. These included reproductive division of labor, resource sharing within kin groups, resource investment in offspring groups, asymmetrical behaviors mediated by messaging, morphological patterning, and adaptive apoptosis. We report eight case studies from replicates where transitions occurred and explore the diverse range of adaptive evolved multicellular strategies.


title: Modeling biological networks: from single gene systems to large microbial communities

abstract: In this research, we study biological networks at different scales: a gene autoregulatory network at the single-cell level and the gut microbiota at the population level. Proteins are the main actors in cells, they are the building blocks, act as enzymes and antibodies. The production of proteins is mediated by transcription factors. In some cases, a protein acts as its own transcription factor, this is called autoregulation. It is known that autorepression speeds up the response and that autoactivation can lead to multiple stable equilibria. In this thesis, we study the effects of the combination of activation and repression in autoregulation, as a case study we investigate the possible dynamics of the leucine responsive protein B of the archaeon Sulfolobus solfataricus (Ss-LrpB), a protein that regulates itself in a unique and non-monotonic way via three binding boxes. We examine for which conditions this type of network leads to oscillations or bistability. In the second part, much larger biological systems are considered. Ecological systems, among which the human gut microbiome, are characterized by heavy-tailed abundance profiles. We study how these distributions can arise from population-based models by adding saturation effects and linear noise. Moreover, we examine different characteristics of experimental time series of microbial communities, such as the noise color and neutrality of the biodiversity, and look at the influence of the parameters on these characteristics. With the first research topic we want to lay a foundation for the understanding of non-monotonic gene regulation and take the first steps toward synthetic biology in archaea. In the second part of the thesis, we investigate experimental time series from complex ecosystems and seek theoretical models reproducing all observed characteristics in view of building predictive models.


title: Personalized News Recommendation with Knowledge-aware Interactive Matching

abstract: The most important task in personalized news recommendation is accurate matching between candidate news and user interest. Most of existing news recommendation methods model candidate news from its textual content and user interest from their clicked news in an independent way. However, a news article may cover multiple aspects and entities, and a user usually has different kinds of interest. Independent modeling of candidate news and user interest may lead to inferior matching between news and users. In this paper, we propose a knowledge-aware interactive matching method for news recommendation. Our method interactively models candidate news and user interest to facilitate their accurate matching. We design a knowledge-aware news co-encoder to interactively learn representations for both clicked news and candidate news by capturing their relatedness in both semantic and entities with the help of knowledge graphs. We also design a user-news co-encoder to learn candidate news-aware user interest representation and user-aware candidate news representation for better interest matching. Experiments on two real-world datasets validate that our method can effectively improve the performance of news recommendation.


title: Bijective enumeration of planar bipartite maps with three tight boundaries, or how to slice pairs of pants

abstract: We consider planar maps with three boundaries, colloquially called pairs of pants. In the case of bipartite maps with controlled face degrees, a simple expression for their generating function was found by Eynard and proved bijectively by Collet and Fusy. In this paper, we obtain an even simpler formula for \emph{tight} pairs of pants, namely for maps whose boundaries have minimal length in their homotopy class. We follow a bijective approach based on the slice decomposition, which we extend by introducing new fundamental building blocks called bigeodesic triangles and diangles, and by working on the universal cover of the triply punctured sphere. We also discuss the statistics of the lengths of minimal separating loops in (non necessarily tight) pairs of pants and annuli, and their asymptotics in the large volume limit.


title: Predicting Medical Interventions from Vital Parameters: Towards a Decision Support System for Remote Patient Monitoring

abstract: Cardiovascular diseases and heart failures in particular are the main cause of non-communicable disease mortality in the world. Constant patient monitoring enables better medical treatment as it allows practitioners to react on time and provide the appropriate treatment. Telemedicine can provide constant remote monitoring so patients can stay in their homes, only requiring medical sensing equipment and network connections. A limiting factor for telemedical centers is the amount of patients that can be monitored simultaneously. We aim to increase this amount by implementing a decision support system. This paper investigates a machine learning model to estimate a risk score based on patient vital parameters that allows sorting all cases every day to help practitioners focus their limited capacities on the most severe cases. The model we propose reaches an AUCROC of 0.84, whereas the baseline rule-based model reaches an AUCROC of 0.73. Our results indicate that the usage of deep learning to improve the efficiency of telemedical centers is feasible. This way more patients could benefit from better health-care through remote monitoring.


title: Precision Millimeter Astrometry of the $\alpha$ Centauri AB System

abstract: $\alpha$ Centauri A is the closest solar-type star to the Sun and offers the best opportunity to find and ultimately to characterize an Earth-sized planet located in its Habitable Zone (HZ). Here we describe initial results from an ALMA program to search for planets in the $\alpha$ Cen AB system using differential astrometry at millimeter wavelengths. Our initial results include new absolute astrometric measurements of the proper motion, orbital motion, and parallax of the $\alpha$ Cen system. These lead to an improved knowledge of the physical properties of both $\alpha$ Cen A and B. Our estimates of ALMA's relative astrometric precision suggest that we will ultimately be sensitive to planets of a few 10s of Earth mass in orbits from 1-3 AU, where stable orbits are thought to exist.


title: Development of digitally obtainable 10-year risk scores for depression and anxiety in the general population

abstract: The burden of depression and anxiety in the world is rising. Identification of individuals at increased risk of developing these conditions would help to target them for prevention and ultimately reduce the healthcare burden. We developed a 10-year predictive algorithm for depression and anxiety using the full cohort of over 400,000 UK Biobank (UKB) participants without pre-existing depression or anxiety using digitally obtainable information. From the initial 204 variables selected from UKB, processed into > 520 features, iterative backward elimination using Cox proportional hazards model was performed to select predictors which account for the majority of its predictive capability. Baseline and reduced models were then trained for depression and anxiety using both Cox and DeepSurv, a deep neural network approach to survival analysis. The baseline Cox model achieved concordance of 0.813 and 0.778 on the validation dataset for depression and anxiety, respectively. For the DeepSurv model, respective concordance indices were 0.805 and 0.774. After feature selection, the depression model contained 43 predictors and the concordance index was 0.801 for both Cox and DeepSurv. The reduced anxiety model, with 27 predictors, achieved concordance of 0.770 in both models. The final models showed good discrimination and calibration in the test datasets.We developed predictive risk scores with high discrimination for depression and anxiety using the UKB cohort, incorporating predictors which are easily obtainable via smartphone. If deployed in a digital solution, it would allow individuals to track their risk, as well as provide some pointers to how to decrease it through lifestyle changes.


title: Astronomy Data, Virtual Observatory and Education

abstract: We shall present with examples how analysis of astronomy data can be used for an educational purpose to train students in methods of data analysis, statistics, programming skills and research problems. Special reference will be made to our IAU-OAD project `Astronomy from Archival Data' where we are in the process of building a repository of instructional videos and reading material for undergraduate and postgraduate students. Virtual Observatory tools will also be discussed and applied. As this is an ongoing project, by the time of the conference we will have the projects and work done by students included in our presentation. The material produced can be freely used by the community.


title: Quantum gas magnifier for sub-lattice-resolved imaging of three-dimensional quantum systems

abstract: Imaging is central for gaining microscopic insight into physical systems, but direct imaging of ultracold atoms in optical lattices as modern quantum simulation platform suffers from the diffraction limit as well as high optical density and small depth of focus. We introduce a novel approach to imaging of quantum many-body systems using matter wave optics to magnify the density distribution prior to optical imaging, allowing sub-lattice spacing resolution in three-dimensional systems. Combining the site-resolved imaging with magnetic resonance techniques for local addressing of individual lattice sites, we demonstrate full accessibility to local information and local manipulation in three-dimensional optical lattice systems. The method opens the path for spatially resolved studies of new quantum many-body regimes including exotic lattice geometries.


title: Ab initio ligand field approach to determine electronic multiplet properties

abstract: A method is developed to calculate the ligand field (LF) parameters and the multiplet spectra of local magnetic centers with open $d$- and $f$-shells in solids in a parameter-free way. This method proceeds from density functional theory and employs Wannier projections of nonmagnetic band structures onto local $d$- or $f$-orbitals. Energies of multiplets and optical, as well as X-ray spectra are determined by exact numerical diagonalization of a local Hamiltonian describing Coulomb, LF, and spin-orbit interactions. The method is tested for several 3$d$- and 5$f$-compounds for which the LF parameters and multiplet spectra are experimentally well known. In this way, we obtain good agreement with experiment for La$_2$NiO$_4$, CaCuO$_2$, Li$_2$CuO$_2$, ZnO:Co, and UO$_2$.


title: Generalized quantum-classical correspondence for random walks on graphs

abstract: We introduce a minimal set of physically motivated postulates that the Hamiltonian H of a continuous-time quantum walk should satisfy in order to properly represent the quantum counterpart of the classical random walk on a given graph. We found that these conditions are satisfied by infinitely many quantum Hamiltonians, which provide novel degrees of freedom for quantum enhanced protocols, In particular, the on-site energies, i.e. the diagonal elements of H, and the phases of the off-diagonal elements are unconstrained on the quantum side. The diagonal elements represent a potential energy landscape for the quantum walk, and may be controlled by the interaction with a classical scalar field, whereas, for regular lattices in generic dimension, the off-diagonal phases of H may be tuned by the interaction with a classical gauge field residing on the edges, e.g., the electro-magnetic vector potential for a charged walker.


title: A decoupling and linearizing discretization for weakly coupled poroelasticity with nonlinear permeability

abstract: We analyze a semi-explicit time discretization scheme of first order for poro\-elasticity with nonlinear permeability provided that the elasticity model and the flow equation are only weakly coupled. The approach leads to a decoupling of the equations and, at the same time, linearizes the nonlinearity without the need of further inner iteration steps. Hence, the computational speed-up is twofold without a loss in the convergence rate. We prove optimal first-order error estimates by considering a related delay system and investigate the method numerically for different examples with various types of nonlinear displacement-permeability relations.


title: Class-Incremental Learning with Generative Classifiers

abstract: Incrementally training deep neural networks to recognize new classes is a challenging problem. Most existing class-incremental learning methods store data or use generative replay, both of which have drawbacks, while 'rehearsal-free' alternatives such as parameter regularization or bias-correction methods do not consistently achieve high performance. Here, we put forward a new strategy for class-incremental learning: generative classification. Rather than directly learning the conditional distribution p(y|x), our proposal is to learn the joint distribution p(x,y), factorized as p(x|y)p(y), and to perform classification using Bayes' rule. As a proof-of-principle, here we implement this strategy by training a variational autoencoder for each class to be learned and by using importance sampling to estimate the likelihoods p(x|y). This simple approach performs very well on a diverse set of continual learning benchmarks, outperforming generative replay and other existing baselines that do not store data.


title: Code conformal field theory and framed algebra

abstract: It is known that there are 48 Virasoro algebras acting on the monster conformal field theory. We call conformal field theories with such a property, which are not necessarily chiral, code conformal field theories. In this paper, we introduce a notion of a framed algebra, which is a finite-dimensional non-associative algebra, and showed that the category of framed algebras and the category of code conformal field theories are equivalent. We have also constructed a new family of integrable conformal field theories using this equivalence. These conformal field theories are expected to be useful for the study of moduli spaces of conformal field theories.


title: Turning Channel Noise into an Accelerator for Over-the-Air Principal Component Analysis

abstract: Recently years, the attempts on distilling mobile data into useful knowledge has been led to the deployment of machine learning algorithms at the network edge. Principal component analysis (PCA) is a classic technique for extracting the linear structure of a dataset, which is useful for feature extraction and data compression. In this work, we propose the deployment of distributed PCA over a multi-access channel based on the algorithm of stochastic gradient descent to learn the dominant feature space of a distributed dataset at multiple devices. Over-the-air aggregation is adopted to reduce the multi-access latency, giving the name over-the-air PCA. The novelty of this design lies in exploiting channel noise to accelerate the descent in the region around each saddle point encountered by gradient descent, thereby increasing the convergence speed of over-the-air PCA. The idea is materialized by proposing a power-control scheme which detects the type of descent region and controlling the level of channel noise accordingly. The scheme is proved to achieve a faster convergence rate than in the case without power control.


title: Mock hyperbolic reflection spaces and Frobenius groups of finite Morley rank

abstract: We define the notion of mock hyperbolic reflection spaces and use it to study Frobenius groups, in particular in the context of groups of finite Morley rank including the so-called bad groups. We show that connected Frobenius groups of finite Morley rank and odd type with nilpotent complement split or interpret a bad field of characteristic zero. Furthermore, we show that mock hyperbolic reflection spaces of finite Morley rank satisfy certain rank inequalities, implying in particular that any connected Frobenius group of odd type and Morley rank at most ten either splits or is a simple non-split sharply 2-transitive group of characteristic different from 2 and of Morley rank 8 or 10.


title: Beyond Fair Pay: Ethical Implications of NLP Crowdsourcing

abstract: The use of crowdworkers in NLP research is growing rapidly, in tandem with the exponential increase in research production in machine learning and AI. Ethical discussion regarding the use of crowdworkers within the NLP research community is typically confined in scope to issues related to labor conditions such as fair pay. We draw attention to the lack of ethical considerations related to the various tasks performed by workers, including labeling, evaluation, and production. We find that the Final Rule, the common ethical framework used by researchers, did not anticipate the use of online crowdsourcing platforms for data collection, resulting in gaps between the spirit and practice of human-subjects ethics in NLP research. We enumerate common scenarios where crowdworkers performing NLP tasks are at risk of harm. We thus recommend that researchers evaluate these risks by considering the three ethical principles set up by the Belmont Report. We also clarify some common misconceptions regarding the Institutional Review Board (IRB) application. We hope this paper will serve to reopen the discussion within our community regarding the ethical use of crowdworkers.


title: Production of Exotic Hadrons in $p\overline{p}$ Collisions at 1.96 TeV at D0

abstract: D0 presents results on the hadronic production of $X(3872)$, $\psi(2S)$, $Z_c^\pm(3900)$, and the inclusive production of pentaquarks $P_c \rightarrow J/\psi p$.


title: Partial Correlation Graphical LASSO

abstract: Standard likelihood penalties to learn Gaussian graphical models are based on regularising the off-diagonal entries of the precision matrix. Such methods, and their Bayesian counterparts, are not invariant to scalar multiplication of the variables, unless one standardises the observed data to unit sample variances. We show that such standardisation can have a strong effect on inference and introduce a new family of penalties based on partial correlations. We show that the latter, as well as the maximum likelihood, $L_0$ and logarithmic penalties are scale invariant. We illustrate the use of one such penalty, the partial correlation graphical LASSO, which sets an $L_{1}$ penalty on partial correlations. The associated optimization problem is no longer convex, but is conditionally convex. We show via simulated examples and in two real datasets that, besides being scale invariant, there can be important gains in terms of inference.


title: UIT-ISE-NLP at SemEval-2021 Task 5: Toxic Spans Detection with BiLSTM-CRF and ToxicBERT Comment Classification

abstract: We present our works on SemEval-2021 Task 5 about Toxic Spans Detection. This task aims to build a model for identifying toxic words in whole posts. We use the BiLSTM-CRF model combining with ToxicBERT Classification to train the detection model for identifying toxic words in posts. Our model achieves 62.23% by F1-score on the Toxic Spans Detection task.


title: Classification of Levi-spherical Schubert varieties

abstract: A Schubert variety in the complete flag manifold $GL_n/B$ is Levi-spherical if the action of a Borel subgroup in a Levi subgroup of a standard parabolic has a dense orbit. We give a combinatorial classification of these Schubert varieties. This establishes a conjecture of the latter two authors, and a new formulation in terms of standard Coxeter elements. Our proof uses the theory of key polynomials (type A Demazure module characters).


title: Polymer Physics by Quantum Computing

abstract: Sampling equilibrium ensembles of dense polymer mixtures is a paradigmatically hard problem in computational physics, even in lattice-based models. Here, we develop a formalism based on interacting binary tensors that allows for tackling this problem using quantum annealing machines. Our approach is general in that properties such as self-avoidance, branching, and looping can all be specified in terms of quadratic interactions of the tensors. Microstates realizations of different lattice polymer ensembles are then seamlessly generated by solving suitable discrete energy-minimization problems. This approach enables us to capitalize on the strengths of quantum annealing machines, as we demonstrate by sampling polymer mixtures from low to high densities, using the D-Wave quantum computer. Our systematic approach offers a promising avenue to harness the rapid development of quantum computers for sampling discrete models of filamentous soft-matter systems.


title: Space Partitioning and Regression Mode Seeking via a Mean-Shift-Inspired Algorithm

abstract: The mean shift (MS) algorithm is a nonparametric method used to cluster sample points and find the local modes of kernel density estimates, using an idea based on iterative gradient ascent. In this paper we develop a mean-shift-inspired algorithm to estimate the modes of regression functions and partition the sample points in the input space. We prove convergence of the sequences generated by the algorithm and derive the non-asymptotic rates of convergence of the estimated local modes for the underlying regression model. We also demonstrate the utility of the algorithm for data-enabled discovery through an application on biomolecular structure data. An extension to subspace constrained mean shift (SCMS) algorithm used to extract ridges of regression functions is briefly discussed.


title: On the smoothness of weak solutions to subcritical semilinear elliptic equations in any dimension

abstract: Let us consider a semilinear boundary value problem $ - \Delta u= f(x,u),$ in $\Omega,$ with Dirichlet boundary conditions, where $ \Omega \subset \mathbb{R}^N $, $N> 2,$ is a bounded smooth domain. We provide sufficient conditions guarantying that semi-stable weak positive solutions to subcritical semilinear elliptic equations are smooth in any dimension, and as a consequence, classical solutions. By a subcritical nonlinearity we mean $f(x,s)/s^\frac{N+2}{N-2} \to 0$ as $s\to\infty$, including non-power nonlinearities, and enlarging the class of subcritical nonlinearities, which is usually reserved for power like nonlinearities.


title: Neural Networks for Learning Counterfactual G-Invariances from Single Environments

abstract: Despite -- or maybe because of -- their astonishing capacity to fit data, neural networks are believed to have difficulties extrapolating beyond training data distribution. This work shows that, for extrapolations based on finite transformation groups, a model's inability to extrapolate is unrelated to its capacity. Rather, the shortcoming is inherited from a learning hypothesis: Examples not explicitly observed with infinitely many training examples have underspecified outcomes in the learner's model. In order to endow neural networks with the ability to extrapolate over group transformations, we introduce a learning framework counterfactually-guided by the learning hypothesis that any group invariance to (known) transformation groups is mandatory even without evidence, unless the learner deems it inconsistent with the training data. Unlike existing invariance-driven methods for (counterfactual) extrapolations, this framework allows extrapolations from a single environment. Finally, we introduce sequence and image extrapolation tasks that validate our framework and showcase the shortcomings of traditional approaches.


title: ds-array: A Distributed Data Structure for Large Scale Machine Learning

abstract: Machine learning has proved to be a useful tool for extracting knowledge from scientific data in numerous research fields, including astrophysics, genomics, and molecular dynamics. Often, data sets from these research areas need to be processed in distributed platforms due to their magnitude. This can be done using one of the various distributed machine learning libraries available. One of these libraries is dislib, a distributed machine learning library for Python especially designed to process large scale data sets on HPC clusters, which makes dislib an ideal candidate for analyzing scientific data. However, dislib's main distributed data structure, called Dataset, has some limitations, including poor performance in certain operations and low flexibility and usability. In this paper, we propose a novel distributed data structure for dislib, called ds-array, that addresses dislib's main limitations in data management. Ds-arrays simplify distributed data management in dislib by exposing a NumPy-like API, provide more flexibility, and reduce the computational complexity of some operations. This results in performance improvements of up to two orders of magnitude over Datasets, while also greatly improving scalability and usability.


title: The optimal lattice quantizer in nine dimensions

abstract: The optimal lattice quantizer is the lattice which minimizes the (dimensionless) second moment $G$. In dimensions $1$ to $8$, it has been proven that the optimal lattice quantizer is one of the classical lattices, or there is good evidence for this. In contrast, more than two decades ago, convincing numerical studies showed that in dimension $9$, a non-classical lattice is optimal. The structure and properties of this lattice depend upon a real parameter $a>0$, whose value was only known approximately. Here, we give a full description of this one-parameter family of lattices and their Voronoi cells, and calculate their (scalar and tensor) second moments analytically as a function of $a$. The value of $a$ which minimizes $G$ is an algebraic number, defined by the root of a $9$th order polynomial, with $a \approx 0.573223794$. For this value of $a$, the covariance matrix (second moment tensor) is proportional to the identity, consistent with a theorem of Zamir and Feder for optimal quantizers. The structure of the Voronoi cell depends upon $a$, and undergoes phase transitions at $a^2 = 1/2$, $1$ and $2$, where its geometry changes abruptly. At each transition, the analytic formula for the second moment changes in a very simple way. Our methods can be used for arbitrary one-parameter families of layered lattices, and may thus provide a useful tool to identify optimal quantizers in other dimensions as well.

categories: math-ph astro-ph.IM gr-qc math.MG math.MP


title: Development of a dynamic type 2 diabetes risk prediction tool: a UK Biobank study

abstract: Diabetes affects over 400 million people and is among the leading causes of morbidity worldwide. Identification of high-risk individuals can support early diagnosis and prevention of disease development through lifestyle changes. However, the majority of existing risk scores require information about blood-based factors which are not obtainable outside of the clinic. Here, we aimed to develop an accessible solution that could be deployed digitally and at scale. We developed a predictive 10-year type 2 diabetes risk score using 301 features derived from 472,830 participants in the UK Biobank dataset while excluding any features which are not easily obtainable by a smartphone. Using a data-driven feature selection process, 19 features were included in the final reduced model. A Cox proportional hazards model slightly overperformed a DeepSurv model trained using the same features, achieving a concordance index of 0.818 (95% CI: 0.812-0.823), compared to 0.811 (95% CI: 0.806-0.815). The final model showed good calibration. This tool can be used for clinical screening of individuals at risk of developing type 2 diabetes and to foster patient empowerment by broadening their knowledge of the factors affecting their personal risk.


title: Heisenberg-Uncertainty of Spatially-Gated Electromagnetic Fields

abstract: A Heisenberg uncertainty relation is derived for spatially-gated electric and magnetic field fluctuations. The uncertainty increases for small gating sizes which implies that in confined spaces the quantum nature of the electromagnetic field must be taken into account. Optimizing the state of light to minimize the electric at the expense of the magnetic field, and vice versa should be possible. Spatial confinements and quantum fields may alternatively be realized without gating by interaction of the field with a nanostructure. Possible applications include nonlinear spectroscopy of nanostructures and optical cavities and chiral signals.


title: Towards Autonomous Robotic Precision Harvesting: Mapping, Localization, Planning and Control for a Legged Tree Harvester

abstract: This paper presents an integrated system for performing precision harvesting missions using a legged harvester. Our harvester performs a challenging task of autonomous navigation and tree grabbing in a confined, GPS denied forest environment. Strategies for mapping, localization, planning, and control are proposed and integrated into a fully autonomous system. The mission starts with a human mapping the area of interest using a custom-made sensor module. Subsequently, a human expert selects the trees for harvesting. The sensor module is then mounted on the machine and used for localization within the given map. A planning algorithm searches for both an approach pose and a path in a single path planning problem. We design a path following controller leveraging the legged harvester's capabilities for negotiating rough terrain. Upon reaching the approach pose, the machine grabs a tree with a general-purpose gripper. This process repeats for all the trees selected by the operator. Our system has been tested on a testing field with tree trunks and in a natural forest. To the best of our knowledge, this is the first time this level of autonomy has been shown on a full-size hydraulic machine operating in a realistic environment.


title: Hydrodynamic synchronisation in strong confinement

abstract: Cellular appendages conferring motility, such as flagella or cilia, are known to synchronise their periodic beats. The origin of synchronisation is a combination of long-range hydrodynamic interactions with physical mechanisms allowing the phases of these biological oscillators to evolve. Two of such mechanisms have been identified by previous work, the elastic compliance of the periodic orbit or oscillations driven by phase-dependent biological forcing. To help uncover the physical mechanism for hydrodynamic synchronisation most essential overall in biology, we theoretically investigate the effect of strong confinement on the effectiveness of hydrodynamic synchronisation. We use minimal models where appendages are modelled as rigid spheres forced to move along circular trajectories near a rigid surface. Strong confinement is modelled by adding a second nearby surface, parallel to the first one, where the distance between the surfaces is much smaller than the typical distance between the cilia. We calculate separately the impact of confinement on the synchronisation dynamics of the elastic compliance and the force modulation mechanisms and compare our results to the case with no confinement. Applying our results to the biologically-relevant situation of nodal cilia, we show that force modulation is a mechanism that leads to phase-locked states under strong confinement that are very similar to those without confinement as a difference with the elastic compliance mechanism. Our results point therefore to the robustness of force modulation for synchronisation, an important feature for biological dynamics that suggests it could be the most essential physical mechanism overall in arrays of nodal cilia. We further examine the distinct situation of primary cilia and show in that case that the difference in robustness of the mechanisms is not as pronounced but still favours the force modulation.


title: Adiabaticity parameters for the categorization of light-matter interaction -- from weak to strong driving

abstract: We investigate theoretically and numerically the light-matter interaction in a two-level system (TLS) as a model system for excitation in a solid-state band structure. We identify five clearly distinct excitation regimes, categorized with well-known adiabaticity parameters: (1) the perturbative multiphoton absorption regime for small driving field strengths, and four light field-driven regimes, where intraband motion connects different TLS: (2) the impulsive Landau-Zener (LZ) regime, (3) the non-impulsive LZ regime, (4) the adiabatic regime and (5) the adiabatic-impulsive regime for large electric field strengths. This categorization is tremendously helpful to understand the highly complex excitation dynamics in any TLS, in particular when the driving field strength varies, and naturally connects Rabi physics with Landau-Zener physics. In addition, we find an insightful analytical expression for the photon orders connecting the perturbative multiphoton regime with the light field-driven regimes. Moreover, in the adiabatic-impulsive regime, adiabatic motion and impulsive LZ transitions are equally important, leading to an inversion symmetry breaking of the TLS when applying few-cycle laser pulses. This categorization allows a deep understanding of driven TLS in a large variety of settings ranging from cold atoms and molecules to solids and qubits, and will help to find optimal driving parameters for a given purpose.


title: Exponentially Converging Distributed Gradient Descent with Intermittent Communication via Hybrid Methods

abstract: We present a hybrid systems framework for multi-agent optimization in which agents execute computations in continuous time and communicate in discrete time. The optimization algorithm is a hybrid version of parallelized coordinate descent. Agents implement a sample-and-hold strategy in which gradients are computed at communication times and held constant during flows between communications. Completeness of maximal solutions under these hybrid dynamics is established. Under assumptions of smoothness and strong convexity, we show that this system exponentially converges to the minimizer of an objective function. Simulation results illustrate this convergence rate.


title: Yukawa coupling unification in an $\mathsf{SO(10)}$ model consistent with Fermilab $(g-2)_{\mu}$ result

abstract: We investigate the Yukawa coupling unification for the third generation in a class of $\mathsf{SO(10)}$ unified models which are consistent with the 4.2 $\sigma$ deviation from the standard model of the muon $g-2$ seen by the Fermilab experiment E989. A recent analysis in supergravity grand unified models shows that such an effect can arise from supersymmetric loops correction. Using a neural network, we further analyze regions of the parameter space where Yukawa coupling unification consistent with the Fermilab result can appear. In the analysis we take into account the contributions to Yukawas from the cubic and the quartic interactions. We test the model at the high luminosity and high energy LHC and estimate the integrated luminosities needed to discover sparticles predicted by the model.


title: Droplet trapping in bendotaxis caused by contact angle hysteresis

abstract: Passive droplet transport mechanisms, in which continuous external energy input is not required for motion, have received significant attention in recent years. Experimental studies of such mechanisms often ignore, or use careful treatments to minimize, contact angle hysteresis, which can impede droplet motion, or even arrest it completely. Here, we consider the effect of contact angle hysteresis on bendotaxis, a mechanism in which droplets spontaneously deform an elastic channel via capillary pressure and thereby move. Here, we seek to understand when contact angle hysteresis prevents bendotaxis. We supplement a previous mathematical model of the dynamics of bendotaxis with a simple model of contact angle hysteresis, and show that this model predicts droplet trapping when hysteresis is sufficiently strong. By identifying the equilibrium configurations adopted by these trapped droplets and assessing their linear stability, we uncover a sensitive dependence of bendotaxis on contact angle hysteresis and develop criteria to describe when droplets will be trapped.


title: Detection of Audio-Video Synchronization Errors Via Event Detection

abstract: We present a new method and a large-scale database to detect audio-video synchronization(A/V sync) errors in tennis videos. A deep network is trained to detect the visual signature of the tennis ball being hit by the racquet in the video stream. Another deep network is trained to detect the auditory signature of the same event in the audio stream. During evaluation, the audio stream is searched by the audio network for the audio event of the ball being hit. If the event is found in audio, the neighboring interval in video is searched for the corresponding visual signature. If the event is not found in the video stream but is found in the audio stream, A/V sync error is flagged. We developed a large-scaled database of 504,300 frames from 6 hours of videos of tennis events, simulated A/V sync errors, and found our method achieves high accuracy on the task.


title: Enhancing Cognitive Models of Emotions with Representation Learning

abstract: We present a novel deep learning-based framework to generate embedding representations of fine-grained emotions that can be used to computationally describe psychological models of emotions. Our framework integrates a contextualized embedding encoder with a multi-head probing model that enables to interpret dynamically learned representations optimized for an emotion classification task. Our model is evaluated on the Empathetic Dialogue dataset and shows the state-of-the-art result for classifying 32 emotions. Our layer analysis can derive an emotion graph to depict hierarchical relations among the emotions. Our emotion representations can be used to generate an emotion wheel directly comparable to the one from Plutchik's\LN model, and also augment the values of missing emotions in the PAD emotional state model.


title: Developing a New Tool to Implement Computer-Supported Active Learning Strategies in the Engineering Classroom

abstract: Successful implementation of active learning strategies in the engineering classroom -- and in particular in certain subjects which are highly technological in nature such as, for instance, rocket engines and space propulsion -- means overcoming certain challenges that arise from the fact that these are extremely complex systems to analyze. In this paper, we address the specific means to overcome one of such challenges: the lack of readily available software tools that are suitable for implementing this sort of teaching strategies within the engineering training. In particular, we develop a new tool for the modeling and simulation of liquid-propellant rocket engines specially tailored for the classroom, taking a systematic approach to the development of such tool based on the needs of modern teaching practices. After a thorough review of the available literature on the topic, the few most critical features that our tool should have in order to serve its purported goal are identified. Subsequently, a pilot experience to assess the impact of the usage of said tool on the learners' performance was carried out, showcasing excellent results, both in terms of the students' perceived quality of their training as well as in terms of their grade of retention and understanding of the matter. The conclusions of this study, especially the guidelines for the development of software tools aimed at the classroom, nevertheless, should be applicable to any other highly technological discipline, extending the scope of this paper beyond merely the subject of rocket science in engineering.


title: Polarization distortions of lensed gravitational waves

abstract: In general relativity (GR), gravitational waves (GWs) propagate the well-known plus and cross polarization modes which are the signature of a massless spin-2 field. However, diffraction of GWs caused by intervening objects along the line of sight can cause the apparent rise of additional polarizations due to GW-curvature interactions. In this paper, we continue the analysis by two of the authors of the present article, on lensing of gravitational waves beyond geometric optics. In particular, we calculate the lensing effect caused by a point-like lens, in the regime where its Schwarzschild radius $R_s$ is much smaller than the wavelength $\lambda$ of the signal, itself smaller than the impact parameter $b$. In this case, the curvature of spacetime induces distortions in the polarization of the wave such that effective scalar and vector polarizations may appear. We find that the amplitude of these apparent non-GR polarizations is suppressed by a factor $R_s\lambda/b^2$ with respect to the amplitude of the GR-like tensor modes. We estimate the probability to develop these extra polarization modes for a nearly monochromatic GW in the Pulsar Timing Arrays band traveling through a distribution of galaxies.


title: Scalar and mean curvature comparison via $\mu$-bubbles

abstract: Following ideas of Gromov we prove scalar and mean curvature comparison results for Riemannian bands with lower scalar curvature bounds in dimension $n\leq7$. The model spaces we use are warped products over scalar-flat manifolds with $\log$-concave warping functions.


title: On the Impact of Word Error Rate on Acoustic-Linguistic Speech Emotion Recognition: An Update for the Deep Learning Era

abstract: Text encodings from automatic speech recognition (ASR) transcripts and audio representations have shown promise in speech emotion recognition (SER) ever since. Yet, it is challenging to explain the effect of each information stream on the SER systems. Further, more clarification is required for analysing the impact of ASR's word error rate (WER) on linguistic emotion recognition per se and in the context of fusion with acoustic information exploitation in the age of deep ASR systems. In order to tackle the above issues, we create transcripts from the original speech by applying three modern ASR systems, including an end-to-end model trained with recurrent neural network-transducer loss, a model with connectionist temporal classification loss, and a wav2vec framework for self-supervised learning. Afterwards, we use pre-trained textual models to extract text representations from the ASR outputs and the gold standard. For extraction and learning of acoustic speech features, we utilise openSMILE, openXBoW, DeepSpectrum, and auDeep. Finally, we conduct decision-level fusion on both information streams -- acoustics and linguistics. Using the best development configuration, we achieve state-of-the-art unweighted average recall values of $73.6\,\%$ and $73.8\,\%$ on the speaker-independent development and test partitions of IEMOCAP, respectively.


title: Improving state-of-the-art in Detecting Student Engagement with Resnet and TCN Hybrid Network

abstract: Automatic detection of students' engagement in online learning settings is a key element to improve the quality of learning and to deliver personalized learning materials to them. Varying levels of engagement exhibited by students in an online classroom is an affective behavior that takes place over space and time. Therefore, we formulate detecting levels of students' engagement from videos as a spatio-temporal classification problem. In this paper, we present a novel end-to-end Residual Network (ResNet) and Temporal Convolutional Network (TCN) hybrid neural network architecture for students' engagement level detection in videos. The 2D ResNet extracts spatial features from consecutive video frames, and the TCN analyzes the temporal changes in video frames to detect the level of engagement. The spatial and temporal arms of the hybrid network are jointly trained on raw video frames of a large publicly available students' engagement detection dataset, DAiSEE. We compared our method with several competing students' engagement detection methods on this dataset. The ResNet+TCN architecture outperforms all other studied methods, improves the state-of-the-art engagement level detection accuracy, and sets a new baseline for future research.


title: Evaluating the origins of the secondary bias based on the correlation of halo properties with the linear density field

abstract: Using two sets of large $N$-body simulations, we study the origin of the correlations of halo assembly time ($z_{\rm f}$), concentration ($v_{\rm max}/v_{\rm 200}$) and spin ($\lambda$) with the large-scale evolved density field at given halo mass, i.e. the secondary bias. We find that the secondary bias is the secondary effect of the correlations of halo properties with the linear density estimated at the same comoving scale. Using the linear density on different scales, we find two types of correlations. The internal correlation, which reflects the correlation of halo properties with the mean linear over-density $\delta_{\rm L}$ within the halo Lagrangian radius $R_{\rm L}$, is positive for both $z_{\rm f}$ and $v_{\rm max}/v_{\rm 200}$, and negative for $\lambda$. The external correlation, which describes the correlation of halo properties with linear overdensity at $R>R_{\rm L}$ for given $\delta_{\rm L}$, shows trends opposite to the internal correlation. Both of the external and internal correlations depend only weakly on halo mass, indicating a similar origin for halos of different masses. Our findings offer a transparent perspective on the origin of the secondary bias. The secondary bias can be largely explained by the competition of the external and internal correlations together with the correlation of the linear density field on different scales. These two types of correlations combined can establish the complex halo-mass dependence of the secondary bias observed in the simulations.


title: Finding Small Multi-Demand Set Covers with Ubiquitous Elements and Large Sets is Fixed-Parameter Tractable

abstract: We study a variant of Set Cover where each element of the universe has some demand that determines how many times the element needs to be covered. Moreover, we examine two generalizations of this problem when a set can be included multiple times and when sets have different prices. We prove that all three problems are fixed-parameter tractable with respect to the combined parameter budget, the maximum number of elements missing in one of the sets, and the maximum number of sets in which one of the elements does not occur. Lastly, we point out how our fixed-parameter tractability algorithm can be applied in the context of bribery for the (collective-decision) group identification problem.


title: Bisecting for selecting: using a Laplacian eigenmaps clustering approach to create the new European football Super League

abstract: We use European football performance data to select teams to form the proposed European football Super League, using only unsupervised techniques. We first used random forest regression to select important variables predicting goal difference, which we used to calculate the Euclidian distances between teams. Creating a Laplacian eigenmap, we bisected the Fielder vector to identify the five major European football leagues' natural clusters. Our results showed how an unsupervised approach could successfully identify four clusters based on five basic performance metrics: shots, shots on target, shots conceded, possession, and pass success. The top two clusters identify those teams who dominate their respective leagues and are the best candidates to create the most competitive elite super league.


title: Could switchbacks originate in the lower solar atmosphere? II. Propagation of switchbacks in the solar corona

abstract: The magnetic switchbacks observed recently by the Parker Solar Probe have raised the question about their nature and origin. One of the competing theories of their origin is the interchange reconnection in the solar corona. In this scenario, switchbacks are generated at the reconnection site between open and closed magnetic fields, and are either advected by an upflow or propagate as waves into the solar wind. In this paper we test the wave hypothesis, numerically modelling the propagation of a switchback, modelled as an embedded Alfv\'en wave packet of constant magnetic field magnitude, through the gravitationally stratified solar corona with different degrees of background magnetic field expansion. While switchbacks propagating in a uniform medium with no gravity are relatively stable, as reported previously, we find that gravitational stratification together with the expansion of the magnetic field act in multiple ways to deform the switchbacks. These include WKB effects, which depend on the degree of magnetic field expansion, and also finite-amplitude effects, such as the symmetry breaking between nonlinear advection and the Lorentz force. In a straight or radially expanding magnetic field the propagating switchbacks unfold into waves that cause minimal magnetic field deflections, while a super-radially expanding magnetic field aids in maintaining strong deflections. Other important effects are the mass uplift the propagating switchbacks induce and the reconnection and drainage of plasmoids contained within the switchbacks. In the Appendix, we examine a series of setups with different switchback configurations and parameters, which broaden the scope of our study.


title: Generative Transformer for Accurate and Reliable Salient Object Detection

abstract: Transformer, which originates from machine translation, is particularly powerful at modeling long-range dependencies. Currently, the transformer is making revolutionary progress in various vision tasks, leading to significant performance improvements compared with the convolutional neural network (CNN) based frameworks. In this paper, we conduct extensive research on exploiting the contributions of transformers for accurate and reliable salient object detection. For the former, we apply transformer to a deterministic model, and explain that the effective structure modeling and global context modeling abilities lead to its superior performance compared with the CNN based frameworks. For the latter, we observe that both CNN and transformer based frameworks suffer greatly from the over-confidence issue, where the models tend to generate wrong predictions with high confidence. To estimate the reliability degree of both CNN- and transformer-based frameworks, we further present a latent variable model, namely inferential generative adversarial network (iGAN), based on the generative adversarial network (GAN). The stochastic attribute of the latent variable makes it convenient to estimate the predictive uncertainty, serving as an auxiliary output to evaluate the reliability of model prediction. Different from the conventional GAN, which defines the distribution of the latent variable as fixed standard normal distribution $\mathcal{N}(0,\mathbf{I})$, the proposed iGAN infers the latent variable by gradient-based Markov Chain Monte Carlo (MCMC), namely Langevin dynamics, leading to an input-dependent latent variable model. We apply our proposed iGAN to both fully and weakly supervised salient object detection, and explain that iGAN within the transformer framework leads to both accurate and reliable salient object detection.


title: Beyond Schr\"{o}dinger-Poisson: Nonrelativistic Effective Field Theory for Scalar Dark Matter

abstract: Massive scalar fields provide excellent dark matter candidates, whose dynamics are often explored analytically and numerically using nonrelativistic Schr\"{o}dinger-Poisson (SP) equations in a cosmological context. In this paper, starting from the nonlinear and fully relativistic Klein-Gordon-Einstein (KGE) equations in an expanding universe, we provide a systematic framework for deriving the SP equations, as well as relativistic corrections to them, by integrating out `fast modes' and including nonlinear metric and matter contributions. We provide explicit equations for the leading-order relativistic corrections, which provide insight into deviations from the SP equations as the system approaches the relativistic regime. Upon including the leading-order corrections, our equations are applicable beyond the domain of validity of the SP system, and are simpler to use than the full KGE case in some contexts. As a concrete application, we calculate the mass-radius relationship of solitons in scalar dark matter and accurately capture the deviations of this relationship from the SP system towards the KGE one.


title: Efficient Retrieval Optimized Multi-task Learning

abstract: Recently, there have been significant advances in neural methods for tackling knowledge-intensive tasks such as open domain question answering (QA). These advances are fueled by combining large pre-trained language models with learnable retrieval of documents. Majority of these models use separate encoders for learning query representation, passage representation for the retriever and an additional encoder for the downstream task. Using separate encoders for each stage/task occupies a lot of memory and makes it difficult to scale to a large number of tasks. In this paper, we propose a novel Retrieval Optimized Multi-task (ROM) framework for jointly training self-supervised tasks, knowledge retrieval, and extractive question answering. Our ROM approach presents a unified and generalizable framework that enables scaling efficiently to multiple tasks, varying levels of supervision, and optimization choices such as different learning schedules without changing the model architecture. It also provides the flexibility of changing the encoders without changing the architecture of the system. Using our framework, we achieve comparable or better performance than recent methods on QA, while drastically reducing the number of parameters.


title: Hidden Biases in Unreliable News Detection Datasets

abstract: Automatic unreliable news detection is a research problem with great potential impact. Recently, several papers have shown promising results on large-scale news datasets with models that only use the article itself without resorting to any fact-checking mechanism or retrieving any supporting evidence. In this work, we take a closer look at these datasets. While they all provide valuable resources for future research, we observe a number of problems that may lead to results that do not generalize in more realistic settings. Specifically, we show that selection bias during data collection leads to undesired artifacts in the datasets. In addition, while most systems train and predict at the level of individual articles, overlapping article sources in the training and evaluation data can provide a strong confounding factor that models can exploit. In the presence of this confounding factor, the models can achieve good performance by directly memorizing the site-label mapping instead of modeling the real task of unreliable news detection. We observed a significant drop (>10%) in accuracy for all models tested in a clean split with no train/test source overlap. Using the observations and experimental results, we provide practical suggestions on how to create more reliable datasets for the unreliable news detection task. We suggest future dataset creation include a simple model as a difficulty/bias probe and future model development use a clean non-overlapping site and date split.


title: Generalization of Kirchhoff's Law: The inherent relations between quantum efficiency and emissivity

abstract: Planck's law of thermal radiation depends only on the temperature T and emissivity $\varepsilon$. It is one of the most fundamental discoveries about light-matter interaction that led to the development of quantum physics. Another basic property of a body is its ability to absorb incoming light, characterized by absorptivity $\alpha$. Kirchhoff's law of thermal radiation equals these two properties at thermodynamic equilibrium, i.e., $\varepsilon$=$\alpha$. The generalized Planck's equation extends Kirchhof's law out of equilibrium by scaling the absorptivity with the pump-dependent chemical potential $\mu$, obscuring emissivity as a material property. Quantum efficiency (QE) is a material property, defined out of equilibrium, describing the statistics of absorption followed by emission of a photon. Both emissivity and QE depend on the interplay between radiative and non-radiative rates. Here we theoretically and experimentally demonstrate a prime equation for emissivity as a material property in and out of equilibrium in the form of $\varepsilon$=$\alpha$(1-QE), which at equilibrium is reduced to Kirchhoff's law. Our work lays out the fundamental evolution of non-thermal emission with temperature, which is critical for the development of lighting and energy devices.


title: Phase Transition Adaptation

abstract: Artificial Recurrent Neural Networks are a powerful information processing abstraction, and Reservoir Computing provides an efficient strategy to build robust implementations by projecting external inputs into high dimensional dynamical system trajectories. In this paper, we propose an extension of the original approach, a local unsupervised learning mechanism we call Phase Transition Adaptation, designed to drive the system dynamics towards the `edge of stability'. Here, the complex behavior exhibited by the system elicits an enhancement in its overall computational capacity. We show experimentally that our approach consistently achieves its purpose over several datasets.