title: SmartProduct: a prototype platform for product monitoring-as-a-service, leveraging IoT technologies and the EPCIS standard

abstract: Internet of Things (IoT) technologies have received significant attention in recent years by encompassing a set of technologies that enable a variety of heterogeneous physical objects, called things, to interact and communicate through efficient networking protocols. These technologies have already been used in several domains such as in manufacturing, healthcare, agriculture, etc. Another domain in which IoT can be applicable and useful, is that of supply chain tracing, where products are monitored throughout the whole supply chain. IoT data collection can enable the proliferation of applications, which are able to track environmental-related information per product (e.g. storage conditions), and combine them together with traceability data in order to provide full product monitoring services. Traditional supply chain tracing methods (e.g. product tracing, storage conditions' monitoring, transport vehicles used, etc.) involve costly and error-prone procedures, as human involvement is often required. Severe fragmentation is also possible, as the various stakeholders involved (producers, distributors, retailers), do not use interoperable technologies and standards. To overcome these limitations, we propose a flexible and secure prototype platform that leverages IoT technologies, jointly with the Electronic Product Code Information Service (EPCIS) standard. The IoT software/hardware modules of the platform are used to collect IoT data (i.e. geographical location, ambient temperature, humidity, etc.), while the EPCIS-based software collects and records conventional supply chain traceability data (e.g. type of product manufactured, product loaded/unloaded into/from a truck, product transformed to another product, etc.). A rich RESTful API with strong authentication/authorisation mechanisms is used to offer Product-Monitoring-as-a-Service (PMaaS) to third-party applications.


title: Data Subsampling for Bayesian Neural Networks

abstract: Markov Chain Monte Carlo (MCMC) algorithms do not scale well for large datasets leading to difficulties in Neural Network posterior sampling. In this paper, we apply a generalization of the Metropolis Hastings algorithm that allows us to restrict the evaluation of the likelihood to small mini-batches in a Bayesian inference context. Since it requires the computation of a so-called "noise penalty" determined by the variance of the training loss function over the mini-batches, we refer to this data subsampling strategy as Penalty Bayesian Neural Networks - PBNNs. Its implementation on top of MCMC is straightforward, as the variance of the loss function merely reduces the acceptance probability. Comparing to other samplers, we empirically show that PBNN achieves good predictive performance for a given mini-batch size. Varying the size of the mini-batches enables a natural calibration of the predictive distribution and provides an inbuilt protection against overfitting. We expect PBNN to be particularly suited for cases when data sets are distributed across multiple decentralized devices as typical in federated learning.


title: Qubit Geodesics on the Bloch Sphere from Optimal-Speed Hamiltonian Evolutions

abstract: In the geometry of quantum evolutions, a geodesic path is viewed as a path of minimal statistical length connecting two pure quantum states along which the maximal number of statistically distinguishable states is minimum. In this paper, we present an explicit geodesic analysis of the dynamical trajectories that emerge from the quantum evolution of a single-qubit quantum state. The evolution is governed by an Hermitian Hamiltonian operator that achieves the fastest possible unitary evolution between given initial and final pure states. Furthermore, in addition to viewing geodesics in ray space as paths of minimal length, we also verify the geodesicity of paths in terms of unit geometric efficiency and vanishing geometric phase. Finally, based on our analysis, we briefly address the main hurdles in moving to the geometry of quantum evolutions for open quantum systems in mixed quantum states.


title: On Rough Frobenius-type Theorems and Their H\"older Estimates

abstract: The thesis studies Frobenius-type theorems in non-smooth settings. We extend the definition of involutivity to non-Lipschitz subbundles using generalized functions. We prove the real Frobenius Theorem with sharp regularity on log-Lipschitz subbundles. We also develop a singular version of the Frobenius theorem on log-Lipschitz vector fields: if $X_1,\dots,X_m$ are log-Lipschitz vector fields such that $[X_i,X_j]=\sum_{k=1}^mc_{ij}^kX_k$ where $c_{ij}^k$ are the derivatives of log-Lipschitz functions, then for any point $p$ there is a $C^1$-manifold containing $p$ such that $X_1,\dots,X_m$ span its tangent space. On the quantitative side, if $c_{ij}^k\in C^{\alpha-1}$ where $1<\alpha<2$ then on each leaf where $X_1,\dots,X_m$ span the tangent spaces we can find a regular parameterization $\Phi$ such that $\Phi^*X_1,\dots,\Phi^*X_m$ are $C^\alpha$, and their $C^\alpha$ norm depend only on the diffeomorphic invariant quantities of $X_1,\dots,X_m$. For a complex Frobenius structure there is a coordinate chart $F$ that takes image in $\mathbb R^r_t\times\mathbb C^m_z\times \mathbb R^{N-r-2m}_s$, such that the structure is locally spanned by $F^*\partial_t,F^*\partial_z$. When it has H\"older regularity $\alpha>1$, we show that the coordinate chart $F$ may be taken to be $\mathscr C^\alpha$, and the vector fields $F^*\partial_t,F^*\partial_z$ are $\mathscr C^{\alpha-\epsilon}$ for every $\epsilon>0$. We give an example to show that the regularity result for $F^*\partial_z$ is optimal. When a complex Frobenius structure $S$ is $C^\alpha$ ($\frac12<\alpha\le1$) such that $S+\bar S$ is log-Lipschitz, then for every $\epsilon>0$ there is a $C^{2\alpha-1-\epsilon}$ homeomorphism $\Phi(t,z,s)$ such that $S$ is spanned by $\Phi_*\partial_t,\Phi_*\partial_z\in C^{2\alpha-1-\epsilon}$.


title: Certain endomorphism rings of local cohomology modules and Lyubeznik numbers

abstract: The goal of this paper is twofold; on the one hand, motivated by questions raised by Schenzel, we explore situations where the Hartshorne--Lichtenbaum Vanishing Theorem for local cohomology fails, leading us to simpler expressions of certain local cohomology modules. As application, we give new expressions of the endomorphism ring of these modules. On the other hand, building upon previous work by \`Alvarez Montaner, we exhibit the shape of Lyubeznik tables of the so--called partially sequentially Cohen--Macaulay rings as introduced by Sbarra and Strazzanti.


title: Exploring the stability of solar geoengineering agreements

abstract: A simple model is introduced to study the cooperative behavior of nations regarding solar geoengineering. The results of this model are explored through numerical methods. A general finding is that cooperation and coordination between nations on solar geoengineering is very much incentivized. Furthermore, the stability of solar geoengineering agreements between nations crucially depends on the perceived riskiness of solar geoengineering. If solar geoengineering is perceived as riskier, the stability of the most stable solar geoengineering agreements is reduced. However, the stability of agreements is completely independent of countries preferences.


title: The holography of non-invertible self-duality symmetries

abstract: We study how non-invertible self-duality defects arise in theories with a holographic dual. We focus on the paradigmatic example of $\mathfrak{su}(N)$ $\mathcal{N} = 4$ SYM. The theory is known to have non-invertible duality and triality defects at $\tau =i$ and $\tau = e^{2 \pi i /3}$, respectively. At these points in the gravitational moduli space, the gauged $SL(2,\mathbb{Z})$ duality symmetry of type IIB string theory is spontaneously broken to a finite subgroup $G$, giving rise to a discrete emergent $G$ gauge field. After reduction on the internal manifold, the low-energy physics is dominated by an interesting 5d Chern-Simons theory, further gauged by $G$, that we analyze and which gives rise to the self-duality defects in the boundary theory. Using the five-dimensional bulk theory, we compute the fusion rules of those defects in detail. The methods presented here are general and may be used to investigate such symmetries in other theories with a gravity dual.


title: PARTIME: Scalable and Parallel Processing Over Time with Deep Neural Networks

abstract: In this paper, we present PARTIME, a software library written in Python and based on PyTorch, designed specifically to speed up neural networks whenever data is continuously streamed over time, for both learning and inference. Existing libraries are designed to exploit data-level parallelism, assuming that samples are batched, a condition that is not naturally met in applications that are based on streamed data. Differently, PARTIME starts processing each data sample at the time in which it becomes available from the stream. PARTIME wraps the code that implements a feed-forward multi-layer network and it distributes the layer-wise processing among multiple devices, such as Graphics Processing Units (GPUs). Thanks to its pipeline-based computational scheme, PARTIME allows the devices to perform computations in parallel. At inference time this results in scaling capabilities that are theoretically linear with respect to the number of devices. During the learning stage, PARTIME can leverage the non-i.i.d. nature of the streamed data with samples that are smoothly evolving over time for efficient gradient computations. Experiments are performed in order to empirically compare PARTIME with classic non-parallel neural computations in online learning, distributing operations on up to 8 NVIDIA GPUs, showing significant speedups that are almost linear in the number of devices, mitigating the impact of the data transfer overhead.


title: Pruning-based Topology Refinement of 3D Mesh using a 2D Alpha Mask

abstract: Image-based 3D reconstruction has increasingly stunning results over the past few years with the latest improvements in computer vision and graphics. Geometry and topology are two fundamental concepts when dealing with 3D mesh structures. But the latest often remains a side issue in the 3D mesh-based reconstruction literature. Indeed, performing per-vertex elementary displacements over a 3D sphere mesh only impacts its geometry and leaves the topological structure unchanged and fixed. Whereas few attempts propose to update the geometry and the topology, all need to lean on costly 3D ground-truth to determine the faces/edges to prune. We present in this work a method that aims to refine the topology of any 3D mesh through a face-pruning strategy that extensively relies upon 2D alpha masks and camera pose information. Our solution leverages a differentiable renderer that renders each face as a 2D soft map. Its pixel intensity reflects the probability of being covered during the rendering process by such a face. Based on the 2D soft-masks available, our method is thus able to quickly highlight all the incorrectly rendered faces for a given viewpoint. Because our module is agnostic to the network that produces the 3D mesh, it can be easily plugged into any self-supervised image-based (either synthetic or natural) 3D reconstruction pipeline to get complex meshes with a non-spherical topology.


title: A Note on Quantum Divide and Conquer for Minimal String Rotation

abstract: Lexicographically minimal string rotation is a fundamental problem on string processing that has recently attracted a lot of attention in quantum computing. Near-optimal quantum algorithms have been proposed during its development, with new ideas such as quantum divide and conquer introduced. In this note, we further study its quantum query complexity. Slightly improved quantum algorithms by divide and conquer are proposed: 1. For the function problem, its query complexity is shown to be $\sqrt{n} \cdot 2^{O\left(\sqrt{\log n}\right)}$, improving the recent result of $\sqrt{n} \cdot 2^{\left(\log n\right)^{1/2+\varepsilon}}$ by Akmal and Jin (2022). 2. For the decision problem, its query complexity is shown to be $O\left(\sqrt{n \log^3 n \log \log n}\right)$, improving the recent result of $O\left(\sqrt{n \log^5 n}\right)$ by Childs et al. (2022). The purpose of this note is to point out some useful algorithmic tricks, e.g., preprocessing and level-wise optimization, that can be used to improve quantum algorithms, especially for those with a divide-and-conquer structure.


title: Prompting GPT-3 To Be Reliable

abstract: Large language models (LLMs) show impressive abilities via few-shot prompting. Commercialized APIs such as OpenAI GPT-3 further increase their use in real-world language applications. However, the crucial problem of how to improve the reliability of GPT-3 is still under-explored. While reliability is a broad and vaguely defined term, we decompose reliability into four main facets that correspond to the existing framework of ML safety and are well-recognized to be important: generalizability, social biases, calibration, and factuality. Our core contribution is to establish simple and effective prompts that improve GPT-3's reliability as it: 1) generalizes out-of-distribution, 2) balances demographic distribution and uses natural language instructions to reduce social biases, 3) calibrates output probabilities, and 4) updates the LLM's factual knowledge and reasoning chains. With appropriate prompts, GPT-3 is more reliable than smaller-scale supervised models on all these facets. We release all processed datasets, evaluation scripts, and model predictions. Our systematic empirical study not only sheds new insights on the reliability of prompting LLMs, but more importantly, our prompting strategies can help practitioners more reliably use LLMs like GPT-3.


title: Symbol Guided Hindsight Priors for Reward Learning from Human Preferences

abstract: Specifying rewards for reinforcement learned (RL) agents is challenging. Preference-based RL (PbRL) mitigates these challenges by inferring a reward from feedback over sets of trajectories. However, the effectiveness of PbRL is limited by the amount of feedback needed to reliably recover the structure of the target reward. We present the PRIor Over Rewards (PRIOR) framework, which incorporates priors about the structure of the reward function and the preference feedback into the reward learning process. Imposing these priors as soft constraints on the reward learning objective reduces the amount of feedback required by half and improves overall reward recovery. Additionally, we demonstrate that using an abstract state space for the computation of the priors further improves the reward learning and the agent's performance.


title: Planet Four: A Neural Network's Search For Polar Spring-time Fans On Mars

abstract: Dark deposits visible from orbit appear in the Martian south polar region during the springtime. These are thought to form from explosive jets of carbon dioxide gas breaking through the thawing seasonal ice cap, carrying dust and dirt which is then deposited onto the ice as dark 'blotches', or blown by the surface winds into streaks or 'fans'. We investigate machine learning (ML) methods for automatically identifying these seasonal features in High Resolution Imaging Science Experiment (HiRISE) satellite imagery. We designed deep Convolutional Neural Networks (CNNs) that were trained and tested using the catalog generated by Planet Four, an online citizen science project mapping the south polar seasonal deposits. We validated the CNNs by comparing their results with those of ISODATA (Iterative Self-Organizing Data Analysis Technique) clustering and as expected, the CNNs were significantly better at predicting the results found by Planet Four, in both the area of predicted seasonal deposits and in delineating their boundaries. We found neither the CNNs or ISODATA were suited to predicting the source point and directions of seasonal fans, which is a strength of the citizen science approach. The CNNs showed good agreement with Planet Four in cross-validation metrics and detected some seasonal deposits in the HiRISE images missed in the Planet Four catalog; the total area of seasonal deposits predicted by the CNNs was 27% larger than that of the Planet Four catalog, but this aspect varied considerably on a per-image basis.


title: Face Pasting Attack

abstract: Cujo AI and Adversa AI hosted the MLSec face recognition challenge. The goal was to attack a black box face recognition model with targeted attacks. The model returned the confidence of the target class and a stealthiness score. For an attack to be considered successful the target class has to have the highest confidence among all classes and the stealthiness has to be at least 0.5. In our approach we paste the face of a target into a source image. By utilizing position, scaling, rotation and transparency attributes we reached 3rd place. Our approach took approximately 200 queries per attack for the final highest score and about ~7.7 queries minimum for a successful attack. The code is available at https://github.com/bunni90/FacePastingAttack .


title: Frame-Dragging in Extrasolar Circumbinary Planetary Systems

abstract: Extrasolar circumbinary planets are so called because they orbit two stars instead of just one; to date, an increasing number of such planets have been discovered with a variety of techniques. If the orbital frequency of the hosting stellar pair is much higher than the planetary one, the tight stellar binary can be considered as a matter ring current generating its own post-Newtonian stationary gravitomagnetic field through its orbital angular momentum. It affects the orbital motion of a relatively distant planet with Lense-Thirring-type precessional effects which, under certain circumstances, may amount to a significant fraction of the static, gravitoelectric ones, analogous to the well known Einstein perihelion precession of Mercury, depending only on the masses of the system's bodies. Instead, when the gravitomagnetic field is due solely to the spin of each of the central star(s), the Lense-Thirring shifts are several orders of magnitude smaller than the gravitoelectric ones. In view of the growing interest in the scientific community about the detection of general relativistic effects in exoplanets, the perspectives of finding new scenarios for testing such a further manifestation of general relativity might be deemed worth of further investigations.


title: Quantum Event Learning and Gentle Random Measurements

abstract: We prove the expected disturbance caused to a quantum system by a sequence of randomly ordered two-outcome projective measurements is upper bounded by the square root of the probability that at least one measurement in the sequence accepts. We call this bound the Gentle Random Measurement Lemma. We then consider problems in which we are given sample access to an unknown state $\rho$ and asked to estimate properties of the accepting probabilities $\text{Tr}[M_i \rho]$ of a set of measurements $\{M_1, M_2, \ldots , M_m\}$. We call these types of problems Quantum Event Learning Problems. Using the gentle random measurement lemma, we show randomly ordering projective measurements solves the Quantum OR problem, answering an open question of Aaronson. We also give a Quantum OR protocol which works on non-projective measurements but which requires a more complicated type of measurement, which we call a Blended Measurement. Given additional guarantees on the set of measurements $\{M_1, \ldots, M_m\}$, we show the Quantum OR protocols developed in this paper can also be used to find a measurement $M_i$ such that $\text{Tr}[M_i \rho]$ is large. We also give a blended measurement based protocol for estimating the average accepting probability of a set of measurements on an unknown state. Finally we consider the Threshold Search Problem described by O'Donnell and B\u{a}descu. By building on our Quantum Event Finding result we show that randomly ordered (or blended) measurements can be used to solve this problem using $O(\log^2(m) / \epsilon^2)$ copies of $\rho$. Consequently, we obtain an algorithm for Shadow Tomography which requires $\tilde{O}(\log^2(m)\log(d)/\epsilon^4)$ samples, matching the current best known sample complexity. This algorithm does not require injected noise in the quantum measurements, but does require measurements to be made in a random order and so is no longer online.


title: Two Modes of LyC Escape From Bursty Star Formation: Implications for [C II] Deficits and the Sources of Reionization

abstract: We use the SPHINX$^{20}$ cosmological radiation hydrodynamics simulation to study how Lyman Continuum (LyC) photons escape from galaxies and the observational signatures of this escape. We define two classes of LyC leaker: Bursty Leakers and Remnant Leakers, based on their star formation rates (SFRs) that are averaged over 10 Myr (SFR$_{10}$) or 100 Myr (SFR$_{100}$). Both have $f_{\rm esc}>20\%$ and experienced an extreme burst of star formation, but Bursty Leakers have ${\rm SFR_{10}>SFR_{100}}$, while Remnant Leakers have ${\rm SFR_{10}<SFR_{100}}$. The maximum SFRs in these bursts were typically $\sim100$ times greater than the SFR of the galaxy prior to the burst, a rare $2\sigma$ outlier among the general high-redshift galaxy population. Bursty Leakers are qualitatively similar to ionization-bounded nebulae with holes, exhibiting high ionization parameters and typical HII region gas densities. Remnant Leakers show properties of density-bounded nebulae, having normal ionization parameters but much lower HII region densities. Both types of leaker exhibit [CII]$_{\rm 158\mu m}$ deficits on the [CII]-SFR$_{100}$ relation, while only Bursty Leakers show deficits when SFR$_{10}$ is used. We predict that [CII] luminosity and SFR indicators such as H$\alpha$ and M$_{\rm 1500\r{A}}$ can be combined to identify both types of LyC leaker and the mode by which photons are escaping. These predictions can be tested with [CII] observations of known $z=3-4$ LyC leakers. Finally, we show that leakers with $f_{\rm esc}>20\%$ dominate the ionizing photon budget at $z\gtrsim7.5$ but the contribution from galaxies with $f_{\rm esc}<5\%$ becomes significant at the tail-end of reionization.


title: A characterization for the defect of rank one valued field extensions

abstract: In this paper we present a characterization for the defect of a simple algebraic extension of rank one valued fields using the key polynomials that define the valuation. As a particular example, this gives the classification of defect extensions of degree $p$ as dependent or independent presented by Kuhlmann.


title: Weakly almost square Lipschitz-free spaces

abstract: We construct a Lipschitz-free space that is locally almost square but not weakly almost square; this is the first example of such a Banach space. We also prove a result, which indicates that geodesic metric spaces are a potential metric characterization for weakly almost square Lipschitz-free spaces. Lastly, we prove that a Lipschitz-free space can not have the symmetric strong diameter $2$ property.


title: Stability and instability of solitary waves in fractional generalized KdV equation in all dimensions

abstract: We study stability properties of solitary wave solutions for the fractional generalized Korteweg-de Vries equation $$ \partial_t u- \partial_{x_1} D^{\alpha}u+ \tfrac{1}{m}\partial_{x_1}(u^m)=0, ~ (x_1,\dots,x_d)\in \mathbb{R}^d, \, \, t\in \mathbb{R}, \, \, 0<\alpha <2, $$ in any spatial dimension $d\geq 1$ and nonlinearity $m>1$. In the $L^2$-subcritical case, $1<m<\frac{2d}{\alpha}+1$, we prove the orbital stability of solitary waves using the concentration-compactness argument, the commutator estimates and expansions of nonlocal operator $D^\alpha$ in several variables. In the $L^2$-supercritical case, $\frac{2d}{\alpha}+1<m<m_{\ast}$, we show that solitary waves are unstable. The instability is obtained by making use of an explicit sequence of initial conditions in conjunction with modulation and truncation arguments. This work maybe be of interest for studying solitary waves and other coherent structures in dispersive equations that involve nonlocal operators. The arguments developed here are independent of the spatial dimension and rely on a careful analysis of spatial decay of ground states and their regularity. In particular, in the one-dimensional setting, we show the instability of solitary waves of the supercritical generalized Benjamin-Ono equation and the dispersion-generalized Benjamin-Ono equation, furthermore, new results on the instability are obtained in the weaker dispersion regime $\frac{1}{2}<\alpha<1$.


title: Statistical, Robustness, and Computational Guarantees for Sliced Wasserstein Distances

abstract: Sliced Wasserstein distances preserve properties of classic Wasserstein distances while being more scalable for computation and estimation in high dimensions. The goal of this work is to quantify this scalability from three key aspects: (i) empirical convergence rates; (ii) robustness to data contamination; and (iii) efficient computational methods. For empirical convergence, we derive fast rates with explicit dependence of constants on dimension, subject to log-concavity of the population distributions. For robustness, we characterize minimax optimal, dimension-free robust estimation risks, and show an equivalence between robust sliced 1-Wasserstein estimation and robust mean estimation. This enables lifting statistical and algorithmic guarantees available for the latter to the sliced 1-Wasserstein setting. Moving on to computational aspects, we analyze the Monte Carlo estimator for the average-sliced distance, demonstrating that larger dimension can result in faster convergence of the numerical integration error. For the max-sliced distance, we focus on a subgradient-based local optimization algorithm that is frequently used in practice, albeit without formal guarantees, and establish an $O(\epsilon^{-4})$ computational complexity bound for it. Our theory is validated by numerical experiments, which altogether provide a comprehensive quantitative account of the scalability question.


title: Atomic cluster expansion for quantum-accurate large-scale simulations of carbon

abstract: We present an atomic cluster expansion (ACE) for carbon that improves over available classical and machine learning potentials. The ACE is parameterized from an exhaustive set of important carbon structures at extended volume and energy range, computed using density functional theory (DFT). Rigorous validation reveals that ACE predicts accurately a broad range of properties of both crystalline and amorphous carbon phases while being several orders of magnitude more computationally efficient than available machine learning models. We demonstrate the predictive power of ACE on three distinct applications, brittle crack propagation in diamond, evolution of amorphous carbon structures at different densities and quench rates and nucleation and growth of fullerene clusters under high pressure and temperature conditions.


title: Table-To-Text generation and pre-training with TabT5

abstract: Encoder-only transformer models have been successfully applied to different table understanding tasks, as in TAPAS (Herzig et al., 2020). A major limitation of these architectures is that they are constrained to classification-like tasks such as cell selection or entailment detection. We present TABT5, an encoder-decoder model that generates natural language text based on tables and textual inputs. TABT5 overcomes the encoder-only limitation by incorporating a decoder component and leverages the input structure with table specific embeddings and pre-training. TABT5 achieves new state-of-the-art results on several domains, including spreadsheet formula prediction with a 15% increase in sequence accuracy, QA with a 2.5% increase in sequence accuracy and data-to-text generation with a 2.5% increase in BLEU.


title: KPI-EDGAR: A Novel Dataset and Accompanying Metric for Relation Extraction from Financial Documents

abstract: We introduce KPI-EDGAR, a novel dataset for Joint Named Entity Recognition and Relation Extraction building on financial reports uploaded to the Electronic Data Gathering, Analysis, and Retrieval (EDGAR) system, where the main objective is to extract Key Performance Indicators (KPIs) from financial documents and link them to their numerical values and other attributes. We further provide four accompanying baselines for benchmarking potential future research. Additionally, we propose a new way of measuring the success of said extraction process by incorporating a word-level weighting scheme into the conventional F1 score to better model the inherently fuzzy borders of the entity pairs of a relation in this domain.


title: How to sustain the terrestrial biosphere in the Anthropocene? A thermodynamic Earth system perspective

abstract: Many aspects of anthropogenic global change, such as land cover change, biodiversity loss and the intensification of agricultural production, threaten the natural biosphere. These aspects seem somewhat disjunct and specific so that it is hard to obtain a bigger picture of what these changes imply and to distinguish beneficial from detrimental human impacts. Here I describe a holistic approach that provides such a bigger picture and use it to understand how the terrestrial biosphere can be sustained in the presence of increased human activities. This approach focuses on the free energy generated by photosynthesis, energy needed to sustain either the dissipative metabolic activity of ecosystems or human activities, with the generation rate being set by the physical constraints of the environment. We can then distinguish two kinds of human impacts on the biosphere: detrimental effects caused by enhanced human consumption of this free energy, and empowering effects that allow for more photosynthetic activity and therefore more dissipative activity of the biosphere. I use examples from the terrestrial biosphere to illustrate this view as well as global datasets to show how this can be estimated. I then discuss how certain aspects of human-made technology can act to enhance the free energy generation of the terrestrial biosphere, which can then facilitate sustaining the biosphere in times at which human activity increasingly shapes the functioning of the Earth system.


title: Expected geoneutrino signal at JUNO using local integrated 3-D refined crustal model

abstract: Geoneutrinos serve as a potent tool for comprehending the radiogenic power and composition of Earth. Although geoneutrinos have been observed in prior experiments, the forthcoming generation of experiments,such as JUNO, will be necessary for fully harnessing their potential. Precise prediction of the crustal contribution is vital for interpreting particlephysics measurements in the context of geo-scientific inquiries. Nonetheless, existing models such as JULOC and GIGJ have limitations in accurately forecasting the crustal contribution. This paper introduces JULOCI, the novel 3-D integrated crustal model of JUNO, which employs seismic, gravity, rock sample, and heat flow data to precisely estimate the geoneutrino signal of the lithosphere. The model indicates elevated concentrations of uranium and thorium in southern China, resulting in unexpectedly strong geoneutrino signals.The accuracy of JULOC-I, coupled with a decade of experimental data, affords JUNO the opportunity to test multiple mantle models. Once operational, JUNO can validate the model predictions and enhance the precision of mantle measurements. All in all, the improved accuracy ofJULOC-I represents a substantial stride towards comprehending the geochemical distribution of the South China crust, offering a valuable tool for investigating the composition and evolution of the Earth through geoneutrinos.


title: Nonautonomous k-contact field theories

abstract: This paper provides a new geometric framework to describe non-conservative field theories with explicit dependence on the space-time coordinates by combining the k-cosymplectic and k-contact formulations. This geometric framework, the k-cocontact geometry, permits to develop a Hamiltonian and Lagrangian formalisms for these field theories. We also compare this new formulation in the autonomous case with the previous k-contact formalism. To illustrate the theory, we study the nonlinear damped wave equation with external time-dependent forcing.


title: How do we get there? Evaluating transformer neural networks as cognitive models for English past tense inflection

abstract: There is an ongoing debate on whether neural networks can grasp the quasi-regularities in languages like humans. In a typical quasi-regularity task, English past tense inflections, the neural network model has long been criticized that it learns only to generalize the most frequent pattern, but not the regular pattern, thus can not learn the abstract categories of regular and irregular and is dissimilar to human performance. In this work, we train a set of transformer models with different settings to examine their behavior on this task. The models achieved high accuracy on unseen regular verbs and some accuracy on unseen irregular verbs. The models' performance on the regulars is heavily affected by type frequency and ratio but not token frequency and ratio, and vice versa for the irregulars. The different behaviors on the regulars and irregulars suggest that the models have some degree of symbolic learning on the regularity of the verbs. In addition, the models are weakly correlated with human behavior on nonce verbs. Although the transformer model exhibits some level of learning on the abstract category of verb regularity, its performance does not fit human data well, suggesting that it might not be a good cognitive model.


title: Spatially scalable recursive estimation of Gaussian process terrain maps using local basis functions

abstract: When an agent, person, vehicle or robot is moving through an unknown environment without GNSS signals, online mapping of nonlinear terrains can be used to improve position estimates when the agent returns to a previously mapped area. Mapping algorithms using online Gaussian process (GP) regression are commonly integrated in algorithms for simultaneous localisation and mapping (SLAM). However, GP mapping algorithms have increasing computational demands as the mapped area expands relative to spatial field variations. This is due to the need for estimating an increasing amount of map parameters as the area of the map grows. Contrary to this, we propose a recursive GP mapping estimation algorithm which uses local basis functions in an information filter to achieve spatial scalability. Our proposed approximation employs a global grid of finite support basis functions but restricts computations to a localized subset around each prediction point. As our proposed algorithm is recursive, it can naturally be incorporated into existing algorithms that uses Gaussian process maps for SLAM. Incorporating our proposed algorithm into an extended Kalman filter (EKF) for magnetic field SLAM reduces the overall computational complexity of the algorithm. We show experimentally that our algorithm is faster than existing methods when the mapped area is large and the map is based on many measurements, both for recursive mapping tasks and for magnetic field SLAM.


title: Modeling lens potentials with continuous neural fields in galaxy-scale strong lenses

abstract: Strong gravitational lensing is a unique observational tool for studying the dark and luminous mass distribution both within and between galaxies. Given the presence of substructures, current strong lensing observations demand more complex mass models than smooth analytical profiles, such as power-law ellipsoids. In this work, we introduce a continuous neural field to predict the lensing potential at any position throughout the image plane, allowing for a nearly model-independent description of the lensing mass. We apply our method on simulated Hubble Space Telescope imaging data containing different types of perturbations to a smooth mass distribution: a localized dark subhalo, a population of subhalos, and an external shear perturbation. Assuming knowledge of the source surface brightness, we use the continuous neural field to model either the perturbations alone or the full lensing potential. In both cases, the resulting model is able to fit the imaging data, and we are able to accurately recover the properties of both the smooth potential and of the perturbations. Unlike many other deep learning methods, ours explicitly retains lensing physics (i.e., the lens equation) and introduces high flexibility in the model only where required, namely, in the lens potential. Moreover, the neural network does not require pre-training on large sets of labelled data and predicts the potential from the single observed lensing image. Our model is implemented in the fully differentiable lens modeling code Herculens.


title: A comprehensive review on the ferroelectric orthochromates: Synthesis, property, and application

abstract: Multiferroics represent a class of advanced materials for promising applications and stand at the forefront of modern science for the special feature possessing both charge polar and magnetic order. Previous studies indicate that the family of RECrO3 (RE = rare earth) compounds is likely another rare candidate system holding both ferroelectricity and magnetism. However, many issues remain unsolved, casting hot disputes about whether RECrO3 is multiferroic or not. For example, an incompatibility exists between reported structural models and observed ferroelectric behaviors, and it is not easy to determine the spin canting degree. To address these questions, one key step is to grow single crystals because they can provide more reliable information than other forms of matter do. In this review, the parent and doped ferroelectric YCrO3 compounds are comprehensively reviewed based on scientific and patent literatures from 1954 to 2022. The materials syntheses with different methods, including poly-, nano-, and single-crystalline samples and thin films, are summarized. The structural, magnetic, ferroelectric and dielectric, optical, and chemical-pressure (on Y and Cr sites by doping) dependent chemical and physical properties and the corresponding phase diagrams, are discussed. Diverse (potential) applications, including anti-corrosion, magnetohydrodynamic electrode, catalyst, negative-temperature-coefficient thermistor, magnetic refrigeration, protective coating, and solid oxide fuel cell, are present. To conclude, we summarize general results, reached consensuses, and existing controversies of the past nearly 69 years of intensive studies and highlight future research opportunities and emerging challenges to address existing issues.


title: Data-driven Modeling of Mach-Zehnder Interferometer-based Optical Matrix Multipliers

abstract: Photonic integrated circuits are facilitating the development of optical neural networks, which have the potential to be both faster and more energy efficient than their electronic counterparts since optical signals are especially well-suited for implementing matrix multiplications. However, accurate programming of photonic chips for optical matrix multiplication remains a difficult challenge. Here, we describe both simple analytical models and data-driven models for offline training of optical matrix multipliers. We train and evaluate the models using experimental data obtained from a fabricated chip featuring a Mach-Zehnder interferometer mesh implementing 3-by-3 matrix multiplication. The neural network-based models outperform the simple physics-based models in terms of prediction error. Furthermore, the neural network models are also able to predict the spectral variations in the matrix weights for up to 100 frequency channels covering the C-band. The use of neural network models for programming the chip for optical matrix multiplication yields increased performance on multiple machine learning tasks.


title: The second set of pulsar discoveries by CHIME/FRB/Pulsar: 14 Rotating Radio Transients and 7 pulsars

abstract: The Canadian Hydrogen Mapping Experiment (CHIME) is a radio telescope located in British Columbia, Canada. The large FOV allows CHIME/FRB to be an exceptional pulsar and Rotating Radio Transient (RRAT) finding machine, despite saving only the metadata of incoming Galactic events. We have developed a pipeline to search for pulsar/RRAT candidates using DBSCAN, a clustering algorithm. Follow-up observations are then scheduled with the more sensitive CHIME/Pulsar instrument capable of near-daily high time resolution spectra observations. We have developed the CHIME/Pulsar Single Pulse Pipeline to automate the processing of CHIME/Pulsar search-mode data. We report the discovery of 21 new Galactic sources, with 14 RRATs, 6 isolated long-period pulsars and 1 binary system. Owing to CHIME/Pulsar's observations we have obtained timing solutions for 8 of the 14 RRATs along with all the regular pulsars and the binary system. Notably we report that the binary system is in a long orbit of 412 days with a minimum companion mass of 0.1303 solar masses and no evidence of an optical companion within 10" of the pulsar position. This highlights that working synergistically with CHIME/FRB's large survey volume CHIME/Pulsar can obtain arc second localisations for low burst rate RRATs though pulsar timing. We find that the properties of our newly discovered RRATs are consistent with those of the presently known population. They tend to have lower burst rates than those found in previous surveys, which is likely due to survey bias rather than the underlying population.


title: Visual onoma-to-wave: environmental sound synthesis from visual onomatopoeias and sound-source images

abstract: We propose a method for synthesizing environmental sounds from visually represented onomatopoeias and sound sources. An onomatopoeia is a word that imitates a sound structure, i.e., the text representation of sound. From this perspective, onoma-to-wave has been proposed to synthesize environmental sounds from the desired onomatopoeia texts. Onomatopoeias have another representation: visual-text representations of sounds in comics, advertisements, and virtual reality. A visual onomatopoeia (visual text of onomatopoeia) contains rich information that is not present in the text, such as a long-short duration of the image, so the use of this representation is expected to synthesize diverse sounds. Therefore, we propose visual onoma-to-wave for environmental sound synthesis from visual onomatopoeia. The method can transfer visual concepts of the visual text and sound-source image to the synthesized sound. We also propose a data augmentation method focusing on the repetition of onomatopoeias to enhance the performance of our method. An experimental evaluation shows that the methods can synthesize diverse environmental sounds from visual text and sound-source images.


title: Non-equilibrium Ising Model on a 2D Additive Small-World Network

abstract: In this work, we have studied the Ising model with one- and two-spin flip competing dynamics on a two-dimensional additive small-world network (A-SWN). The system model consists of a $L\times L$ square lattice where each site of the lattice is occupied by a spin variable that interacts with the nearest neighbor spins and it has a certain probability $p$ of being additionally connected at random to one of its farther neighbors. The dynamics present in the system can be defined by the probability $q$ of being in contact with a heat bath at a given temperature $T$ and, at the same time, with a probability of $1-q$ the system is subjected to an external flux of energy into the system. The contact with the heat bath is simulated by one-spin flip according to the Metropolis prescription, while the input of energy is mimicked by the two-spin flip process, involving a simultaneous flipping of a pair of neighboring spins. We have employed Monte Carlo simulations to obtain the thermodynamic quantities of the system, such as, the total $\textrm{m}_{\textrm{L}}^{\textrm{F}}$ and staggered $\textrm{m}_{\textrm{L}}^{\textrm{AF}}$ magnetizations per spin, the susceptibility $\chi_{\textrm{L}}$, and the reduced fourth-order Binder cumulant $\textrm{U}_{\textrm{L}}$. We have built the phase diagram for the stationary states of the model in the plane $T$ versus $q$, showing the existence of two continuous transition lines for each value of $p$: one line between the ferromagnetic $F$ and paramagnetic $P$ phases, and the other line between the $P$ and antiferromagnetic $AF$ phases. Therefore, we have shown that the phase diagram topology changes when $p$ increases. Using the finite-size scaling analysis, we also obtained the critical exponents for the system, where varying the parameter $p$, we have observed a different universality class from the Ising model in the regular square lattice to the A-SWN.


title: Learning Instructions with Unlabeled Data for Zero-Shot Cross-Task Generalization

abstract: Training language models to learn from human instructions for zero-shot cross-task generalization has attracted much attention in NLP communities. Recently, instruction tuning (IT), which fine-tunes a pre-trained language model on a massive collection of tasks described via human-craft instructions, has been shown effective in instruction learning for unseen tasks. However, IT relies on a large amount of human-annotated samples, which restricts its generalization. Unlike labeled data, unlabeled data are often massive and cheap to obtain. In this work, we study how IT can be improved with unlabeled data. We first empirically explore the IT performance trends versus the number of labeled data, instructions, and training tasks. We find it critical to enlarge the number of training instructions, and the instructions can be underutilized due to the scarcity of labeled data. Then, we propose Unlabeled Data Augmented Instruction Tuning (UDIT) to take better advantage of the instructions during IT by constructing pseudo-labeled data from unlabeled plain texts. We conduct extensive experiments to show UDIT's effectiveness in various scenarios of tasks and datasets. We also comprehensively analyze the key factors of UDIT to investigate how to better improve IT with unlabeled data. The code is publicly available at https://github.com/thu-coai/UDIT.


title: Gravitational Quadratic-in-Spin Hamiltonian at NNNLO in the post-Newtonian framework

abstract: We present the result of the quadratic-in-spin interaction Hamiltonian for binary systems of rotating compact objects with generic spins, up to NNNLO corrections within the post-Newtonian expansion. The calculation is performed by employing the effective field theory diagrammatic approach, and it involves Feynman integrals up to three loops, evaluated within the dimensional regularization scheme. The gauge-invariant binding energy and the scattering angle, in special kinematic regimes and spin configurations, are explicitly derived. The results extend our earlier study on the spin-orbit interaction effects.


title: Long-term trends of light pollution assessed from SQM measurements and an empirical atmospheric model

abstract: We present long-term (4-10 years) trends of light pollution observed at 26 locations, covering rural, intermediate and urban sites, including the three major European metropolitan areas of Stockholm, Berlin and Vienna. Our analysis is based on i) night sky brightness (NSB) measurements obtained with Sky Quality Meters (SQMs) and ii) a rich set of atmospheric data products provided by the European Centre for Medium-Range Weather Forecasts. We describe the SQM data reduction routine in which we filter for moon- and clear-sky data and correct for the SQM "aging" effect using an updated version of the twilight method of Puschnig et al. (2021). Our clear-sky, aging-corrected data reveals short- and long-term (seasonal) variations due to atmospheric changes. To assess long-term anthropogenic NSB trends, we establish an empirical atmospheric model via multi-variate penalized linear regression. Our modeling approach allows to quantitatively investigate the importance of different atmospheric parameters, revealing that surface albedo and vegetation have by far the largest impact on zenithal NSB. Additionally, the NSB is sensitive to black carbon and organic matter aerosols at urban and rural sites respectively. Snow depth was found to be important for some sites, while the total column of ozone leaves impact on some rural places. The average increase in light pollution at our 11 rural sites is 1.7 percent per year. At our nine urban sites we measure an increase of 1.8 percent per year and for the remaining six intermediate sites we find an average increase of 3.7 percent per year. These numbers correspond to doubling times of 41, 39 and 19 years. We estimate that our method is capable of detecting trend slopes shallower/steeper than 1.5 percent per year.


title: Amplitude and colour evolution

abstract: Colour evolution and parton branching at the amplitude level have become important theoretical frameworks to improve parton showers, and are algorithms in their own right: they complement shower development by resummation algorithms capable of including interference effects and subleading colour contributions at an unprecedented level. I summarize recent development in the field, focusing on soft gluon evolution, hadronization, and the CVolver framework.


title: Zero-Shot Ranking Socio-Political Texts with Transformer Language Models to Reduce Close Reading Time

abstract: We approach the classification problem as an entailment problem and apply zero-shot ranking to socio-political texts. Documents that are ranked at the top can be considered positively classified documents and this reduces the close reading time for the information extraction process. We use Transformer Language Models to get the entailment probabilities and investigate different types of queries. We find that DeBERTa achieves higher mean average precision scores than RoBERTa and when declarative form of the class label is used as a query, it outperforms dictionary definition of the class label. We show that one can reduce the close reading time by taking some percentage of the ranked documents that the percentage depends on how much recall they want to achieve. However, our findings also show that percentage of the documents that should be read increases as the topic gets broader.


title: The Kitaev honeycomb model on surfaces of genus $g \geq 2$

abstract: We present a construction of the Kitaev honeycomb lattice model on an arbitrary higher genus surface. We first generalize the exact solution of the model based on the Jordan-Wigner fermionization to a surface with genus $g = 2$, and then use this as a basic module to extend the solution to lattices of arbitrary genus. We demonstrate our method by calculating the ground states of the model in both the Abelian doubled $\mathbb{Z}_2$ phase and the non-Abelian Ising topological phase on lattices with the genus up to $g = 6$. We verify the expected ground state degeneracy of the system in both topological phases and further illuminate the role of fermionic parity in the Abelian phase.


title: Bayesian Projection Pursuit Regression

abstract: In projection pursuit regression (PPR), an unknown response function is approximated by the sum of M "ridge functions," which are flexible functions of one-dimensional projections of a multivariate input space. Traditionally, optimization routines are used to estimate the projection directions and ridge functions via a sequential algorithm, and M is typically chosen via cross-validation. We introduce the first Bayesian version of PPR, which has the benefit of accurate uncertainty quantification. To learn the projection directions and ridge functions, we apply novel adaptations of methods used for the single ridge function case (M=1), called the Single Index Model, for which Bayesian implementations do exist; then use reversible jump MCMC to learn the number of ridge functions M. We evaluate the predictive ability of our model in 20 simulation scenarios and for 23 real datasets, in a bake-off against an array of state-of-the-art regression methods. Its effective performance indicates that Bayesian Projection Pursuit Regression is a valuable addition to the existing regression toolbox.


title: Weak lensing in the blue: a counter-intuitive strategy for stratospheric observations

abstract: The statistical power of weak lensing measurements is principally driven by the number of high redshift galaxies whose shapes are resolved. Conventional wisdom and physical intuition suggest this is optimised by deep imaging at long (red or near IR) wavelengths, to avoid losing redshifted Balmer break and Lyman break galaxies. We use the synthetic Emission Line EL-COSMOS catalogue to simulate lensing observations using different filters, from various altitudes. Here were predict the number of exposures to achieve a target z > 0.3 source density, using off-the-shelf and custom filters. Ground-based observations are easily better at red wavelengths, as (more narrowly) are space-based observations. However, we find that SuperBIT, a diffraction-limited observatory operating in the stratosphere, should instead perform its lensing-quality observations at blue wavelengths.


title: On the linear convergence of additive Schwarz methods for the $p$-Laplacian

abstract: We consider additive Schwarz methods for boundary value problems involving the $p$-Laplacian. While existing theoretical estimates suggest a sublinear convergence rate for these methods, empirical evidence from numerical experiments demonstrates a linear convergence rate. In this paper, we narrow the gap between these theoretical and empirical results by presenting a novel convergence analysis. Firstly, we present a new convergence theory for additive Schwarz methods written in terms of a quasi-norm. This quasi-norm exhibits behavior akin to the Bregman distance of the convex energy functional associated with the problem. Secondly, we provide a quasi-norm version of the Poincar'{e}--Friedrichs inequality, which plays a crucial role in deriving a quasi-norm stable decomposition for a two-level domain decomposition setting. By utilizing these key elements, we establish the linear convergence.


title: Packed-Ensembles for Efficient Uncertainty Estimation

abstract: Deep Ensembles (DE) are a prominent approach for achieving excellent performance on key metrics such as accuracy, calibration, uncertainty estimation, and out-of-distribution detection. However, hardware limitations of real-world systems constrain to smaller ensembles and lower-capacity networks, significantly deteriorating their performance and properties. We introduce Packed-Ensembles (PE), a strategy to design and train lightweight structured ensembles by carefully modulating the dimension of their encoding space. We leverage grouped convolutions to parallelize the ensemble into a single shared backbone and forward pass to improve training and inference speeds. PE is designed to operate within the memory limits of a standard neural network. Our extensive research indicates that PE accurately preserves the properties of DE, such as diversity, and performs equally well in terms of accuracy, calibration, out-of-distribution detection, and robustness to distribution shift. We make our code available at https://github.com/ENSTA-U2IS/torch-uncertainty.


title: Characterization of Population III Stars with Stellar Atmosphere and Evolutionary Modeling and Predictions of their Observability with the James Webb Space Telescope

abstract: Population III stars were the first stars to form after the Big Bang, and are believed to have made the earliest contribution to the metal content of the universe beyond the products of the Big Bang Nucleosynthesis. These stars are theorized to have had extremely short lifespans, and therefore would only be observable at high redshifts ($z \geq 3-17$) and faint apparent magnitudes ($m_{AB} \gtrsim 40$). The direct detection of Population III stars therefore remains elusive. However, the recently launched James Webb Space Telescope (JWST) may be capable of detecting stars in the relevant magnitude range in the event of favorable gravitational lensing. Theoretical models are required to interpret these future observations. In this study, new evolutionary models and non-equilibrium model atmospheres were used to characterize the observable properties of zero-age main sequence Population III stars. The calculated models cover a wide range of possible Population III stellar masses, from the minimum mass predicted by star formation studies to the maximum mass capable of maintaining hydrostatic equilibrium. Synthetic photometry and theoretical color-magnitude diagrams were calculated for the bands of the Near-Infrared Camera (NIRCam) on JWST. The final results are compared to the scales of known lensing events and JWST magnitude limits. The purpose of this study is to calculate the observable parameters of Population III stars in the most optimal JWST bands in order to provide a theoretical foundation for anticipated future observations of this stellar population.


title: Implicit models, latent compression, intrinsic biases, and cheap lunches in community detection

abstract: The task of community detection, which aims to partition a network into clusters of nodes to summarize its large-scale structure, has spawned the development of many competing algorithms with varying objectives. Some community detection methods are inferential, explicitly deriving the clustering objective through a probabilistic generative model, while other methods are descriptive, dividing a network according to an objective motivated by a particular application, making it challenging to compare these methods on the same scale. Here we present a solution to this problem that associates any community detection objective, inferential or descriptive, with its corresponding implicit network generative model. This allows us to compute the description length of a network and its partition under arbitrary objectives, providing a principled measure to compare the performance of different algorithms without the need for "ground truth" labels. Our approach also gives access to instances of the community detection problem that are optimal to any given algorithm, and in this way reveals intrinsic biases in popular descriptive methods, explaining their tendency to overfit. Using our framework, we compare a number of community detection methods on artificial networks, and on a corpus of over 500 structurally diverse empirical networks. We find that more expressive community detection methods exhibit consistently superior compression performance on structured data instances, without having degraded performance on a minority of situations where more specialized algorithms perform optimally. Our results undermine the implications of the "no free lunch" theorem for community detection, both conceptually and in practice, since it is confined to unstructured data instances, unlike relevant community detection problems which are structured by requirement.

categories: cs.SI cs.LG physics.data-an physics.soc-ph stat.ML


title: Detection of Nonlinear Behavior in Voltage Source Converter Control in Wind Farms Based on Higher-Order Spectral Analysis

abstract: In recent years, the sub-synchronous oscillation (SSO) accidents caused by wind power have received extensive attention. A method is needed to distinguish if nonlinear behavior exists in the recorded equal-amplitude accident waveforms, so that different methods can be adopted to analyze the mechanism of the oscillation. The theory of higher-order statistics (HOS) has become a powerful tool for detection of nonlinear behavior (DNB) in production quality control since 1960s. However, HOS analysis has been applied in mechanical condition monitoring and fault diagnosis, even after being introduced into the power system and wind farms. This paper focuses on the voltage source converter (VSC) control systems in wind farms and tries to detect the nonlinear behavior caused by the bilateral or unilateral saturation hard limits based on HOS analysis. First, the traditional describing function is extended to obtain more frequency domain information, and hereby the harmonic characteristics of bilateral and the unilateral saturation hard limit are studied. Then the bispectrum and trispectrum are introduced as HOS, which are extended into bicoherence and tricoherence spectrums to eliminate the effects from linear parts in the VSC control system. The effectiveness of DNB and classification based on HOS is strictly proved and its detailed calculation and estimation process is illustrated. Finally, the proposed method is demonstrated and further discussed through simulation results.


title: Sub-8-bit quantization for on-device speech recognition: a regularization-free approach

abstract: For on-device automatic speech recognition (ASR), quantization aware training (QAT) is ubiquitous to achieve the trade-off between model predictive performance and efficiency. Among existing QAT methods, one major drawback is that the quantization centroids have to be predetermined and fixed. To overcome this limitation, we introduce a regularization-free, "soft-to-hard" compression mechanism with self-adjustable centroids in a mu-Law constrained space, resulting in a simpler yet more versatile quantization scheme, called General Quantizer (GQ). We apply GQ to ASR tasks using Recurrent Neural Network Transducer (RNN-T) and Conformer architectures on both LibriSpeech and de-identified far-field datasets. Without accuracy degradation, GQ can compress both RNN-T and Conformer into sub-8-bit, and for some RNN-T layers, to 1-bit for fast and accurate inference. We observe a 30.73% memory footprint saving and 31.75% user-perceived latency reduction compared to 8-bit QAT via physical device benchmarking.


title: On the regularity of conical Calabi-Yau potentials

abstract: Using pluripotential theory on degenerate Sasakian manifolds, we show that a locally bounded conical Calabi-Yau potential on a Fano cone is actually smooth on the regular locus. This work is motivated by a similar result obtained by R. Berman in the case where the cone is toric. Our proof is purely pluripotential and independent of any extra symmetry imposed on the cone.


title: Optimizing intermodal transportation networks at scale via column generation

abstract: In light of the need for design and analysis of intermodal transportation systems, we propose an algorithmic framework to determine the system optimum of an intermodal transportation system. To this end, we model an intermodal transportation system by combining two core principles of network optimization - layered-graph structures and (partially) time-expanded networks - to formulate our problem on a graph that allows us to implicitly encode problem specific constraints related to intermodality. This enables us to solve a standard integer minimum-cost multi-commodity flow problem to obtain the system optimum for an intermodal transportation system. To solve this integer minimum-cost multi-commodity flow problem efficiently, we present a column generation approach to find continuous minimum-cost multi-commodity flow solutions, which we combine with a price-and-branch procedure to obtain integer solutions. To speed up our column generation, we further develop a pricing filter and an admissible distance approximation to utilize the $A^*$ algorithm for solving the pricing problems. We show the efficiency of our framework by applying it to a real-world case study for the city of Munich, where we solve instances with up to 56,295 passengers to optimality, and show that the computation time of our algorithm can be reduced by up to 60\% through the use of our pricing filter and by up to additional 90\% through the use of the $A^*$-based pricing algorithm.


title: Escaping barren plateaus in approximate quantum compiling

abstract: Quantum compilation provides a method to translate quantum algorithms at a high level of abstraction into their implementations as quantum circuits on real hardware. One approach to quantum compiling is to design a parameterised circuit and to use techniques from optimisation to find the parameters that minimise the distance between the parameterised circuit and the target circuit of interest. While promising, such an approach typically runs into the obstacle of barren plateaus - i.e. large regions of parameter space in which the gradient vanishes. A number of recent works focusing on so-called quantum assisted quantum compiling have developed new techniques to induce gradients in some particular cases. Here we develop and implement a set of related techniques such that they can be applied to classically assisted quantum compiling. We consider both approximate state preparation and approximate circuit preparation and show that, in both cases, we can significantly improve convergence with the approach developed in this work.


title: Dirac sea effects on Heavy Quarkonia decay widths in magnetized matter -- a field theoretic model of composite hadrons

abstract: We study the partial decay widths of charmonium (bottomonium) states to ${\rm D\bar D \; (B\bar B)}$ mesons in magnetized (nuclear) matter using a field theoretical model of composite hadrons with quark (and antiquark) constituents. These are computed from the mass modifications of the decaying and produced mesons within a chiral effective model, including the nucleon Dirac sea effects. The mass modifications of the open charm (bottom) mesons are calculated from their interactions with the nucleons and the scalar mesons, whereas the mass shift of the heavy quarkonium state is obtained from the medium change of a scalar dilaton field, $\chi$, which mimics the gluon condensates of QCD. The Dirac sea contributions are observed to lead to a rise (drop) in the quark condensates as the magnetic field is increased, an effect called the (inverse) magnetic catalysis. These effects are observed to be significant and the anomalous magnetic moments (AMMs) of the nucleons are observed to play an important role. For $\rho_B$=0, there is observed to be magnetic catalysis (MC) without and with AMMs, whereas, for $\rho_B=\rho_0$, the inverse magnetic catalysis (IMC) is observed when the AMMs are taken into account, contrary to MC, when the AMMs are ignored. In the presence of a magnetic field, there are also mixings of spin 0 (pseudoscalar) and spin 1 (vector) states (PV mixing) which modify the masses of these mesons. The magnetic field effects on the heavy quarkonium decay widths should have observable consequences on the production the heavy flavour mesons, which are created in the early stage of ultra-relativistic peripheral heavy ion collisions, at RHIC and LHC, when the produced magnetic fields can still be extremely large.


title: Quasi-Tempered Automorphic D-modules

abstract: In this paper, we introduce the category of quasi-tempered automorphic D-modules, which is a rather natural class of D-modules from the point of view of geometric Langlands. We provide a characterization of this category in terms of singular support, and as a consequence, we obtain certain microlocal categorical K\"unneth formulas.


title: Marksman Backdoor: Backdoor Attacks with Arbitrary Target Class

abstract: In recent years, machine learning models have been shown to be vulnerable to backdoor attacks. Under such attacks, an adversary embeds a stealthy backdoor into the trained model such that the compromised models will behave normally on clean inputs but will misclassify according to the adversary's control on maliciously constructed input with a trigger. While these existing attacks are very effective, the adversary's capability is limited: given an input, these attacks can only cause the model to misclassify toward a single pre-defined or target class. In contrast, this paper exploits a novel backdoor attack with a much more powerful payload, denoted as Marksman, where the adversary can arbitrarily choose which target class the model will misclassify given any input during inference. To achieve this goal, we propose to represent the trigger function as a class-conditional generative model and to inject the backdoor in a constrained optimization framework, where the trigger function learns to generate an optimal trigger pattern to attack any target class at will while simultaneously embedding this generative backdoor into the trained model. Given the learned trigger-generation function, during inference, the adversary can specify an arbitrary backdoor attack target class, and an appropriate trigger causing the model to classify toward this target class is created accordingly. We show empirically that the proposed framework achieves high attack performance while preserving the clean-data performance in several benchmark datasets, including MNIST, CIFAR10, GTSRB, and TinyImageNet. The proposed Marksman backdoor attack can also easily bypass existing backdoor defenses that were originally designed against backdoor attacks with a single target class. Our work takes another significant step toward understanding the extensive risks of backdoor attacks in practice.


title: The topology of compact rank-one ECS manifolds

abstract: Pseudo-Riemannian manifolds with parallel Weyl tensor that are not conformally flat or locally symmetric, also known as ECS manifolds, have a natural local invariant, the rank, which equals 1 or 2, and is the dimension of a certain distinguished null parallel distribution $\,\mathcal{D}$. All known examples of compact ECS manifolds are of rank one and have dimensions greater than 4. We prove that a compact rank-one ECS manifold, if not locally homogeneous, replaced when necessary by a two-fold isometric covering, must be a bundle over the circle with leaves of $\,\mathcal{D}^\perp$ serving as the fibres. The same conclusion holds in the locally-homogeneous case if one assumes that $\,\mathcal{D}^\perp$ has at least one compact leaf. We also show that in the pseudo-Riemannian universal covering space of any compact rank-one ECS manifold the leaves of $\,\mathcal{D}^\perp$ are the factor manifolds of a global product decomposition.


title: Efficient Parallelization of 5G-PUSCH on a Scalable RISC-V Many-core Processor

abstract: 5G Radio access network disaggregation and softwarization pose challenges in terms of computational performance to the processing units. At the physical layer level, the baseband processing computational effort is typically offloaded to specialized hardware accelerators. However, the trend toward software-defined radio-access networks demands flexible, programmable architectures. In this paper, we explore the software design, parallelization and optimization of the key kernels of the lower physical layer (PHY) for physical uplink shared channel (PUSCH) reception on MemPool and TeraPool, two manycore systems having respectively 256 and 1024 small and efficient RISC-V cores with a large shared L1 data memory. PUSCH processing is demanding and strictly time-constrained, it represents a challenge for the baseband processors, and it is also common to most of the uplink channels. Our analysis thus generalizes to the entire lower PHY of the uplink receiver at gNodeB (gNB). Based on the evaluation of the computational effort (in multiply-accumulate operations) required by the PUSCH algorithmic stages, we focus on the parallel implementation of the dominant kernels, namely fast Fourier transform, matrix-matrix multiplication, and matrix decomposition kernels for the solution of linear systems. Our optimized parallel kernels achieve respectively on MemPool and TeraPool speedups of 211, 225, 158, and 762, 880, 722, at high utilization (0.81, 0.89, 0.71, and 0.74, 0.88, 0.71), comparable a single-core serial execution, moving a step closer toward a full-software PUSCH implementation.


title: On the Impact of Temporal Concept Drift on Model Explanations

abstract: Explanation faithfulness of model predictions in natural language processing is typically evaluated on held-out data from the same temporal distribution as the training data (i.e. synchronous settings). While model performance often deteriorates due to temporal variation (i.e. temporal concept drift), it is currently unknown how explanation faithfulness is impacted when the time span of the target data is different from the data used to train the model (i.e. asynchronous settings). For this purpose, we examine the impact of temporal variation on model explanations extracted by eight feature attribution methods and three select-then-predict models across six text classification tasks. Our experiments show that (i)faithfulness is not consistent under temporal variations across feature attribution methods (e.g. it decreases or increases depending on the method), with an attention-based method demonstrating the most robust faithfulness scores across datasets; and (ii) select-then-predict models are mostly robust in asynchronous settings with only small degradation in predictive performance. Finally, feature attribution methods show conflicting behavior when used in FRESH (i.e. a select-and-predict model) and for measuring sufficiency/comprehensiveness (i.e. as post-hoc methods), suggesting that we need more robust metrics to evaluate post-hoc explanation faithfulness.


title: Pixel-Aligned Non-parametric Hand Mesh Reconstruction

abstract: Non-parametric mesh reconstruction has recently shown significant progress in 3D hand and body applications. In these methods, mesh vertices and edges are visible to neural networks, enabling the possibility to establish a direct mapping between 2D image pixels and 3D mesh vertices. In this paper, we seek to establish and exploit this mapping with a simple and compact architecture. The network is designed with these considerations: 1) aggregating both local 2D image features from the encoder and 3D geometric features captured in the mesh decoder; 2) decoding coarse-to-fine meshes along the decoding layers to make the best use of the hierarchical multi-scale information. Specifically, we propose an end-to-end pipeline for hand mesh recovery tasks which consists of three phases: a 2D feature extractor constructing multi-scale feature maps, a feature mapping module transforming local 2D image features to 3D vertex features via 3D-to-2D projection, and a mesh decoder combining the graph convolution and self-attention to reconstruct mesh. The decoder aggregate both local image features in pixels and geometric features in vertices. It also regresses the mesh vertices in a coarse-to-fine manner, which can leverage multi-scale information. By exploiting the local connection and designing the mesh decoder, Our approach achieves state-of-the-art for hand mesh reconstruction on the public FreiHAND dataset.


title: Ordering kinetics in active polar fluid

abstract: We model the active polar fluid as a collection of orientable objects supplied with active stresses and momentum damping coming from the viscosity of bulk fluid medium. The growth kinetics of local orientation field is studied. The effect of active fluid is contractile or extensile depending upon the sign of the active stress. We explore the growth kinetics for different activities. We observe that for both extensile and contractile cases the growth is altered by a prefactor when compared to the equilibrium Model A. We find that the extensile fluid enhances the domain growth whereas the contractile fluid supresses it. The asymptotic growth becomes pure algebraic for large magnitudes of activity. We also find that the domain morphology remains unchanged due to activity and system shows the good dynamic scaling for all activities. Our study provides the understanding of ordering kinetics in active polar gel.


title: Synchronization in a multilevel network using the Hamilton-Jacobi-Bellman (HJB) technique

abstract: This paper presents the optimal control and synchronization problem of a multilevel network of R\"ossler chaotic oscillators. Using the Hamilton-Jacobi-Bellman (HJB) technique, the optimal control law with three-state variables feedback is designed such that the trajectories of all the R\"ossler oscillators in the network are optimally synchronized in each level. Furthermore, we provide numerical simulations to demonstrate the effectiveness of the proposed approach for the cases of one and three networks. A perfect correlation between the MATLAB and the PSPICE results was obtained, thus allowing the experimental validation of our designed controller and shows the effectiveness of the theoretical results.


title: On the optimal control of kinetic epidemic models with uncertain social features

abstract: It is recognized that social heterogeneities in terms of the contact distribution have a strong influence on the spread of infectious diseases. Nevertheless, few data are available on the group composition of social contacts, and their statistical description does not possess universal patterns and may vary spatially and temporally. It is therefore essential to design robust control strategies, mimicking the effects of non-pharmaceutical interventions, to limit efficiently the number of infected cases. In this work, starting from a recently introduced kinetic model for epidemiological dynamics that takes into account the impact of social contacts of individuals, we consider an uncertain contact formation dynamics leading to slim-tailed as well as fat-tailed distributions of contacts. Hence, we analyse the effects of an optimally robust control strategy of the system of agents. Thanks to classical methods of kinetic theory, we couple uncertainty quantification methods with the introduced mathematical model to assess the effects of social limitations. Finally, using the proposed modelling approach and starting from available data, we show the effectiveness of the proposed selective measures to dampen uncertainties together with the epidemic trends.


title: High-efficiency Blockchain-based Supply Chain Traceability

abstract: Supply chain traceability refers to product tracking from the source to customers, demanding transparency, authenticity, and high efficiency. In recent years, blockchain has been widely adopted in supply chain traceability to provide transparency and authenticity, while the efficiency issue is understudied. In practice, as the numerous product records accumulate, the time- and storage- efficiencies will decrease remarkably. To the best of our knowledge, this paper is the first work studying the efficiency issue in blockchain-based supply chain traceability. Compared to the traditional method, which searches the records stored in a single chunk sequentially, we replicate the records in multiple chunks and employ parallel search to boost the time efficiency. However, allocating the record searching primitives to the chunks with maximized parallelization ratio is challenging. To this end, we model the records and chunks as a bipartite graph and solve the allocation problem using a maximum matching algorithm. The experimental results indicate that the time overhead can be reduced by up to 85.1% with affordable storage overhead.


title: On torsion in linearized Legendrian contact homology

abstract: In this short note we discuss certain examples of Legendrian submanifolds, whose linearized Legendrian contact (co)homology groups over integers have non-vanishing algebraic torsion. More precisely, for a given arbitrary finitely generated abelian group $G$ and a positive integer $n\geq 3$, $n\neq 4$, we construct examples of Legendrian submanifolds of the standard contact vector space $\mathbb R^{2n+1}$, whose $n-1$-th linearized Legendrian contact (co)homology over $\mathbb Z$ computed with respect to a certain augmentation is isomorphic to $G$.


title: ArtFacePoints: High-resolution Facial Landmark Detection in Paintings and Prints

abstract: Facial landmark detection plays an important role for the similarity analysis in artworks to compare portraits of the same or similar artists. With facial landmarks, portraits of different genres, such as paintings and prints, can be automatically aligned using control-point-based image registration. We propose a deep-learning-based method for facial landmark detection in high-resolution images of paintings and prints. It divides the task into a global network for coarse landmark prediction and multiple region networks for precise landmark refinement in regions of the eyes, nose, and mouth that are automatically determined based on the predicted global landmark coordinates. We created a synthetically augmented facial landmark art dataset including artistic style transfer and geometric landmark shifts. Our method demonstrates an accurate detection of the inner facial landmarks for our high-resolution dataset of artworks while being comparable for a public low-resolution artwork dataset in comparison to competing methods.


title: Interpretations of the cosmic ray secondary-to-primary ratios measured by DAMPE

abstract: Precise measurements of the boron-to-carbon and boron-to-oxygen ratios by DAMPE show clear hardenings around $100$ GeV/n, which provide important implications on the production, propagation, and interaction of Galactic cosmic rays. In this work we investigate a number of models proposed in literature in light of the DAMPE findings. These models can roughly be classified into two classes, driven by propagation effects or by source ones. Among these models discussed, we find that the re-acceleration of cosmic rays, during their propagation, by random magnetohydrodynamic waves may not reproduce sufficient hardenings of B/C and B/O, and an additional spectral break of the diffusion coefficient is required. The other models can properly explain the hardenings of the ratios. However, depending on simplifications assumed, the models differ in their quality in reproducing the data in a wide energy range. The models with significant re-acceleration effect will under-predict low-energy antiprotons but over-predict low-energy positrons, and the models with secondary production at sources over-predict high-energy antiprotons. For all models high-energy positron excess exists.


title: Model Predictive Control via On-Policy Imitation Learning

abstract: In this paper, we leverage the rapid advances in imitation learning, a topic of intense recent focus in the Reinforcement Learning (RL) literature, to develop new sample complexity results and performance guarantees for data-driven Model Predictive Control (MPC) for constrained linear systems. In its simplest form, imitation learning is an approach that tries to learn an expert policy by querying samples from an expert. Recent approaches to data-driven MPC have used the simplest form of imitation learning known as behavior cloning to learn controllers that mimic the performance of MPC by online sampling of the trajectories of the closed-loop MPC system. Behavior cloning, however, is a method that is known to be data inefficient and suffer from distribution shifts. As an alternative, we develop a variant of the forward training algorithm which is an on-policy imitation learning method proposed by Ross et al. (2010). Our algorithm uses the structure of constrained linear MPC, and our analysis uses the properties of the explicit MPC solution to theoretically bound the number of online MPC trajectories needed to achieve optimal performance. We validate our results through simulations and show that the forward training algorithm is indeed superior to behavior cloning when applied to MPC.


title: Gradient estimates and the fundamental solution for higher-order elliptic systems with lower-order terms

abstract: We establish the Caccioppoli inequality, a reverse H\"older inequality in the spirit of the classic estimate of Meyers, and construct the fundamental solution for linear elliptic differential equations of order $2m$ with certain lower order terms.


title: Chebyshev pseudosite matrix product state approach for the spectral functions of electron-phonon coupling systems

abstract: The electron-phonon ($e$-ph) coupling system often has a large number of phonon degrees of freedom, whose spectral functions are numerically difficult to compute using matrix product state (MPS) formalisms. To solve this problem, we propose a new and practical method that combines the Chebyshev MPS and the pseudosite density matrix renormalization group (DMRG) algorithm. The Chebyshev vector is represented by a pseudosite MPS with global $U(1)$ fermion symmetry, which maps $2^{N_p}$ bosonic degrees of freedom onto $N_p$ pseudosites, each with two states. This approach can handle arbitrary $e$-ph coupling Hamiltonians where pseudosite DMRG performs efficiently. We use this method to study the spectral functions of the doped extended Hubbard-Holstein model in a regime of strong Coulomb repulsion, which has not been studied extensively before. Key features of the excitation spectra are captured at a modest computational cost. Our results show that weak extended $e$-ph couplings can increase the spectral weight of the holon-folding branch at low phonon frequencies, in agreement with angle-resolved photoemission observations on one-dimensional (1D) cuprates.


title: $K$-theory of non-commutative Bernoulli Shifts

abstract: For a large class of C*-algebras $A$, we calculate the $K$-theory of reduced crossed products $A^{\otimes G}\rtimes_rG$ of Bernoulli shifts by groups satisfying the Baum--Connes conjecture. In particular, we give explicit formulas for finite-dimensional C*-algebras, UHF-algebras, rotation algebras, and several other examples. As an application, we obtain a formula for the $K$-theory of reduced C*-algebras of wreath products $H\wr G$ for large classes of groups $H$ and $G$. Our methods use a generalization of techniques developed by the second named author together with Joachim Cuntz and Xin Li, and a trivialization theorem for finite group actions on UHF algebras developed in a companion paper by the third and fourth named authors.


title: Ultrafast laser-driven topological spin textures on a 2D magnet

abstract: Ultrafast laser excitations provide an efficient and low-power consumption alternative since different magnetic properties and topological spin states can be triggered and manipulated at the femtosecond (fs) regime. However, it is largely unknown whether laser excitations already used in data information platforms can manipulate the magnetic properties of recently discovered two-dimensional (2D) van der Waals (vdW) materials. Here we show that ultrashort laser pulses (30$-$85 fs) can not only manipulate magnetic domains of 2D-XY CrCl$_3$ ferromagnets, but also induce the formation and control of topological nontrivial meron and antimeron spin textures. We observed that these spin quasiparticles are created within $\sim$100 ps after the excitation displaying rich dynamics through motion, collision and annihilation with emission of spin waves throughout the surface. Our findings highlight substantial opportunities of using photonic driving forces for the exploration of spin textures on 2D magnetic materials towards magneto-optical topological applications.

categories: cond-mat.mtrl-sci cond-mat.mes-hall cond-mat.other cond-mat.str-el


title: Conditional Neural Processes for Molecules

abstract: Neural processes (NPs) are models for transfer learning with properties reminiscent of Gaussian Processes (GPs). They are adept at modelling data consisting of few observations of many related functions on the same input space and are trained by minimizing a variational objective, which is computationally much less expensive than the Bayesian updating required by GPs. So far, most studies of NPs have focused on low-dimensional datasets which are not representative of realistic transfer learning tasks. Drug discovery is one application area that is characterized by datasets consisting of many chemical properties or functions which are sparsely observed, yet depend on shared features or representations of the molecular inputs. This paper applies the conditional neural process (CNP) to DOCKSTRING, a dataset of docking scores for benchmarking ML models. CNPs show competitive performance in few-shot learning tasks relative to supervised learning baselines common in chemoinformatics, as well as an alternative model for transfer learning based on pre-training and refining neural network regressors. We present a Bayesian optimization experiment which showcases the probabilistic nature of CNPs and discuss shortcomings of the model in uncertainty quantification.


title: Robust digital optimal control on IBM quantum computers

abstract: The ability of pulse-shaping devices to generate accurately quantum optimal control is a strong limitation to the development of quantum technologies. We propose and demonstrate a systematic procedure to design robust digital control processes adapted to such experimental constraints. We show to what extent this digital pulse can be obtained from its continuous-time counterpart. A remarkable efficiency can be achieved even for a limited number of pulse parameters. We experimentally implement the protocols on IBM quantum computers for a single qubit, obtaining an optimal robust transfer in a time T = 382 ns.


title: Segmentation-guided Domain Adaptation for Efficient Depth Completion

abstract: Complete depth information and efficient estimators have become vital ingredients in scene understanding for automated driving tasks. A major problem for LiDAR-based depth completion is the inefficient utilization of convolutions due to the lack of coherent information as provided by the sparse nature of uncorrelated LiDAR point clouds, which often leads to complex and resource-demanding networks. The problem is reinforced by the expensive aquisition of depth data for supervised training. In this work, we propose an efficient depth completion model based on a vgg05-like CNN architecture and propose a semi-supervised domain adaptation approach to transfer knowledge from synthetic to real world data to improve data-efficiency and reduce the need for a large database. In order to boost spatial coherence, we guide the learning process using segmentations as additional source of information. The efficiency and accuracy of our approach is evaluated on the KITTI dataset. Our approach improves on previous efficient and low parameter state of the art approaches while having a noticeably lower computational footprint.


title: Strong-Field QED Experiments using the BELLA PW Laser Dual Beamlines

abstract: The Petawatt (PW) laser facility of the Berkeley Lab Laser Accelerator (BELLA) Center has recently commissioned its second laser pulse transport line. This new beamline can be operated in parallel with the first beamline and enables strong-field quantum electrodynamics (SF-QED) experiments at BELLA. In this paper, we present an overview of the upgraded BELLA PW facility with a SF-QED experimental layout in which intense laser pulses collide with GeV-class laser-wakefield-accelerated electron beams. We present simulation results showing that experiments will allow the study of laser-particle interactions from the classical to the SF-QED regime with a nonlinear quantum parameter of up to $\chi\sim$2. In addition, we show that experiments will enable the study and production of GeV-class, mrad-divergence positron beams via the Breit-Wheeler process.


title: A Systematic Review of Machine Learning Techniques for Cattle Identification: Datasets, Methods and Future Directions

abstract: Increased biosecurity and food safety requirements may increase demand for efficient traceability and identification systems of livestock in the supply chain. The advanced technologies of machine learning and computer vision have been applied in precision livestock management, including critical disease detection, vaccination, production management, tracking, and health monitoring. This paper offers a systematic literature review (SLR) of vision-based cattle identification. More specifically, this SLR is to identify and analyse the research related to cattle identification using Machine Learning (ML) and Deep Learning (DL). For the two main applications of cattle detection and cattle identification, all the ML based papers only solve cattle identification problems. However, both detection and identification problems were studied in the DL based papers. Based on our survey report, the most used ML models for cattle identification were support vector machine (SVM), k-nearest neighbour (KNN), and artificial neural network (ANN). Convolutional neural network (CNN), residual network (ResNet), Inception, You Only Look Once (YOLO), and Faster R-CNN were popular DL models in the selected papers. Among these papers, the most distinguishing features were the muzzle prints and coat patterns of cattle. Local binary pattern (LBP), speeded up robust features (SURF), scale-invariant feature transform (SIFT), and Inception or CNN were identified as the most used feature extraction methods.


title: Creation of non-classical states of light in a chiral waveguide

abstract: Creating non-classical states of light from simple quantum systems together with classical resources is a challenging problem. We show how chiral emitters under a coherent drive can generate non-classical photon states. For our analysis, we select a specific temporal mode in the transmitted light field, resulting in a coupled master equation for the relevant mode and the chiral emitters. We characterise the mode's state by its Wigner function and show that the emission from the system predominantly produces mixtures of few-photon-added coherent states. We argue that these non-classical states are experimentally accessible and show their application for quantum metrology.


title: Statistical learning methods for neuroimaging data analysis with applications

abstract: The aim of this paper is to provide a comprehensive review of statistical challenges in neuroimaging data analysis from neuroimaging techniques to large-scale neuroimaging studies to statistical learning methods. We briefly review eight popular neuroimaging techniques and their potential applications in neuroscience research and clinical translation. We delineate the four common themes of neuroimaging data and review major image processing analysis methods for processing neuroimaging data at the individual level. We briefly review four large-scale neuroimaging-related studies and a consortium on imaging genomics and discuss four common themes of neuroimaging data analysis at the population level. We review nine major population-based statistical analysis methods and their associated statistical challenges and present recent progress in statistical methodology to address these challenges.


title: Collision-induced flavor instability in dense neutrino gases with energy-dependent scattering

abstract: We investigate the collision-induced flavor instability in homogeneous, isotropic, dense neutrino gases in the two-flavor mixing scenario with energy-dependent scattering. We uncover a simple expression of the growth rate of this instability in terms of the flavor-decohering collision rates and the electron lepton number distribution of the neutrino. This growth rate is common to the neutrinos and antineutrinos of different energies, and is independent of the mass-splitting and vacuum mixing angle of the neutrino, the matter density, and the neutrino density, although the initial amplitude of the unstable oscillation mode can be suppressed by a large matter density. Our results suggest that neutrinos are likely to experience collision-induced flavor conversions deep inside a core-collapse supernova even when both the fast and slow collective flavor oscillations are suppressed.


title: Venus boundary layer dynamics: eolian transport and convective vortex

abstract: Few spacecraft have studied the dynamics of Venus' deep atmosphere, which is needed to understand the interactions between the surface and atmosphere. Recent global simulations suggest a strong effect of the diurnal cycle of surface winds on the depth of the planetary boundary layer. We propose to use a turbulent-resolving model to characterize the Venus boundary layer and the impact of surface winds for the first time. Simulations were performed in the low plain and high terrain at the Equator and noon and midnight. A strong diurnal cycle is resolved in the high terrain, with a convective layer reaching 7 km above the local surface and vertical wind of 1.3 m/s. The boundary layer depth in the low plain is consistent with the observed wavelength of the dune fields. At noon, the resolved surface wind field for both locations is strong enough to lift dust particles and engender micro-dunes. Convective vortices are resolved for the first time on Venus.


title: A Saccaded Visual Transformer for General Object Spotting

abstract: This paper presents the novel combination of a visual transformer style patch classifier with saccaded local attention. A novel optimisation paradigm for training object models is also presented, rather than the optimisation function minimising class membership probability error the network is trained to estimate the normalised distance to the centroid of labelled objects. This approach builds a degree of transnational invariance directly into the model and allows fast saccaded search with gradient ascent to find object centroids. The resulting saccaded visual transformer is demonstrated on human faces.