title: On Hill's Worst-Case Guarantee for Indivisible Bads

abstract: When allocating objects among agents with equal rights, people often evaluate the fairness of an allocation rule by comparing their received utilities to a benchmark share - a function only of her own valuation and the number of agents. This share is called a guarantee if for any profile of valuations there is an allocation ensuring the share of every agent. When the objects are indivisible goods, Budish [J. Political Econ., 2011] proposed MaxMinShare, i.e., the least utility of a bundle in the best partition of the objects, which is unfortunately not a guarantee. Instead, an earlier pioneering work by Hill [Ann. Probab., 1987] proposed for a share the worst-case MaxMinShare over all valuations with the same largest possible single-object value. Although Hill's share is more conservative than the MaxMinShare, it is an actual guarantee and its computation is elementary, unlike that of the MaxMinShare which involves solving an NP-hard problem. We apply Hill's approach to the allocation of indivisible bads (objects with disutilities or costs), and characterise the tight closed form of the worst-case MinMaxShare for a given value of the worst bad. We argue that Hill's share for allocating bads is effective in the sense of being close to the original MinMaxShare value, and there is much to learn about the guarantee an agent can be offered from the disutility of her worst single bad. Furthermore, we prove that the monotonic cover of Hill's share is the best guarantee that can be achieved in Hill's model for all allocation instances.


title: Galois Points and Cremona Transformations

abstract: In this article, we study Galois points of plane curves and the extension of the corresponding Galois group to $\mathrm{Bir}(\mathbb{P}^2)$. If the Galois group has order at most $3$, we prove that it always extends to a subgroup of the Jonqui\`eres group associated to the point $P$. In degree at least $4$, we prove that it is false. We provide an example of a Galois extension whose Galois group is extendable to Cremona transformations but not to a group of de Jonqui\`eres maps with respect to $P$. We also give an example of a Galois extension whose Galois group cannot be extended to Cremona transformations.


title: Privacy Dashboards for Citizens and corresponding GDPR Services for Small Data Holders: A Literature Review

abstract: Citizens have gained many rights with the GDPR, e.g. the right to get a copy of their personal data. In practice, however, this is fraught with problems for citizens and small data holders. We present a literature review on solutions promising relief in the form of privacy dashboards for citizens and GDPR services for small data holders. Covered topics are analyzed, categorized and compared. This is ought to be a step towards both enabling citizens to exercise their GDPR rights and supporting small data holders to comply with their GDPR duties.


title: Evaluating TCFD Reporting: A New Application of Zero-Shot Analysis to Climate-Related Financial Disclosures

abstract: We examine climate-related disclosures in a large sample of reports published by banks that officially endorsed the recommendations of the Task Force for Climate-related Financial Disclosures (TCFD). In doing so, we introduce a new application of the zero-shot text classification. By developing a set of fine-grained TCFD labels, we show that zero-shot analysis is a useful tool for classifying climate-related disclosures without further model training. Overall, our findings indicate that corporate climate-related disclosures grew dynamically after the launch of the TCFD recommendations. However, there are marked differences in the extent of reporting by recommended disclosure topic, suggesting that some recommendations have not yet been fully met. Our findings yield important conclusions for the design of climate-related disclosure frameworks.


title: Observation of Acoustically Induced Dressed States of Rare-Earth Ions

abstract: Acoustically induced dressed states of long-lived erbium ions in a crystal are demonstrated. These states are formed by rapid modulation of two-level systems via strain induced by surface acoustic waves whose frequencies exceed the optical linewidth of the ion ensemble. Multiple sidebands and the reduction of their intensities appearing near the surface are evidence of a strong interaction between the acoustic waves and the ions. This development allows for on-chip control of long-lived ions and paves the way to highly coherent hybrid quantum systems with telecom photons, acoustic phonons, and electrons.


title: Learning Functional Transduction

abstract: Research in machine learning has polarized into two general approaches for regression tasks: Transductive methods construct estimates directly from available data but are usually problem unspecific. Inductive methods can be much more specific but generally require compute-intensive solution searches. In this work, we propose a hybrid approach and show that transductive regression principles can be meta-learned through gradient descent to form efficient in-context neural approximators by leveraging the theory of vector-valued Reproducing Kernel Banach Spaces (RKBS). We apply this approach to function spaces defined over finite and infinite-dimensional spaces (function-valued operators) and show that once trained, the Transducer can almost instantaneously capture an infinity of functional relationships given a few pairs of input and output examples and return new image estimates. We demonstrate the benefit of our meta-learned transductive approach to model complex physical systems influenced by varying external factors with little data at a fraction of the usual deep learning training computational cost for partial differential equations and climate modeling applications.


title: Effective divisors on projectivized Hodge bundles and modular forms

abstract: We construct vector-valued modular forms on moduli spaces of curves and abelian varieties using effective divisors in projectivized Hodge bundles over moduli of curves. Cycle relations tell us the weight of these modular forms. In particular we construct basic modular forms for genus $2$ and $3$. We also discuss modular forms on the moduli of hyperelliptic curves. In that case the relative canonical bundle is a pull back of a line bundle on a ${\mathbb P}^1$-bundle over the moduli of hyperelliptic curves and we extend that line bundle to a compactification so that its push down is (close to) the Hodge bundle and use this to construct modular forms. In an appendix we use our method to calculate divisor classes in the dual projectivized $k$-Hodge bundle determined by Gheorghita-Tarasca and by Korotkin-Sauvaget-Zograf.


title: Prioritizing Speech Test Cases

abstract: With the wide adoption of automated speech recognition (ASR) systems, it is increasingly important to test and improve ASR systems. However, collecting and executing speech test cases is usually expensive and time-consuming, motivating us to strategically prioritize speech test cases. A key question is: how to determine the ideal order of collecting and executing speech test cases to uncover more errors as early as possible? Each speech test case consists of a piece of audio and the corresponding reference text. In this work, we propose PROPHET (PRiOritizing sPeecH tEsT), a tool that predicts potential error-uncovering speech test cases only based on their reference texts. Thus, PROPHET analyzes test cases and prioritizes them without running the ASR system, which can analyze speech test cases at a large scale. We evaluate 6 different prioritization methods on 3 ASR systems and 12 datasets. Given the same testing budget, we find that our approach uncovers 12.63% more wrongly recognized words than the state-of-the-art method. We select test cases from the prioritized list to fine-tune ASR systems and analyze how our approach can improve the ASR system performance. Statistical tests show that our proposed method can bring significantly larger performance improvement to ASR systems than the existing baseline methods. Furthermore, we perform correlation analysis and confirm that fine-tuning an ASR system using a dataset, on which the model performs worse, tends to improve the performance more.


title: Exogenous time-varying covariates in double additive cure survival model with application to fertility

abstract: Extended cure survival models enable to separate covariates that affect the probability of an event (or `long-term' survival) from those only affecting the event timing (or `short-term' survival). We propose to generalize the bounded cumulative hazard model to handle additive terms for time-varying (exogenous) covariates jointly impacting long- and short-term survival. The selection of the penalty parameters is a challenge in that framework. A fast algorithm based on Laplace approximations in Bayesian P-spline models is proposed. The methodology is motivated by fertility studies where women's characteristics such as the employment status and the income (to cite a few) can vary in a non-trivial and frequent way during the individual follow-up. The method is furthermore illustrated by drawing on register data from the German Pension Fund which enabled us to study how women's time-varying earnings relate to first birth transitions.


title: iPAL: A Machine Learning Based Smart Healthcare Framework For Automatic Diagnosis Of Attention Deficit/Hyperactivity Disorder (ADHD)

abstract: ADHD is a prevalent disorder among the younger population. Standard evaluation techniques currently use evaluation forms, interviews with the patient, and more. However, its symptoms are similar to those of many other disorders like depression, conduct disorder, and oppositional defiant disorder, and these current diagnosis techniques are not very effective. Thus, a sophisticated computing model holds the potential to provide a promising diagnosis solution to this problem. This work attempts to explore methods to diagnose ADHD using combinations of multiple established machine learning techniques like neural networks and SVM models on the ADHD200 dataset and explore the field of neuroscience. In this work, multiclass classification is performed on phenotypic data using an SVM model. The better results have been analyzed on the phenotypic data compared to other supervised learning techniques like Logistic regression, KNN, AdaBoost, etc. In addition, neural networks have been implemented on functional connectivity from the MRI data of a sample of 40 subjects provided to achieve high accuracy without prior knowledge of neuroscience. It is combined with the phenotypic classifier using the ensemble technique to get a binary classifier. It is further trained and tested on 400 out of 824 subjects from the ADHD200 data set and achieved an accuracy of 92.5% for binary classification The training and testing accuracy has been achieved upto 99% using ensemble classifier.


title: Deep learning for $\psi$-weakly dependent processes

abstract: In this paper, we perform deep neural networks for learning $\psi$-weakly dependent processes. Such weak-dependence property includes a class of weak dependence conditions such as mixing, association,$\cdots$ and the setting considered here covers many commonly used situations such as: regression estimation, time series prediction, time series classification,$\cdots$ The consistency of the empirical risk minimization algorithm in the class of deep neural networks predictors is established. We achieve the generalization bound and obtain a learning rate, which is less than $\mathcal{O}(n^{-1/\alpha})$, for all $\alpha > 2 $. Applications to binary time series classification and prediction in affine causal models with exogenous covariates are carried out. Some simulation results are provided, as well as an application to the US recession data.


title: Hamiltonian Classification of toric fibres and symmetric probes

abstract: In a toric symplectic manifold, regular fibres of the moment map are Lagrangian tori which are called toric fibres. We discuss the question which two toric fibres are equivalent up to a Hamiltonian diffeomorphism of the ambient space. On the construction side of this question, we introduce a new method of constructing equivalences of toric fibres by using a symmetric version of McDuff's probes (see arXiv:0904.1686 and arXiv:1203.1074). On the other hand, we derive some obstructions to such equivalence by using Chekanov's classification of product tori together with a lifting trick from toric geometry. Furthermore, we conjecture that (iterated) symmetric probes yield all possible equivalences and prove this conjecture for $\mathbb{C}^n,\mathbb{C}P^2, \mathbb{C} \times S^2, \mathbb{C}^2 \times T^*S^1, T^*S^1 \times S^2$ and monotone $S^2 \times S^2$. This problem is intimately related to determining the Hamiltonian monodromy group of toric fibres, i.e. determining which automorphisms of the homology of the toric fibre can be realized by a Hamiltonian diffeomorphism mapping the toric fibre in question to itself. For the above list of examples, we determine the Hamiltonian monodromy group for all toric fibres.


title: Contactless actuators and pyramid wavefront sensor, the SPLATT concept for space active optics: an overview of the project and the last laboratory results

abstract: In the last few years the concept of an active space telescope has been greatly developed, to meet demanding requirements with a substantial reduction of tolerances, risks and costs. This is the frame of the LATT project (an ESA TRP) and its follow-up SPLATT (an INAF funded R&D project). Within the SPLATT activities, we outline a novel approach and investigate, both via simulations and in the optical laboratory, two main elements: an active segmented primary with contactless actuators and a pyramid wavefront sensor (PWFS) to drive the correction chain. The key point is the synergy between them: the sensitivity of the PWFS and the intrinsic stability of a contactless-actuated mirror segment. Voice-coil, contactless actuators are in facts a natural decoupling layer between the payload and the optical surface and can suppress the high frequency vibration as we verified in the lab. We subjected a 40 cm diameter prototype with 19 actuators to an externally injected vibration spectrum; we then measured optically the reduction of vibrations when the optical surface is floating controlled by the actuators, thus validating the concept at the first stage of the design. The PWFS, which is largely adopted on ground-based telescope, is a pupil-conjugated sensor and offers a user-selectable sampling and capture range, in order to match different use cases; it is also more sensitive than Shack-Hartmann sensor especially at the low-mid spatial scales. We run a set of numerical simulations with the PWFS measuring the misalignment and phase steps of a JWST-like primary mirrors: we investigated the PWFS sensitivity in the sub-nanometer regime in presence of photon and detector noise, and with guide star magnitudes in the range 8 to 14. In the paper we discuss the outcomes of the project and present a possible roadmap for further developments.


title: Measurement of the production of a $W$ boson in association with a charmed hadron in $pp$ collisions at $\sqrt{s} = 13\,\mathrm{TeV}$ with the ATLAS detector

abstract: The production of a $W$ boson in association with a single charm quark is studied using 140 $\mathrm{fb}^{-1}$ of $\sqrt{s} = 13\,\mathrm{TeV}$ proton-proton collision data collected with the ATLAS detector at the Large Hadron Collider. The charm quark is tagged by a charmed hadron, reconstructed with a secondary-vertex fit. The $W$ boson is reconstructed from an electron/muon decay and the missing transverse momentum. The mesons reconstructed are $D^{\pm} \to K^\mp \pi^\pm \pi^\pm$ and $D^{*\pm} \to D^{0} \pi^\pm \to (K^\mp \pi^\pm) \pi^\pm$, where $p_{\text{T}}(e, \mu) > 30\,\mathrm{GeV}$, $|\eta(e, \mu)| < 2.5$, $p_{\text{T}}(D) > 8\,\mathrm{GeV}$, and $|\eta(D)| < 2.2$. The integrated and normalized differential cross-sections as a function of the pseudorapidity of the lepton from the $W$ boson decay, and of the transverse momentum of the meson, are extracted from the data using a profile likelihood fit. The measured fiducial cross-sections are $\sigma^{\mathrm{OS-SS}}_{\mathrm{fid}}(W^{-}{+}D^{+}) = 50.2\pm0.2\,\mathrm{(stat.)}\,^{+2.4}_{-2.3}\,\mathrm{(syst.)}\,\mathrm{pb}$, $\sigma^{\mathrm{OS-SS}}_{\mathrm{fid}}(W^{+}{+}D^{-}) = 48.5\pm0.2\,\mathrm{(stat.)}\,^{+2.3}_{-2.2}\,\mathrm{(syst.)}\,\mathrm{pb}$, $\sigma^{\mathrm{OS-SS}}_{\mathrm{fid}}(W^{-}{+}D^{*+}) = 51.1\pm0.4\,\mathrm{(stat.)}\,^{+1.9}_{-1.8}\,\mathrm{(syst.)}\,\mathrm{pb}$, and $\sigma^{\mathrm{OS-SS}}_{\mathrm{fid}}(W^{+}{+}D^{*-}) = 50.0\pm0.4\,\mathrm{(stat.)}\,^{+1.9}_{-1.8}\,\mathrm{(syst.)}\,\mathrm{pb}$. Results are compared with the predictions of next-to-leading-order quantum chromodynamics calculations performed using state-of-the-art parton distribution functions. The ratio of charm to anti-charm production cross-sections is studied to probe the $s$-$\bar{s}$ quark asymmetry and is found to be $R_c^\pm = 0.971\pm0.006\,\mathrm{(stat.)}\pm0.011\,\mathrm{(syst.)}$.


title: Space-Time CutFEM on Overlapping Meshes: Simple Continuous Mesh Motion

abstract: We present a cut finite element method for the heat equation on two overlapping meshes: a stationary background mesh and an overlapping mesh that moves around inside/"on top" of it. Here the overlapping mesh is prescribed a simple continuous motion, meaning that its location as a function of time is continuous and piecewise linear. For the discrete function space, we use continuous Galerkin in space and discontinuous Galerkin in time, with the addition of a discontinuity on the boundary between the two meshes. The finite element formulation is based on Nitsche's method and also includes an integral term over the space-time boundary between the two meshes that mimics the standard discontinuous Galerkin time-jump term. The simple continuous mesh motion results in a space-time discretization for which standard analysis methodologies either fail or are unsuitable. We therefore employ what seems to be a relatively new energy analysis framework that is general and robust enough to be applicable to the current setting. The energy analysis consists of a stability estimate that is slightly stronger than the standard basic one and an a priori error estimate that is of optimal order with respect to both time step and mesh size. We also present numerical results for a problem in one spatial dimension that verify the analytic error convergence orders.


title: A Robust Certificate Management System to Prevent Evil Twin Attacks in IEEE 802.11 Networks

abstract: The evil twin attack is a major security threat to WLANs. An evil twin is a rogue AP installed by a malicious user to impersonate legitimate APs. It intends to attract victims in order to intercept their credentials, to steal their sensitive information, to eavesdrop on their data, etc. In this paper, we study the security mechanisms of wireless networks and we introduce the different authentication methods, including 802.1X authentication. We show that 802.1X has improved security through the use of digital certificates but does not define any practical technique for the user to check the network certificate. Therefore, it remains vulnerable to the evil twin attack. To repair this vulnerability, we introduce Robust Certificate Management System (RCMS) which takes advantage of the digital certificates of 802.1X to protect the users against rogue APs. RCMS defines a new verification code to allow the user device to check the network certificate. This practical verification combined with the reliability of digital certificates provides a perfect protection against rogue APs. RCMS requires a small software update on the user terminal and does not need any modification of IEEE 802.11. It has a significant flexibility since trusting a single AP is enough to trust all the APs of the extended network. This allows the administrators to extend their networks easily without the need to update any database of trusted APs on the user devices.


title: A Hydrogenated amorphous silicon detector for Space Weather Applications

abstract: The characteristics of a hydrogenated amorphous silicon (a-Si:H) detector are presented here for monitoring in space solar flares and the evolution of large energetic proton events up to hundreds of MeV. The a-Si:H presents an excellent radiation hardness and finds application in harsh radiation environments for medical purposes, for particle beam characterization and in space weather science and applications. The critical flux detection threshold for solar X rays, soft gamma rays, electrons and protons is discussed in detail.


title: Attention Link: An Efficient Attention-Based Low Resource Machine Translation Architecture

abstract: Transformers have achieved great success in machine translation, but transformer-based NMT models often require millions of bilingual parallel corpus for training. In this paper, we propose a novel architecture named as attention link (AL) to help improve transformer models' performance, especially in low training resources. We theoretically demonstrate the superiority of our attention link architecture in low training resources. Besides, we have done a large number of experiments, including en-de, de-en, en-fr, en-it, it-en, en-ro translation tasks on the IWSLT14 dataset as well as real low resources scene on bn-gu and gu-ta translation tasks on the CVIT PIB dataset. All the experiment results show our attention link is powerful and can lead to a significant improvement. In addition, we achieve a 37.9 BLEU score, a new sota, on the IWSLT14 de-en task by combining our attention link and other advanced methods.


title: Reverse Ordering Techniques for Attention-Based Channel Prediction

abstract: This work aims to predict channels in wireless communication systems based on noisy observations, utilizing sequence-to-sequence models with attention (Seq2Seq-attn) and transformer models. Both models are adapted from natural language processing to tackle the complex challenge of channel prediction. Additionally, a new technique called reverse positional encoding is introduced in the transformer model to improve the robustness of the model against varying sequence lengths. Similarly, the encoder outputs of the Seq2Seq-attn model are reversed before applying attention. Simulation results demonstrate that the proposed ordering techniques allow the models to better capture the relationships between the channel snapshots within the sequence, irrespective of the sequence length, as opposed to existing methods.


title: Bayesian inference for a spatio-temporal model of road traffic collision data

abstract: Improving road safety is hugely important with the number of deaths on the world's roads remaining unacceptably high; an estimated 1.35 million people die each year (WHO, 2020). Current practice for treating collision hotspots is almost always reactive: once a threshold level of collisions has been exceeded during some predetermined observation period, treatment is applied (e.g. road safety cameras). However, more recently, methodology has been developed to predict collision counts at potential hotspots in future time periods, with a view to a more proactive treatment of road safety hotspots. Dynamic linear models provide a flexible framework for predicting collisions and thus enabling such a proactive treatment. In this paper, we demonstrate how such models can be used to capture both seasonal variability and spatial dependence in time course collision rates at several locations. The model allows for within- and out-of-sample forecasting for locations which are fully observed and for locations where some data are missing. We illustrate our approach using collision rate data from 8 Traffic Administration Zones in North Florida, USA, and find that the model provides a good description of the underlying process and reasonable forecast accuracy.


title: Flag-accurate arrangements

abstract: In [MR21], the first two authors introduced the notion of an accurate arrangement, a particular notion of freeness. In this paper, we consider a special subclass, where the property of accuracy stems from a flag of flats in the intersection lattice of the underlying arrangement. Members of this family are called flag-accurate. One relevance of this new notion is that it entails divisional freeness. There are a number of important natural classes which are flag-accurate, the most prominent one among them is the one consisting of Coxeter arrangements. This warrants a systematic study which is put forward in the present paper. More specifically, let $\mathscr A$ be a free arrangement of rank $\ell$. Suppose that for every $1\leq d \leq \ell$, the first $d$ exponents of $\mathscr A$ -- when listed in increasing order -- are realized as the exponents of a free restriction of $\mathscr A$ to some intersection of reflecting hyperplanes of $\mathscr A$ of dimension $d$. Following [MR21], we call such an arrangement $\mathscr A$ with this natural property accurate. If in addition the flats involved can be chosen to form a flag, we call $\mathscr A$ flag-accurate. We investigate flag-accuracy among reflection arrangements, extended Shi and extended Catalan arrangements, and further for various families of graphic and digraphic arrangements. We pursue these both from theoretical and computational perspectives. Along the way we present examples of accurate arrangements that are not flag-accurate. The main result of [MR21] shows that MAT-free arrangements are accurate. We provide strong evidence for the conjecture that MAT-freeness actually entails flag-accuracy.


title: A Minimal Explanation of the Primordial Cosmological Perturbations

abstract: We outline a new explanation for the primordial density perturbations in cosmology. Dimension zero fields are a minimal addition to the Standard Model of particle physics: if the Higgs doublet is emergent, they cancel the vacuum energy and both Weyl anomalies without introducing any new particles. Furthermore, the cancellation explains why there are three generations of elementary particles, including RH neutrinos. We show how quantum zero point fluctuations of dimension zero fields seed nearly scale-invariant, Gaussian, adiabatic density perturbations. We calculate the amplitude of the primordial perturbations in terms of Standard Model couplings and find a result consistent with large scale observations. Subject to two key theoretical assumptions, both the amplitude and the tilt we calculate agree with the observed values, with no free parameters.


title: Slow, slow, quick, quick, slow: five altmetric sources observed over a decade show evolving trends, by research age, attention source maturity and open access status

abstract: The study of temporal trends in altmetrics is under-developed, and this multi-year observation study addresses some of the deficits in our understanding of altmetric behaviour over time. The attention surrounding research outputs, as partially captured by altmetrics, or alternative metrics, constitutes many varied forms of data. Over the years 2008-2013, a set of 7739 papers were sampled on six occasions. Five altmetric data sources were recorded (Twitter, Mendeley, News, Blogs and Policy) and analysed for temporal trends, with particular attention being paid to their Open Access status and discipline. Twitter attention both starts and ends quickly. Mendeley readers accumulate quickly, and continue to grow over the following years. News and blog attention is quick to start, although news attention persists over a longer timeframe. Citations in policy documents are slow to start, and are observed to be growing over a decade after publication. Over time, growth in Twitter activity is confirmed, alongside an apparent decline in blogging attention. Mendeley usage is observed to grow, but shows signs of recent decline. Policy attention is identified as the slowest form of impact studied by altmetrics, and one that strongly favours the Humanities and Social Sciences. The Open Access Altmetrics Advantage is seen to emerge and evolve over time, with each attention source showing different trends. The existence of late-emergent attention in all attention sources is confirmed.


title: Polarisation Leakage due to Errors in Track Reconstruction in Gas Pixel Detectors

abstract: X-ray polarimetry, based on Gas Pixel Detectors (GPDs), have reached a high level of maturity with the Imaging X-ray Polarimeter Explorer (IXPE) leading to the first ever spatially resolved polarimetric measures. However, being this a new technique, a few unexpected effect have emerged during in flight operations. In particular it was almost immediately found that on-board unpolarized calibration sources were showing radially polarized halos. The origin of this features was recognized in a correlation between the error in reconstructing the absorption point of the X-ray photon and the direction of its electric field vector. Here we present and discuss in detail this effect, showing that it is possible to provide a simple and robust mathematical formalism to handle it. We further show its role and relevance for the recent IXPE measures, and for the use of GPD-based techniques in general, and illustrate how to model it in the study of extended sources.


title: Anderson Acceleration For Bioinformatics-Based Machine Learning

abstract: Anderson acceleration (AA) is a well-known method for accelerating the convergence of iterative algorithms, with applications in various fields including deep learning and optimization. Despite its popularity in these areas, the effectiveness of AA in classical machine learning classifiers has not been thoroughly studied. Tabular data, in particular, presents a unique challenge for deep learning models, and classical machine learning models are known to perform better in these scenarios. However, the convergence analysis of these models has received limited attention. To address this gap in research, we implement a support vector machine (SVM) classifier variant that incorporates AA to speed up convergence. We evaluate the performance of our SVM with and without Anderson acceleration on several datasets from the biology domain and demonstrate that the use of AA significantly improves convergence and reduces the training loss as the number of iterations increases. Our findings provide a promising perspective on the potential of Anderson acceleration in the training of simple machine learning classifiers and underscore the importance of further research in this area. By showing the effectiveness of AA in this setting, we aim to inspire more studies that explore the applications of AA in classical machine learning.


title: DEIM vs. leverage scores for time-parallel construction of problem-adapted basis functions

abstract: To tackle heterogeneous time-dependent problems, an algorithm that constructs problem-adapted basis functions in an embarrassingly parallel and local manner in time has recently been proposed in [Schleuss, Smetana, ter Maat, SIAM J. Sci. Comput., 2022+]. Several simulations of the problem are performed for only few time steps in parallel by starting at different, randomly drawn start time points. For this purpose, data-dependent probability distributions that are based on the (time-dependent) data functions of the problem, such as leverage scores, are employed. In this paper, we suggest as a key new contribution to perform a deterministic time point selection based on the (discrete) empirical interpolation method (DEIM) within the proposed algorithm. In numerical experiments we investigate the performance of a DEIM based time point selection and compare it to the leverage score sampling approach.


title: Collective excitations of Bose-Einstein Condensate in a Rydberg Atom

abstract: In this work, we investigated a Bose-Einstein condensate (BEC) inside a Rydberg atom. We first observed the density profile of the system using the Gross-Pitaevskii equation, and then we used the Bogoliubov theory to examine the collective excitation spectra. We have also extended our study by taking into account a hybrid of two BEC species. Again, for this new system, the density profile and the collective excitation are investigated in a similar manner. The results of the BEC for one species reveal that the Rydberg atom can trap the BEC and that the excitation curve moves upward with increasing Rydberg atom interaction. We have seen roton minima for two species of BEC, and the depth of the minima shifts with the Rydberg interaction.


title: The Intermediate Jacobian fibration of a cubic fourfold containing a plane and fibrations in Prym varieties

abstract: We give a description of the intermediate Jacobian fibration attached to a general complex cubic fourfold $X$ containing a plane as a Lagrangian subfibration of a moduli space of torsion sheaves on the K3 surface associated to $X$ up to a cover. To do so, we propose a general construction of Lagrangian fibrations in Prym varieties as subfibrations of Beauville-Mukai systems over some loci of nodal curves in linear systems on K3 surfaces.


title: Stable maps to Looijenga pairs built from the plane

abstract: Choosing a normal crossings anticanonical divisor of $\mathbb{P}^2$ leads to four log Calabi-Yau surfaces, three of which are Looijenga pairs. In this survey article, I describe how to count rational curves in these that intersect each component of the divisor in one point of maximal tangency.


title: Flip-width: Cops and Robber on dense graphs

abstract: We define new graph parameters, called flip-width, that generalize treewidth, degeneracy, and generalized coloring numbers for sparse graphs, and clique-width and twin-width for dense graphs. The flip-width parameters are defined using variants of the Cops and Robber game, in which the robber has speed bounded by a fixed constant $r\in\mathbb N\cup\{\infty\}$, and the cops perform flips (or perturbations) of the considered graph. We then propose a new notion of tameness of a graph class, called bounded flip-width, which is a dense counterpart of classes of bounded expansion of Ne\v{s}etril and Ossona de Mendez, and includes classes of bounded twin-width of Bonnet, Kim, Thomass{\'e}, and Watrigant. This unifies Sparsity Theory and Twin-width Theory, providing a common language for studying the central notions of the two theories, such as weak coloring numbers and twin-width -- corresponding to winning strategies of one player -- or dense shallow minors, rich divisions, or well-linked sets, corresponding to winning strategies of the other player. We prove that boundedness of flip-width is preserved by first-order interpretations, or transductions, generalizing previous results concerning classes of bounded expansion and bounded twin-width. We provide an algorithm approximating the flip-width of a given graph, which runs in slicewise polynomial time (XP) in the size of the graph. Finally, we propose a more general notion of tameness, called almost bounded flip-width, which is a dense counterpart of nowhere dense classes. We conjecture, and provide evidence, that classes with almost bounded flip-width coincide with monadically dependent (or monadically NIP) classes, introduced by Shelah in model theory. We also provide evidence that classes of almost bounded flip-width characterise the hereditary graph classes for which the model-checking problem is fixed-parameter tractable.


title: Towards Label-Efficient Incremental Learning: A Survey

abstract: The current dominant paradigm when building a machine learning model is to iterate over a dataset over and over until convergence. Such an approach is non-incremental, as it assumes access to all images of all categories at once. However, for many applications, non-incremental learning is unrealistic. To that end, researchers study incremental learning, where a learner is required to adapt to an incoming stream of data with a varying distribution while preventing forgetting of past knowledge. Significant progress has been made, however, the vast majority of works focus on the fully supervised setting, making these algorithms label-hungry thus limiting their real-life deployment. To that end, in this paper, we make the first attempt to survey recently growing interest in label-efficient incremental learning. We identify three subdivisions, namely semi-, few-shot- and self-supervised learning to reduce labeling efforts. Finally, we identify novel directions that can further enhance label-efficiency and improve incremental learning scalability. Project website: https://github.com/kilickaya/label-efficient-il.


title: The Spatial Kernel Predictor based on Huge Observation Sets

abstract: Spatial prediction in an arbitrary location, based on a spatial set of observations, is usually performed by Kriging, being the best linear unbiased predictor (BLUP) in a least-square sense. In order to predict a continuous surface over a spatial domain a grid representation is most often used. Kriging predictions and prediction variances are computed in the nodes of a grid covering the spatial domain, and the continuous surface is assessed from this grid representation. A precise representation usually requires the number of grid nodes to be considerably larger than the number of observations. For a Gaussian random field model the Kriging predictor coinsides with the conditional expectation of the spatial variable given the observation set. An alternative expression for this conditional expectation provides a spatial predictor on functional form which does not rely on a spatial grid discretization. This functional predictor, called the Kernel predictor, is identical to the asymptotic grid infill limit of the Kriging-based grid representation, and the computational demand is primarily dependent on the number of observations - not the dimension of the spatial reference domain nor any grid discretization. We explore the potential of this Kernel predictor with associated prediction variances. The predictor is valid for Gaussian random fields with any eligible spatial correlation function, and large computational savings can be obtained by using a finite-range spatial correlation function. For studies with a huge set of observations, localized predictors must be used, and the computational advantage relative to Kriging predictors can be very large. Moreover, model parameter inference based on a huge observation set can be efficiently made. The methodology is demonstrated in a couple of examples.


title: Algorithms for Modifying Recurrence Relations of Orthogonal Polynomial and Rational Functions when Changing the Discrete Inner Product

abstract: Often, polynomials or rational functions, orthogonal for a particular inner product are desired. In practical numerical algorithms these polynomials are not constructed, but instead the associated recurrence relations are computed. Moreover, also typically the inner product is changed to a discrete inner product, which is the finite sum of weighted functions evaluated in specific nodes. For particular applications it is beneficial to have an efficient procedure to update the recurrence relations when adding or removing nodes from the inner product. The construction of the recurrence relations is equivalent to computing a structured matrix (polynomial) or pencil (rational) having prescribed spectral properties. Hence the solution of this problem is often referred to as solving an Inverse Eigenvalue Problem. In Van Buggenhout et al. (2022) we proposed updating techniques to add nodes to the inner product while efficiently updating the recurrences. To complete this study we present in this article manners to efficiently downdate the recurrences when removing nodes from the inner product. The link between removing nodes and the QR algorithm to deflate eigenvalues is exploited to develop efficient algorithms. We will base ourselves on the perfect shift strategy and develop algorithms, both for the polynomial case and the rational function setting. Numerical experiments validate our approach.


title: Exponentials rarely maximize Fourier extension inequalities for cones

abstract: We prove the existence of maximizers and the precompactness of $L^p$-normalized maximizing sequences modulo symmetries for all valid scale-invariant Fourier extension inequalities on the cone in $\mathbb R^{1+d}$. In the range for which such inequalities are conjectural, our result is conditional on the boundedness of the extension operator. Global maximizers for the $L^2$ Fourier extension inequality on the cone in $\mathbb R^{1+d}$ have been characterized in the lowest-dimensional cases $d\in\{2,3\}$. We further prove that these functions are critical points for the $L^p$ to $L^q$ Fourier extension inequality if and only if $p = 2$.


title: Multidimensional Rogers-Ramanujan type identities with parameters

abstract: Via the contour integral method, we establish several multidimensional Rogers-Ramanujan type identities with parameters. As conclusions, some known formulas are recovered and several new identities are derived. The bisection method is also used to discover some new results.


title: Bandit Convex Optimisation Revisited: FTRL Achieves $\tilde{O}(t^{1/2})$ Regret

abstract: We show that a kernel estimator using multiple function evaluations can be easily converted into a sampling-based bandit estimator with expectation equal to the original kernel estimate. Plugging such a bandit estimator into the standard FTRL algorithm yields a bandit convex optimisation algorithm that achieves $\tilde{O}(t^{1/2})$ regret against adversarial time-varying convex loss functions.


title: A modern-day Mars climate in the Met Office Unified Model: dry simulations

abstract: We present results from the Met Office Unified Model (UM), a world-leading climate and weather model, adapted to simulate a dry Martian climate. We detail the adaptation of the basic parameterisations and analyse results from two simulations, one with radiatively active mineral dust and one with radiatively inactive dust. These simulations demonstrate how the radiative effects of dust act to accelerate the winds and create a mid-altitude isothermal layer during the dusty season. We validate our model through comparison with an established Mars model, the Laboratoire de M\'et\'eorologie Dynamique planetary climate model (PCM), finding good agreement in the seasonal wind and temperature profiles but with discrepancies in the predicted dust mass mixing ratio and conditions at the poles. This study validates the use of the UM for a Martian atmosphere, highlighting how the adaptation of an Earth general circulation model (GCM) can be beneficial for existing Mars GCMs and provides insight into the next steps in our development of a new Mars climate model.


title: Faster maximal clique enumeration in large real-world link streams

abstract: Link streams offer a good model for representing interactions over time. They consist of links $(b,e,u,v)$, where $u$ and $v$ are vertices interacting during the whole time interval $[b,e]$. In this paper, we deal with the problem of enumerating maximal cliques in link streams. A clique is a pair $(C,[t_0,t_1])$, where $C$ is a set of vertices that all interact pairwise during the full interval $[t_0,t_1]$. It is maximal when neither its set of vertices nor its time interval can be increased. Some of the main works solving this problem are based on the famous Bron-Kerbosch algorithm for enumerating maximal cliques in graphs. We take this idea as a starting point to propose a new algorithm which matches the cliques of the instantaneous graphs formed by links existing at a given time $t$ to the maximal cliques of the link stream. We prove its validity and compute its complexity, which is better than the state-of-the art ones in many cases of interest. We also study the output-sensitive complexity, which is close to the output size, thereby showing that our algorithm is efficient. To confirm this, we perform experiments on link streams used in the state of the art, and on massive link streams, up to 100 million links. In all cases our algorithm is faster, mostly by a factor of at least 10 and up to a factor of $10^4$. Moreover, it scales to massive link streams for which the existing algorithms are not able to provide the solution.


title: K-D Bonsai: ISA-Extensions to Compress K-D Trees for Autonomous Driving Tasks

abstract: Autonomous Driving (AD) systems extensively manipulate 3D point clouds for object detection and vehicle localization. Thereby, efficient processing of 3D point clouds is crucial in these systems. In this work we propose K-D Bonsai, a technique to cut down memory usage during radius search, a critical building block of point cloud processing. K-D Bonsai exploits value similarity in the data structure that holds the point cloud (a k-d tree) to compress the data in memory. K-D Bonsai further compresses the data using a reduced floating-point representation, exploiting the physically limited range of point cloud values. For easy integration into nowadays systems, we implement K-D Bonsai through Bonsai-extensions, a small set of new CPU instructions to compress, decompress, and operate on points. To maintain baseline safety levels, we carefully craft the Bonsai-extensions to detect precision loss due to compression, allowing re-computation in full precision to take place if necessary. Therefore, K-D Bonsai reduces data movement, improving performance and energy efficiency, while guaranteeing baseline accuracy and programmability. We evaluate K-D Bonsai over the euclidean cluster task of Autoware.ai, a state-of-the-art software stack for AD. We achieve an average of 9.26% improvement in end-to-end latency, 12.19% in tail latency, and a reduction of 10.84% in energy consumption. Differently from expensive accelerators proposed in related work, K-D Bonsai improves radius search with minimal area increase (0.36%).


title: A Flexible Framework for Virtual Omnidirectional Vision to Improve Operator Situation Awareness

abstract: During teleoperation of a mobile robot, providing good operator situation awareness is a major concern as a single mistake can lead to mission failure. Camera streams are widely used for teleoperation but offer limited field-of-view. In this paper, we present a flexible framework for virtual projections to increase situation awareness based on a novel method to fuse multiple cameras mounted anywhere on the robot. Moreover, we propose a complementary approach to improve scene understanding by fusing camera images and geometric 3D Lidar data to obtain a colorized point cloud. The implementation on a compact omnidirectional camera reduces system complexity considerably and solves multiple use-cases on a much smaller footprint compared to traditional approaches such as actuated pan-tilt units. Finally, we demonstrate the generality of the approach by application to the multi-camera system of the Boston Dynamics Spot. The software implementation is available as open-source ROS packages on the project page https://tu-darmstadt-ros-pkg.github.io/omnidirectional_vision.


title: Implicit augmented Lagrangian and generalized optimization

abstract: Generalized nonlinear programming is considered without any convexity assumption, capturing a variety of problems that include nonsmooth objectives, combinatorial structures, and set-membership nonlinear constraints. We extend the augmented Lagrangian framework to this broad problem class, preserving an implicit formulation and introducing slack variables merely as a formal device. This, however, gives rise to a generalized augmented Lagrangian function that lacks regularity, due to the marginalization with respect to slack variables. Based on parametric optimization, we develop a tailored stationarity concept to better qualify the iterates, generated as approximate solutions to a sequence of subproblems. Using this variational characterization and the lifted representation, a suitable multiplier update rule is derived, and then asymptotic properties and convergence guarantees are established for a safeguarded augmented Lagrangian scheme. An illustrative numerical example showcases the modelling versatility gained by dropping convexity assumptions and indicates the practical benefits of the advocated implicit approach.


title: The YODO algorithm: An efficient computational framework for sensitivity analysis in Bayesian networks

abstract: Sensitivity analysis measures the influence of a Bayesian network's parameters on a quantity of interest defined by the network, such as the probability of a variable taking a specific value. Various sensitivity measures have been defined to quantify such influence, most commonly some function of the quantity of interest's partial derivative with respect to the network's conditional probabilities. However, computing these measures in large networks with thousands of parameters can become computationally very expensive. We propose an algorithm combining automatic differentiation and exact inference to efficiently calculate the sensitivity measures in a single pass. It first marginalizes the whole network once, using e.g. variable elimination, and then backpropagates this operation to obtain the gradient with respect to all input parameters. Our method can be used for one-way and multi-way sensitivity analysis and the derivation of admissible regions. Simulation studies highlight the efficiency of our algorithm by scaling it to massive networks with up to 100'000 parameters and investigate the feasibility of generic multi-way analyses. Our routines are also showcased over two medium-sized Bayesian networks: the first modeling the country-risks of a humanitarian crisis, the second studying the relationship between the use of technology and the psychological effects of forced social isolation during the COVID-19 pandemic. An implementation of the methods using the popular machine learning library PyTorch is freely available.


title: On tests of the quantum nature of gravitational interactions in presence of non-linear corrections to quantum mechanics

abstract: When two particles interact primarily through gravity and follow the laws of quantum mechanics, the generation of entanglement is considered a hallmark of the quantum nature of the gravitational interaction. However, we demonstrate that entanglement dynamics can also occur in the presence of a weak quantum interaction and non-linear corrections to local quantum mechanics, even if the gravitational interaction is classical or absent at short distances. This highlights the importance of going beyond entanglement detection to conclusively test the quantum character of gravity, and it requires a thorough examination of the strength of other quantum forces and potential non-linear corrections to quantum mechanics in the realm of large masses.


title: CzSL: Learning from citizen science, experts and unlabelled data in astronomical image classification

abstract: Citizen science is gaining popularity as a valuable tool for labelling large collections of astronomical images by the general public. This is often achieved at the cost of poorer quality classifications made by amateur participants, which are usually verified by employing smaller data sets labelled by professional astronomers. Despite its success, citizen science alone will not be able to handle the classification of current and upcoming surveys. To alleviate this issue, citizen science projects have been coupled with machine learning techniques in pursuit of a more robust automated classification. However, existing approaches have neglected the fact that, apart from the data labelled by amateurs, (limited) expert knowledge of the problem is also available along with vast amounts of unlabelled data that have not yet been exploited within a unified learning framework. This paper presents an innovative learning methodology for citizen science capable of taking advantage of expert- and amateur-labelled data, featuring a transfer of labels between experts and amateurs. The proposed approach first learns from unlabelled data with a convolutional autoencoder and then exploits amateur and expert labels via the pre-training and fine-tuning of a convolutional neural network, respectively. We focus on the classification of galaxy images from the Galaxy Zoo project, from which we test binary, multi-class, and imbalanced classification scenarios. The results demonstrate that our solution is able to improve classification performance compared to a set of baseline approaches, deploying a promising methodology for learning from different confidence levels in data labelling.


title: FLYEYE family tree, from smart fast cameras to MezzoCielo

abstract: We developed game-changing concepts for meter(s) class very-wide-field telescopes, spanning three orders of magnitude of the covered field of view. Multiple cameras and monocentric systems: from the Smart Fast Cameras (with a quasi-monocentric aperture), through the FlyEye, toward a MezzoCielo concept (both with a truly monocentric aperture). MezzoCielo (or "half of the sky") is the last developed concept for a new class of telescopes. Such a concept is based on a fully spherical optical surface filled with a low refractive index, and high transparency liquid surrounded by multiple identical cameras. MezzoCielo is capable to reach field of views in the range of ten to twenty thousand square degrees.


title: Test-Time Amendment with a Coarse Classifier for Fine-Grained Classification

abstract: We investigate the problem of reducing mistake severity for fine-grained classification. Fine-grained classification can be challenging, mainly due to the requirement of domain expertise for accurate annotation. However, humans are particularly adept at performing coarse classification as it requires relatively low levels of expertise. To this end, we present a novel approach for Post-Hoc Correction called Hierarchical Ensembles (HiE) that utilizes label hierarchy to improve the performance of fine-grained classification at test-time using the coarse-grained predictions. By only requiring the parents of leaf nodes, our method significantly reduces avg. mistake severity while improving top-1 accuracy on the iNaturalist-19 and tieredImageNet-H datasets, achieving a new state-of-the-art on both benchmarks. We also investigate the efficacy of our approach in the semi-supervised setting. Our approach brings notable gains in top-1 accuracy while significantly decreasing the severity of mistakes as training data decreases for the fine-grained classes. The simplicity and post-hoc nature of HiE renders it practical to be used with any off-the-shelf trained model to improve its predictions further.


title: Memory Enabled Bumblebee-based Dynamic Spectrum Access for Platooning Environments

abstract: In this paper, we propose a novel memory-enabled non-uniform sampling-based bumblebee foraging algorithm (MEB) designed for optimal channel selection in a distributed Vehicular Dynamic Spectrum Access (VDSA) framework employed in a platoon operating environment. Given how bumblebee behavioral models are designed to support adaptation in complex and highly time-varying environments, these models can be employed by connected vehicles to enable their operation within a dynamically changing network topology and support their selection of optimal channels possessing low levels of congestion to achieve high throughput. As a result, the proposed VDSA-based optimal channel selection employs fundamental concepts from the bumblebee foraging model. In the proposed approach, the Channel Busy Ratio (CBR) of all channels is computed and stored in memory to be accessed by the MEB algorithm to make the necessary channel switching decisions. Two averaging techniques, Sliding Window Average (SWA) and Exponentially Weighted Moving Average (EWMA), are employed to leverage past samples and are evaluated against the no-memory case. Due to the high variability of the environment (e.g., high velocities, changing density of vehicles on the road), we propose to calculate the CBR by employing non-uniform channel sampling allocations as well as evaluate it using both simplified numerical and realistic Vehicle-to-Vehicle (V2V) computer simulations. The numerical simulation results show that gains in the probability of the best channel selection can be achieved relative to a uniform sampling allocation approach. By utilizing memory, we observe an additional increase in the channel selection performance. Similarly, we see an increase in the probability of successful reception when utilizing the bumblebee algorithm via a system-level simulator.


title: How to select predictive models for causal inference?

abstract: As predictive models -- e.g., from machine learning -- give likely outcomes, they may be used to reason on the effect of an intervention, a causal-inference task. The increasing complexity of health data has opened the door to a plethora of models, but also the Pandora box of model selection: which of these models yield the most valid causal estimates? Here we highlight that classic machine-learning model selection does not select the best outcome models for causal inference. Indeed, causal model selection should control both outcome errors for each individual, treated or not treated, whereas only one outcome is observed. Theoretically, simple risks used in machine learning do not control causal effects when treated and non-treated population differ too much. More elaborate risks build proxies of the causal error using ``nuisance'' re-weighting to compute it on the observed data. But does computing these nuisance adds noise to model selection? Drawing from an extensive empirical study, we outline a good causal model-selection procedure: using the so-called $R\text{-risk}$; using flexible estimators to compute the nuisance models on the train set; and splitting out 10\% of the data to compute risks.


title: Simple yet Effective Gradient-Free Graph Convolutional Networks

abstract: Linearized Graph Neural Networks (GNNs) have attracted great attention in recent years for graph representation learning. Compared with nonlinear Graph Neural Network (GNN) models, linearized GNNs are much more time-efficient and can achieve comparable performances on typical downstream tasks such as node classification. Although some linearized GNN variants are purposely crafted to mitigate ``over-smoothing", empirical studies demonstrate that they still somehow suffer from this issue. In this paper, we instead relate over-smoothing with the vanishing gradient phenomenon and craft a gradient-free training framework to achieve more efficient and effective linearized GNNs which can significantly overcome over-smoothing and enhance the generalization of the model. The experimental results demonstrate that our methods achieve better and more stable performances on node classification tasks with varying depths and cost much less training time.


title: Millimeter-wave spectrum of 2-propanimine

abstract: Up to date, only 6 imines have been detected in the interstellar medium. The 3-carbon imine, 2-propanimine ((CH$_3$)$_2$C=NH), is predicted to be the structural isomer with the lowest energy in the C$_3$H$_7$N group, and appears to be a good candidate for astronomical searches. Unexpectedly, no microwave or millimeter wave spectrum is available for 2-propanimine. In this work, we provide the first high resolution millimeter wave spectrum of 2-propanimine and its analysis. With the guide of this laboratory measurement, we aim to search for 2-propanimine in two molecule-rich sources Sgr B2(N) and IRAS 16293-2422 using observations from the Atacama Large Millimeter/submillimeter Array (ALMA). Starting from a synthesized sample, we measured the spectrum of 2-propanimine from 50 to 500 GHz, and the ground state lines are successfully assigned and fitted using XIAM and ERHAM programs with the aid of theoretical calculations. The barriers to internal rotation of the two CH$_3$ tops are determined to be 531.956(64) cm$^{-1}$ and 465.013(26) cm$^{-1}$. These data are able to provide reliable prediction of transition frequencies for astronomical search. Although a few line matches exist, no confirmed detection of 2-propanimine has been found in the hot molecular core Sgr B2(N1S) and the Class 0 protostar IRAS 16293B. Upper-limits of its column density have been derived, and indicate that 2-propanimine is at least 18 times less abundant than methanimine in Sgr B2(N1S), and is at most 50-83 % of methanimine in IRAS 16293B.


title: Scalar fluid in scalar-tensor gravity from an equivalent picture of thermodynamic and fluid descriptions of gravitational dynamics

abstract: We revisit the thermodynamic description of fluid, represented by scalar field in scalar-tensor gravity theory through a general approach to study the thermodynamics of relativistic fluids. In order to identify the fluid energy-momentum tensor, contrary to the existing way, we use equivalent description of gravitational dynamics both in Jordan and Einstein frames as thermodynamical identity and fluid equation on a generic null surface. Such an approach provides the energy-momentum tensors for scalar fluid as that of an ideal fluid in both the frames. We then mention few issues in the existing way of using Eckart's formalism for an ideal fluid. Our investigation suggests that the Eckart's frame may not be suitable to consider ideal fluid. Consequently a possible alternative description, valid in other than Eckart's frame, is being suggested for a general ideal fluid. Based on this we obtain a unified thermodynamic description in both Jordan and Einstein frames from our identified energy-momentum tensors. Finally, the relations between thermodynamic entities on different frames are being put forwarded. Thus, the description in either of the frames is enough to provide the complete picture.


title: HOAX: A Hyperparameter Optimization Algorithm Explorer for Neural Networks

abstract: Computational chemistry has become an important tool to predict and understand molecular properties and reactions. Even though recent years have seen a significant growth in new algorithms and computational methods that speed up quantum chemical calculations, the bottleneck for trajectory-based methods to study photoinduced processes is still the huge number of electronic structure calculations. In this work, we present an innovative solution, in which the amount of electronic structure calculations is drastically reduced, by employing machine learning algorithms and methods borrowed from the realm of artificial intelligence. However, applying these algorithms effectively requires finding optimal hyperparameters, which remains a challenge itself. Here we present an automated user-friendly framework, HOAX, to perform the hyperparameter optimization for neural networks, which bypasses the need for a lengthy manual process. The neural network generated potential energy surfaces (PESs) reduces the computational costs compared to the ab initio-based PESs. We perform a comparative investigation on the performance of different hyperparameter optimiziation algorithms, namely grid search, simulated annealing, genetic algorithm, and bayesian optimizer in finding the optimal hyperparameters necessary for constructing the well-performing neural network in order to fit the PESs of small organic molecules. Our results show that this automated toolkit not only facilitate a straightforward way to perform the hyperparameter optimization but also the resulting neural networks-based generated PESs are in reasonable agreement with the ab initio-based PESs.


title: Bayes-optimal Learning of Deep Random Networks of Extensive-width

abstract: We consider the problem of learning a target function corresponding to a deep, extensive-width, non-linear neural network with random Gaussian weights. We consider the asymptotic limit where the number of samples, the input dimension and the network width are proportionally large. We propose a closed-form expression for the Bayes-optimal test error, for regression and classification tasks. We further compute closed-form expressions for the test errors of ridge regression, kernel and random features regression. We find, in particular, that optimally regularized ridge regression, as well as kernel regression, achieve Bayes-optimal performances, while the logistic loss yields a near-optimal test error for classification. We further show numerically that when the number of samples grows faster than the dimension, ridge and kernel methods become suboptimal, while neural networks achieve test error close to zero from quadratically many samples.


title: Boundary states and Non-Abelian Casimir effect in lattice Yang-Mills theory

abstract: Using first-principle numerical simulations, we investigate the Casimir effect in zero-temperature SU(3) lattice gauge theory in 3+1 spacetime dimensions. The Casimir interaction between perfect chromometallic mirrors reveals the presence of a new gluonic state with the mass $m_{\mathrm{gt}} = 1.0(1)\sqrt{\sigma} = 0.49(5)\,\mathrm{GeV} = 0.29(3) M_{0^{++}}$ which is substantially lighter than the $0^{++}$ groundstate glueball. We call this excitation ``glueton'' interpreting it as a non-perturbative colorless state of gluons bound to their negatively colored images in the chromometallic mirror. The glueton is a gluonic counterpart of a surface electron-hole exciton in semiconductors. We also show that a heavy quark is attracted to the neutral chromometallic mirror, thus supporting the existence of a ``quarkiton'' (a ``quark exciton'') colorless state in QCD, which is formed by a single quark with its anti-quark image in the chromometallic mirror. Analogies with edge modes in topological insulators and boundary states of fractional vortices in multi-component condensates are highlighted.


title: Autobidding Auctions in the Presence of User Costs

abstract: We study autobidding ad auctions with user costs, where each bidder is value-maximizing subject to a return-over-investment (ROI) constraint, and the seller aims to maximize the social welfare taking into consideration the user's cost of viewing an ad. We show that in the worst case, the approximation ratio of social welfare by running the vanilla VCG auctions with user costs could as bad as 0. To improve the performance of VCG, We propose a new variant of VCG based on properly chosen cost multipliers, and prove that there exist auction-dependent and bidder-dependent cost multipliers that guarantee approximation ratios of 1/2 and 1/4 respectively in terms of the social welfare.


title: An Empirical Study on the Transferability of Transformer Modules in Parameter-Efficient Fine-Tuning

abstract: Parameter-efficient fine-tuning approaches have recently garnered a lot of attention. Having considerably lower number of trainable weights, these methods can bring about scalability and computational effectiveness. In this paper, we look for optimal sub-networks and investigate the capability of different transformer modules in transferring knowledge from a pre-trained model to a downstream task. Our empirical results suggest that every transformer module in BERT can act as a winning ticket: fine-tuning each specific module while keeping the rest of the network frozen can lead to comparable performance to the full fine-tuning. Among different modules, LayerNorms exhibit the best capacity for knowledge transfer with limited trainable weights, to the extent that, with only 0.003% of all parameters in the layer-wise analysis, they show acceptable performance on various target tasks. On the reasons behind their effectiveness, we argue that their notable performance could be attributed to their high-magnitude weights compared to that of the other modules in the pre-trained BERT.


title: Continuous Scatterplot Operators for Bivariate Analysis and Study of Electronic Transitions

abstract: Electronic transitions in molecules due to the absorption or emission of light is a complex quantum mechanical process. Their study plays an important role in the design of novel materials. A common yet challenging task in the study is to determine the nature of electronic transitions, namely which subgroups of the molecule are involved in the transition by donating or accepting electrons, followed by an investigation of the variation in the donor-acceptor behavior for different transitions or conformations of the molecules. In this paper, we present a novel approach for the analysis of a bivariate field and show its applicability to the study of electronic transitions. This approach is based on two novel operators, the continuous scatterplot (CSP) lens operator and the CSP peel operator, that enable effective visual analysis of bivariate fields. Both operators can be applied independently or together to facilitate analysis. The operators motivate the design of control polygon inputs to extract fiber surfaces of interest in the spatial domain. The CSPs are annotated with a quantitative measure to further support the visual analysis. We study different molecular systems and demonstrate how the CSP peel and CSP lens operators help identify and study donor and acceptor characteristics in molecular systems.


title: Avoiding parameter fine-tuning in mass varying neutrino models of DE?

abstract: Coupled models of quintessence are usually introduced for avoiding or mitigating the parameter fine-tuning problem. At the same time, the coupled models should avoid the fine-tuning problem related to the initial conditions as quintessence models do. One more attractive feature of coupled models might be the explanation of the timescale at which the coincidence of DE and matter energy densities occur and the understanding of reason why after this the DE takes over. And finally, all these nice features should be unaffected by the quantum corrections of the potential. Having in mind these remarks, we shall focus our discussion on mass varying neutrino model of DE with inverse power-law potential to see how naturally does it work.


title: BotPercent: Estimating Bot Populations in Twitter Communities

abstract: Twitter bot detection is vital in combating misinformation and safeguarding the integrity of social media discourse. While malicious bots are becoming more and more sophisticated and personalized, standard bot detection approaches are still agnostic to social environments (henceforth, communities) the bots operate at. In this work, we introduce community-specific bot detection, estimating the percentage of bots given the context of a community. Our method -- BotPercent -- is an amalgamation of Twitter bot detection datasets and feature-, text-, and graph-based models, adjusted to a particular community on Twitter. We introduce an approach that performs confidence calibration across bot detection models, which addresses generalization issues in existing community-agnostic models targeting individual bots and leads to more accurate community-level bot estimations. Experiments demonstrate that BotPercent achieves state-of-the-art performance in community-level Twitter bot detection across both balanced and imbalanced class distribution settings, %outperforming existing approaches and presenting a less biased estimator of Twitter bot populations within the communities we analyze. We then analyze bot rates in several Twitter groups, including users who engage with partisan news media, political communities in different countries, and more. Our results reveal that the presence of Twitter bots is not homogeneous, but exhibiting a spatial-temporal distribution with considerable heterogeneity that should be taken into account for content moderation and social media policy making. The implementation of BotPercent is available at https://github.com/TamSiuhin/BotPercent.


title: Quantum Phase Transitions in periodically quenched systems

abstract: Quantum phase transitions encompass a variety of phenomena that occur in quantum systems exhibiting several possible symmetries. Traditionally, these transitions are explored by continuously varying a control parameter that connects two different symmetry configurations. Here we propose an alternative approach where the control parameter undergoes abrupt and time-periodic jumps between only two values. This approach yields results surprisingly similar to those obtained by the traditional one and may prove experimentally useful in situations where accessing the control parameter is challenging.


title: Long-time error bounds of low-regularity integrators for nonlinear Schr\"odinger equations

abstract: We introduce a new non-resonant low-regularity integrator for the cubic nonlinear Schr\"odinger equation (NLSE) allowing for long-time error estimates which are optimal in the sense of the underlying PDE. The main idea thereby lies in treating the zeroth mode exactly within the discretization. For long-time error estimates, we rigorously establish the long-time error bounds of different low-regularity integrators for the nonlinear Schr\"odinger equation (NLSE) with small initial data characterized by a dimensionless parameter $\varepsilon \in (0, 1]$. We begin with the low-regularity integrator for the quadratic NLSE in which the integral is computed exactly and the improved uniform first-order convergence in $H^r$ is proven at $O(\varepsilon \tau)$ for solutions in $H^r$ with $r > 1/2$ up to the time $T_{\varepsilon } = T/\varepsilon $ with fixed $T > 0$. Then, the improved uniform long-time error bound is extended to a symmetric second-order low-regularity integrator in the long-time regime. For the cubic NLSE, we design new non-resonant first-order and symmetric second-order low-regularity integrators which treat the zeroth mode exactly and rigorously carry out the error analysis up to the time $T_{\varepsilon } = T/\varepsilon ^2$. With the help of the regularity compensation oscillation (RCO) technique, the improved uniform error bounds are established for the new non-resonant low-regularity schemes, which further reduce the long-time error by a factor of $\varepsilon^2$ compared with classical low-regularity integrators for the cubic NLSE. Numerical examples are presented to validate the error estimates and compare with the classical time-splitting methods in the long-time simulations.


title: Alphazzle: Jigsaw Puzzle Solver with Deep Monte-Carlo Tree Search

abstract: Solving jigsaw puzzles requires to grasp the visual features of a sequence of patches and to explore efficiently a solution space that grows exponentially with the sequence length. Therefore, visual deep reinforcement learning (DRL) should answer this problem more efficiently than optimization solvers coupled with neural networks. Based on this assumption, we introduce Alphazzle, a reassembly algorithm based on single-player Monte Carlo Tree Search (MCTS). A major difference with DRL algorithms lies in the unavailability of game reward for MCTS, and we show how to estimate it from the visual input with neural networks. This constraint is induced by the puzzle-solving task and dramatically adds to the task complexity (and interest!). We perform an in-deep ablation study that shows the importance of MCTS and the neural networks working together. We achieve excellent results and get exciting insights into the combination of DRL and visual feature learning.


title: Superfluid-droplet crossover in a binary boson mixture on a ring: Exact diagonalization solutions for few-particle systems in one dimension

abstract: We investigate the formation of self-bound quantum droplets in a one-dimensional binary mixture of bosonic atoms, applying the method of numerical diagonalization of the full Hamiltonian. The excitation spectra and ground-state pair correlations signal the formation of a few-boson droplet when crossing the region of critical inter-species interactions. The self-binding affects the rotational excitations, displaying a change in the energy dispersion from negative curvature, associated with superfluidity in the many-body limit, to a nearly parabolic curvature indicative of rigid body rotation. We exploit two global symmetries of the system to further analyze the few-body modes in terms of transition matrix elements and breathing mode dynamics. The exact results are compared to the usual ad-hoc inclusion of higher-order contributions in the extended Gross-Pitaevskii equation, showing a remarkable agreement between the few-body regime and the thermodynamic limit in one dimension.


title: EfficientRep:An Efficient Repvgg-style ConvNets with Hardware-aware Neural Network Design

abstract: We present a hardware-efficient architecture of convolutional neural network, which has a repvgg-like architecture. Flops or parameters are traditional metrics to evaluate the efficiency of networks which are not sensitive to hardware including computing ability and memory bandwidth. Thus, how to design a neural network to efficiently use the computing ability and memory bandwidth of hardware is a critical problem. This paper proposes a method how to design hardware-aware neural network. Based on this method, we designed EfficientRep series convolutional networks, which are high-computation hardware(e.g. GPU) friendly and applied in YOLOv6 object detection framework. YOLOv6 has published YOLOv6N/YOLOv6S/YOLOv6M/YOLOv6L models in v1 and v2 versions.


title: Cutting multi-control quantum gates with ZX calculus

abstract: Circuit cutting, the decomposition of a quantum circuit into independent partitions, has become a promising avenue towards experiments with larger quantum circuits in the noisy-intermediate scale quantum (NISQ) era. While previous work focused on cutting qubit wires or two-qubit gates, in this work we introduce a method for cutting multi-controlled Z gates. We construct a decomposition and prove the upper bound $\mathcal{O}(6^{2K})$ on the associated sampling overhead, where $K$ is the number of cuts in the circuit. This bound is independent of the number of control qubits but can be further reduced to $\mathcal{O}(4.5^{2K})$ for the special case of CCZ gates. Furthermore, we evaluate our proposal on IBM hardware and experimentally show noise resilience due to the strong reduction of CNOT gates in the cut circuits.


title: Short-term Prediction and Filtering of Solar Power Using State-Space Gaussian Processes

abstract: Short-term forecasting of solar photovoltaic energy (PV) production is important for powerplant management. Ideally these forecasts are equipped with error bars, so that downstream decisions can account for uncertainty. To produce predictions with error bars in this setting, we consider Gaussian processes (GPs) for modelling and predicting solar photovoltaic energy production in the UK. A standard application of GP regression on the PV timeseries data is infeasible due to the large data size and non-Gaussianity of PV readings. However, this is made possible by leveraging recent advances in scalable GP inference, in particular, by using the state-space form of GPs, combined with modern variational inference techniques. The resulting model is not only scalable to large datasets but can also handle continuous data streams via Kalman filtering.


title: Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applications

abstract: Multimodality Representation Learning, as a technique of learning to embed information from different modalities and their correlations, has achieved remarkable success on a variety of applications, such as Visual Question Answering (VQA), Natural Language for Visual Reasoning (NLVR), and Vision Language Retrieval (VLR). Among these applications, cross-modal interaction and complementary information from different modalities are crucial for advanced models to perform any multimodal task, e.g., understand, recognize, retrieve, or generate optimally. Researchers have proposed diverse methods to address these tasks. The different variants of transformer-based architectures performed extraordinarily on multiple modalities. This survey presents the comprehensive literature on the evolution and enhancement of deep learning multimodal architectures to deal with textual, visual and audio features for diverse cross-modal and modern multimodal tasks. This study summarizes the (i) recent task-specific deep learning methodologies, (ii) the pretraining types and multimodal pretraining objectives, (iii) from state-of-the-art pretrained multimodal approaches to unifying architectures, and (iv) multimodal task categories and possible future improvements that can be devised for better multimodal learning. Moreover, we prepare a dataset section for new researchers that covers most of the benchmarks for pretraining and finetuning. Finally, major challenges, gaps, and potential research topics are explored. A constantly-updated paperlist related to our survey is maintained at https://github.com/marslanm/multimodality-representation-learning.


title: Hierarchical Classification of Research Fields in the "Web of Science" Using Deep Learning

abstract: This paper presents a hierarchical classification system that automatically categorizes a scholarly publication using its abstract into a three-tier hierarchical label set (discipline, field, subfield) in a multi-class setting. This system enables a holistic categorization of research activities in the mentioned hierarchy in terms of knowledge production through articles and impact through citations, permitting those activities to fall into multiple categories. The classification system distinguishes 44 disciplines, 718 fields and 1,485 subfields among 160 million abstract snippets in Microsoft Academic Graph (version 2018-05-17). We used batch training in a modularized and distributed fashion to address and allow for interdisciplinary and interfield classifications in single-label and multi-label settings. In total, we have conducted 3,140 experiments in all considered models (Convolutional Neural Networks, Recurrent Neural Networks, Transformers). The classification accuracy is > 90% in 77.13% and 78.19% of the single-label and multi-label classifications, respectively. We examine the advantages of our classification by its ability to better align research texts and output with disciplines, to adequately classify them in an automated way, and to capture the degree of interdisciplinarity. The proposed system (a set of pre-trained models) can serve as a backbone to an interactive system for indexing scientific publications in the future.


title: PresSim: An End-to-end Framework for Dynamic Ground Pressure Profile Generation from Monocular Videos Using Physics-based 3D Simulation

abstract: Ground pressure exerted by the human body is a valuable source of information for human activity recognition (HAR) in unobtrusive pervasive sensing. While data collection from pressure sensors to develop HAR solutions requires significant resources and effort, we present a novel end-to-end framework, PresSim, to synthesize sensor data from videos of human activities to reduce such effort significantly. PresSim adopts a 3-stage process: first, extract the 3D activity information from videos with computer vision architectures; then simulate the floor mesh deformation profiles based on the 3D activity information and gravity-included physics simulation; lastly, generate the simulated pressure sensor data with deep learning models. We explored two approaches for the 3D activity information: inverse kinematics with mesh re-targeting, and volumetric pose and shape estimation. We validated PresSim with an experimental setup with a monocular camera to provide input and a pressure-sensing fitness mat (80x28 spatial resolution) to provide the sensor ground truth, where nine participants performed a set of predefined yoga sequences.


title: Delayed Feedback in Kernel Bandits

abstract: Black box optimisation of an unknown function from expensive and noisy evaluations is a ubiquitous problem in machine learning, academic research and industrial production. An abstraction of the problem can be formulated as a kernel based bandit problem (also known as Bayesian optimisation), where a learner aims at optimising a kernelized function through sequential noisy observations. The existing work predominantly assumes feedback is immediately available; an assumption which fails in many real world situations, including recommendation systems, clinical trials and hyperparameter tuning. We consider a kernel bandit problem under stochastically delayed feedback, and propose an algorithm with $\tilde{\mathcal{O}}(\sqrt{\Gamma_k(T)T}+\mathbb{E}[\tau])$ regret, where $T$ is the number of time steps, $\Gamma_k(T)$ is the maximum information gain of the kernel with $T$ observations, and $\tau$ is the delay random variable. This represents a significant improvement over the state of the art regret bound of $\tilde{\mathcal{O}}(\Gamma_k(T)\sqrt{T}+\mathbb{E}[\tau]\Gamma_k(T))$ reported in Verma et al. (2022). In particular, for very non-smooth kernels, the information gain grows almost linearly in time, trivializing the existing results. We also validate our theoretical results with simulations.


title: Self-Similar Pattern in Coupled Parabolic Systems as Non-Equilibrium Steady States

abstract: We consider reaction-diffusion systems and other related dissipative systems on unbounded domains which would have a Liapunov function (and gradient structure) when posed on a finite domain. In this situation, the system may reach local equilibrium on a rather fast time scale but the infinite amount of mass or energy leads to persistent mass or energy flow for all times. In suitably rescaled variables the system converges to a steady state that corresponds to asymptotically self-similar behavior in the original system.


title: Toward a consistent performance evaluation for defect prediction models

abstract: In defect prediction community, many defect prediction models have been proposed and indeed more new models are continuously being developed. However, there is no consensus on how to evaluate the performance of a newly proposed model. In this paper, we aim to propose MATTER, a fraMework towArd a consisTenT pErformance compaRison, which makes model performance directly comparable across different studies. We take three actions to build a consistent evaluation framework for defect prediction models. First, we propose a simple and easy-to-use unsupervised baseline model ONE (glObal baseliNe modEl) to provide "a single point of comparison". Second, we propose using the SQA-effort-aligned threshold setting to make a fair comparison. Third, we suggest reporting the evaluation results in a unified way and provide a set of core performance indicators for this purpose, thus enabling an across-study comparison to attain real progress. The experimental results show that MATTER can serve as an effective framework to support a consistent performance evaluation for defect prediction models and hence can help determine whether a newly proposed defect prediction model is practically useful for practitioners and inform the real progress in the road of defect prediction. Furthermore, when applying MATTER to evaluate the representative defect prediction models proposed in recent years, we find that most of them (if not all) are not superior to the simple baseline model ONE in terms of the SQA-effort awareness prediction performance. This reveals that the real progress in defect prediction has been overestimated. We hence recommend that, in future studies, when any new defect prediction model is proposed, MATTER should be used to evaluate its actual usefulness (on the same benchmark test data sets) to advance scientific progress in defect prediction.


title: Integrability of the Dirac Equation in the Presence of Fluxes on Product Manifolds

abstract: This paper aims to show that the Dirac equation coupled to an arbitrary inhomogeneous flux field admits separation in manifolds formed from the direct product of bidimensional spaces. As a direct application of these results, we study a spin-$1/2$ charged particle propagating in a background conformally related to a novel and complex string-inspired model in $D = 10$ spacetime dimension whose base manifold is a product of four two-dimensional unit spheres, $S^{2}$, in the presence of $1$- and $3$-form fluxes.


title: Unrestricted quantum moduli algebras, III: Surfaces of arbitrary genus and skein algebras

abstract: We prove that the quantum moduli algebra associated to a possibly punctured compact oriented surface and a complex semisimple Lie algebra $\mathfrak{g}$ is a Noetherian and finitely generated ring; if the surface has punctures, we prove also that it has no non-trivial zero divisors. Moreover, we show that the quantum moduli algebra is isomorphic to the skein algebra of the surface, defined by means of the Reshetikhin-Turaev functor for the quantum group $U_q(\mathfrak{g})$, and which coincides with the Kauffman bracket skein algebra when $\mathfrak{g}=\mathfrak{sl}_2$.


title: Chatbots for Robotic Process Automation: Investigating Perceived Trust and User Satisfaction

abstract: Driven by ongoing improvements in machine learning, chatbots have increasingly grown from experimental interface prototypes to reliable and robust tools for process automation. Building on these advances, companies have identified various application scenarios, where the automated processing of human language can help foster task efficiency. To this end, the use of chatbots may not only decrease costs, but it is also said to boost user satisfaction. People's intention to use and/or reuse said technology, however, is often dependent on less utilitarian factors. Particularly trust and respective task satisfaction count as relevant usage predictors. In this paper, we thus present work that aims to shed some light on these two variable constructs. We report on an experimental study ($n=277$), investigating four different human-chatbot interaction tasks. After each task, participants were asked to complete survey items on perceived trust, perceived task complexity and perceived task satisfaction. Results show that task complexity impacts negatively on both trust and satisfaction. To this end, higher complexity was associated particularly with those conversations that relied on broad, descriptive chatbot answers, while conversations that span over several short steps were perceived less complex, even when the overall conversation was eventually longer.


title: Highly-stable, flexible delivery of microjoule-level ultrafast pulses in vacuumized anti-resonant hollow-core fibers for active synchronization

abstract: We demonstrate the stable and flexible light delivery of multi-{\mu}J, sub-200-fs pulses over a ~10-m-long vacuumized anti-resonant hollow-core fiber (AR-HCF), which was successfully used for high-performance pulse synchronization. Compared with the pulse train launched into the AR-HCF, the transmitted pulse train out of the fiber exhibits excellent stabilities in pulse power and spectrum, with pointing stability largely improved. The walk-off between the fiber-delivery and the other free-space-propagation pulse trains, in an open loop, was measured to be <6 fs root-mean-square (RMS) over 90 minutes, corresponding to a relative optical-path variation of <2x10-7. This walk-off can be further suppressed to ~2 fs RMS simply using an active control loop, highlighting the great application potentials of this AR-HCF set-up in large-scale laser and accelerator facilities.


title: Survey for Distant Solar Twins (SDST) -- III. Identification of new solar twin and solar analogue stars

abstract: The Survey for Distant Solar Twins (SDST) aims to find stars very similar to the Sun at distances 1-4 kpc, several times more distant than any currently known solar twins and analogues. The goal is to identify the best stars with which to test whether the fine-structure constant, alpha, varies with dark matter density in our Galaxy. Here we use EPIC, our line-by-line differential technique, to measure the stellar parameters - effective temperature Teff, surface gravity log g, metallicity [Fe/H] - from moderate resolution (R < 32,000) spectra of 877 solar twin and analogue candidates (547 at 1-4 kpc) observed with the HERMES spectrograph on the Anglo-Australian Telescope. These are consistent with expectations for Teff and log g from photometry, and for [Fe/H] from the Besancon stellar population model. EPIC provides small enough uncertainties (~90 K, 0.08 dex, 0.05 dex, respectively), even at the low signal-to-noise ratios available (S/N >~ 25 per pixel), to identify 299 new solar analogues (> 90% confidence), and 20 solar twins (>50% confidence), 206 and 12 of which are at 1-4 kpc. By extending EPIC to measure line broadening and lithium abundance from HERMES spectra, and with ages derived from isochrone fitting with our stellar parameters, we identify 174 solar analogues at 1-4 kpc which are relatively inactive, slowly rotating, and with no evidence of spectroscopic binarity. These are the preferred targets for follow-up spectroscopy to measure alpha.


title: Continuity bounds on observational entropy and measured relative entropies

abstract: We derive a measurement-independent asymptotic continuity bound on the observational entropy for general POVM measurements, making essential use of its property of bounded concavity. The same insight is used to obtain continuity bounds for other entropic quantities, including the measured relative entropy distance to a convex a set of states under a general set of measurements. As a special case, we define and study conditional observational entropy, which is an observational entropy in one (measured) subsystem conditioned on the quantum state in another (unmeasured) subsystem. We also study continuity of relative entropy with respect to a jointly applied channel, finding that observational entropy is uniformly continuous as a function of the measurement. But we show by means of an example that this continuity under measurements cannot have the form of a concrete asymptotic bound.


title: Deterministic equivalent and error universality of deep random features learning

abstract: This manuscript considers the problem of learning a random Gaussian network function using a fully connected network with frozen intermediate layers and trainable readout layer. This problem can be seen as a natural generalization of the widely studied random features model to deeper architectures. First, we prove Gaussian universality of the test error in a ridge regression setting where the learner and target networks share the same intermediate layers, and provide a sharp asymptotic formula for it. Establishing this result requires proving a deterministic equivalent for traces of the deep random features sample covariance matrices which can be of independent interest. Second, we conjecture the asymptotic Gaussian universality of the test error in the more general setting of arbitrary convex losses and generic learner/target architectures. We provide extensive numerical evidence for this conjecture, which requires the derivation of closed-form expressions for the layer-wise post-activation population covariances. In light of our results, we investigate the interplay between architecture design and implicit regularization.


title: mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video

abstract: Recent years have witnessed a big convergence of language, vision, and multi-modal pretraining. In this work, we present mPLUG-2, a new unified paradigm with modularized design for multi-modal pretraining, which can benefit from modality collaboration while addressing the problem of modality entanglement. In contrast to predominant paradigms of solely relying on sequence-to-sequence generation or encoder-based instance discrimination, mPLUG-2 introduces a multi-module composition network by sharing common universal modules for modality collaboration and disentangling different modality modules to deal with modality entanglement. It is flexible to select different modules for different understanding and generation tasks across all modalities including text, image, and video. Empirical study shows that mPLUG-2 achieves state-of-the-art or competitive results on a broad range of over 30 downstream tasks, spanning multi-modal tasks of image-text and video-text understanding and generation, and uni-modal tasks of text-only, image-only, and video-only understanding. Notably, mPLUG-2 shows new state-of-the-art results of 48.0 top-1 accuracy and 80.3 CIDEr on the challenging MSRVTT video QA and video caption tasks with a far smaller model size and data scale. It also demonstrates strong zero-shot transferability on vision-language and video-language tasks. Code and models will be released in https://github.com/alibaba/AliceMind.


title: Transposed Poisson structures on generalized Witt algebras and Block Lie algebras

abstract: We describe transposed Poisson structures on generalized Witt algebras $W(A,V, \langle \cdot,\cdot \rangle )$ and Block Lie algebras $L(A,g,f)$ over a field $F$ of characteristic zero, where $\langle \cdot,\cdot \rangle$ and $f$ are non-degenerate. More specifically, if $\dim(V)>1$, then all the transposed Poisson algebra structures on $W(A,V,\langle \cdot,\cdot \rangle)$ are trivial; and if $\dim(V)=1$, then such structures are, up to isomorphism, mutations of the group algebra structure on $FA$. The transposed Poisson algebra structures on $L(A,g,f)$ are in a one-to-one correspondence with commutative and associative multiplications defined on a complement of the square of $L(A,g,f)$ with values in the center of $L(A,g,f)$. In particular, all of them are usual Poisson structures on $L(A,g,f)$. This generalizes earlier results about transposed Poisson structures on Block Lie algebras $\mathcal{B}(q)$.


title: Physiological Imaging: When the Pixel Size Matters

abstract: With the proliferation of inexpensive CMOS cameras, medical imaging experiences a noticeable influx of new technologies. While anatomical imaging is based on well-established principles of photography, physiological optical imaging is a relatively novel range of technologies that requires considering a new set of technical and physiological aspects. We discuss several factors (binning, spatial frequency sampling, and distance to the target area) indispensable to getting quantifiable and reproducible results, which are the essence of physiological imaging. We also discussed their implications for several commonly used physiological imaging modalities, including hyperspectral/multispectral imaging, fluorescence imaging, and thermography. Physiological imaging technologies are in their infancy. Thus, the proper design, which considers technical and physiological aspects, is paramount to establishing their credibility and driving clinical adoption.