title: Muzeel: A Dynamic JavaScript Analyzer for Dead Code Elimination in Today's Web

abstract: JavaScript contributes to the increasing complexity of today's web. To support user interactivity and accelerate the development cycle, web developers heavily rely on large general-purpose third-party JavaScript libraries. This practice increases the size and the processing complexity of a web page by bringing additional functions that are not used by the page but unnecessarily downloaded and processed by the browser. In this paper, an analysis of around 40,000 web pages shows that 70% of JavaScript functions on the median page are unused, and the elimination of these functions would contribute to the reduction of the page size by 60%. Motivated by these findings, we propose Muzeel (which means eliminator in Arabic); a solution for eliminating JavaScript functions that are not used in a given web page (commonly referred to as dead code). Muzeel extracts all of the page event listeners upon page load, and emulates user interactions using a bot that triggers each of these events, in order to eliminate the dead code of functions that are not called by any of these events. Our evaluation results spanning several Android mobile phones and browsers show that Muzeel speeds up the page load by around 30% on low-end phones, and by 25% on high-end phones under 3G network. It also reduces the speed index (which is an important user experience metric) by 23% and 21% under the same network on low-end, and high-end phones, respectively. Additionally, Muzeel reduces the overall download size while maintaining the visual content and interactive functionality of the pages.


title: Common hypercyclic algebras for families of products of backward shifts

abstract: In this paper, we generalize to the context of algebras some recent results on the existence of common hypercyclic vectors for families of products of backward shift operators. We also give, in a multi-dimensional setting, a positive answer to a question raised by F. Bayart, D. Papathanasiou and the author about the existence of a common hypercyclic algebra on $\ell_1(\mathbb{N})$ with the convolution product for the family of backward shifts $(B_{w(\lambda)})_{\lambda>0}$ induced by the weights $w_n(\lambda)=1+\lambda/n$.


title: A diffuse-interface lattice Boltzmann method for fluid-particle interaction problems

abstract: In this paper, a diffuse-interface lattice Boltzmann method (DI-LBM) is developed for fluid-particle interaction problems. In this method, the sharp interface between the fluid and solid is replaced by a thin but nonzero thickness transition region named diffuse interface, where the physical variables varies continuously. In order to describe the diffuse interface, we introduce a smooth function, which is similar to the order parameter in phase-field model or the volume fraction of solid phase in the partially saturated lattice Boltzmann method (PS-LBM). In addition, to depict the fluid-particle interaction more accurately, a modified force term is also proposed and included in the evolution equation of the DI-LBM. Some classical problems are used to test the DI-LBM, and the results are in good agreement with some available theoretical and numerical works. Finally, it is also found that the DI-LBM is more efficient and accurate than the PS-LBM with the superposition model.


title: A force proportional to velocity squared derived from spacetime algebra

abstract: The underlying geometri of spacetime algebra allows one to derive a force by contracting the relativistic generalization of angular momentum, M, with the mass-current, mw, where w is a proper 4-vector velocity. By applying this force to a cosmological object, a repulsive inverse distance-square law is found, which is proportional to the velocity dispersion squared of that structure. It is speculated if this finding may be relevant to the recent suggestion, that such a force may accelerate the expanding universe with no need for a cosmological constant.


abstract: Feedback on the ASTRONET Science Vision and Infrastructure Roadmap from the CTA Consortium.


title: Gaussian distributions on Riemannian symmetric spaces, random matrices, and planar Feynman diagrams

abstract: Gaussian distributions can be generalized from Euclidean space to a wide class of Riemannian manifolds. Gaussian distributions on manifolds are harder to make use of in applications since the normalisation factors, which we will refer to as partition functions, are complicated, intractable integrals in general that depend in a highly non-linear way on the mean of the given distribution. Nonetheless, on Riemannian symmetric spaces, the partition functions are independent of the mean and reduce to integrals over finite dimensional vector spaces. These are generally still hard to compute numerically when the dimension (more precisely the rank $N$) of the underlying symmetric space gets large. On the space of positive definite Hermitian matrices, it is possible to compute these integrals exactly using methods from random matrix theory and the so-called Stieltjes-Wigert polynomials. In other cases of interest to applications, such as the space of symmetric positive definite (SPD) matrices or the Siegel domain (related to block-Toeplitz covariance matrices), these methods seem not to work quite as well. Nonetheless, it remains possible to compute leading order terms in a large $N$ limit, which provide increasingly accurate approximations as $N$ grows. This limit is inspired by realizing a given partition function as the partition function of a zero-dimensional quantum field theory or even Chern-Simons theory. From this point of view the large $N$ limit arises naturally and saddle-point methods, Feynman diagrams, and certain universalities that relate different spaces emerge.


title: Type-II Weyl semimetal vs gravastar

abstract: The boundary between the type I and type II Weyl semimetals serves as the event horizon for the "relativistic" fermions. The interior of the black hole is represented by the type II Weyl semimetal, where the Fermi surface is formed. The process of the filling of the Fermi surface by electrons results in the relaxation inside the horizon. This leads to the Hawking radiation and to the reconstruction of the interior vacuum state. After the Fermi surface is fully occupied, the interior region reaches the equilibrium state, for which the Hawking radiation is absent. If this scenario is applicable to the real black hole, then the final state of the black hole will be the dark energy star with the event horizon. Inside the event horizon one would have de Sitter space time, which is separated from the event horizon by the shell of the Planck length width. Both the de Sitter part and the shell are made of the vacuum fields without matter. This is distinct from the gravastar, in which the matter shell is outside the "horizon", and which we call the type I gravastar. But this is similar to the other type of the vacuum black hole, where the shell is inside the event horizon, and which we call the type II gravastar. We suggest to study the vacuum structure of the type II gravastar using the $q$-theory, where the vacuum variable is the 4-form field introduced for the phenomenological description of the quantum vacuum.


title: One-dimensional ghost imaging with an electron microscope: a route towards ghost imaging with inelastically scattered electrons

abstract: In quantum mechanics, entanglement and correlations are not just a mere sporadic curiosity, but rather common phenomena at the basis of an interacting quantum system. In electron microscopy, such concepts have not been extensively explored yet in all their implications; in particular, inelastic scattering can be reanalyzed in terms of correlation between the electron beam and the sample. While classical inelastic scattering simply implies loss of coherence in the electron beam, performing a joint measurement on the electron beam and the sample excitation could restore the coherence and the lost information. Here, we propose to exploit joint measurement in electron microscopy for a surprising and counter-intuitive application of the concept of ghost imaging. Ghost imaging, first proposed in quantum photonics, can be applied partially in electron microscopy by performing joint measurement between the portion of the transmitted electron beam and a photon emitted from the sample reaching a bucket detector. This would permit us to form a one-dimensional virtual image of an object that even has not interacted with the electron beam directly. This technique is extremely promising for low-dose imaging that requires the minimization of radiation exposure for electron-sensitive materials, because the object interacts with other form of waves, e.g., photons/surface plasmon polaritons, and not the electron beam. We demonstrate this concept theoretically for any inelastic electron-sample interaction in which the electron excites a single quantum of a collective mode, such as a photon, plasmon, phonon, magnon, or any optical polariton.


title: Detecting chaos in lineage-trees: A deep learning approach

abstract: Many complex phenomena, from weather systems to heartbeat rhythm patterns, are effectively modeled as low-dimensional dynamical systems. Such systems may behave chaotically under certain conditions, and so the ability to detect chaos based on empirical measurement is an important step in characterizing and predicting these processes. Classifying a system as chaotic usually requires estimating its largest Lyapunov exponent, which quantifies the average rate of convergence or divergence of initially close trajectories in state space, and for which a positive value is generally accepted as an operational definition of chaos. Estimating the largest Lyapunov exponent from observations of a process is especially challenging in systems affected by dynamical noise, which is the case for many models of real-world processes, in particular models of biological systems. We describe a novel method for estimating the largest Lyapunov exponent from data, based on training Deep Learning models on synthetically generated trajectories, and demonstrate that this method yields accurate and noise-robust predictions given relatively short inputs and across a range of different dynamical systems. Our method is unique in that it can analyze tree-shaped data, a ubiquitous topology in biological settings, and specifically in dynamics over lineages of cells or organisms. We also characterize the types of input information extracted by our models for their predictions, allowing for a deeper understanding into the different ways by which chaos can be analyzed in different topologies.


title: Early fault detection with multi-target neural networks

abstract: Wind power is seeing a strong growth around the world. At the same time, shrinking profit margins in the energy markets let wind farm managers explore options for cost reductions in the turbine operation and maintenance. Sensor-based condition monitoring facilitates remote diagnostics of turbine subsystems, enabling faster responses when unforeseen maintenance is required. Condition monitoring with data from the turbines' supervisory control and data acquisition (SCADA) systems was proposed and SCADA-based fault detection and diagnosis approaches introduced based on single-task normal operation models of turbine state variables. As the number of SCADA channels has grown strongly, thousands of independent single-target models are in place today for monitoring a single turbine. Multi-target learning was recently proposed to limit the number of models. This study applied multi-target neural networks to the task of early fault detection in drive-train components. The accuracy and delay of detecting gear bearing faults were compared to state-of-the-art single-target approaches. We found that multi-target multi-layer perceptrons (MLPs) detected faults at least as early and in many cases earlier than single-target MLPs. The multi-target MLPs could detect faults up to several days earlier than the single-target models. This can deliver a significant advantage in the planning and performance of maintenance work. At the same time, the multi-target MLPs achieved the same level of prediction stability.


title: Unicity on meromorphic function sharing three small functions CM with its higher-order difference operators

abstract: In this paper, we study the uniqueness of the shift of meromorphic functions. We prove: Let $f$ be a non-constant meromorphic function satisfying $\rho_{2}(f)<1$, let $\eta$ be a non-zero complex number, and let $a,b,c\in\hat{S}(f)$ be three distinct small functions. If $f$ and $\Delta^{n}_{\eta}f$ share $a,b,c$ CM, then $f\equiv \Delta^{n}_{\eta}f$.


title: Flux of information in scale-free networks

abstract: Scale-free networks constitute a fast-developing field that has already provided us with important tools to understand natural and social phenomena. From biological systems to environmental modifications, from quantum fields to high energy collisions, or from the number of contacts one person has, on average, to the flux of vehicles in the streets of urban centres, all these complex, non-linear problems are better understood under the light of the scale-free network's properties. A few mechanisms have been found to explain the emergence of scale invariance in complex networks. Here we discuss a mechanism based on how information is locally spread among agents in a scale-free network. We show that the correct description of the information dynamics is given in terms of the q-exponential function, with the power-law behaviour arising in the asymptotic limit. This result shows that the best statistical approach to the information dynamics is given by Tsallis Statistics. We discuss the main properties of the information spreading process in the network and analyse the role and behaviour of some of the parameters as the number of agents increases. The different mechanisms for optimization of the information spread are discussed.


title: Collaborative Training of Acoustic Encoders for Speech Recognition

abstract: On-device speech recognition requires training models of different sizes for deploying on devices with various computational budgets. When building such different models, we can benefit from training them jointly to take advantage of the knowledge shared between them. Joint training is also efficient since it reduces the redundancy in the training procedure's data handling operations. We propose a method for collaboratively training acoustic encoders of different sizes for speech recognition. We use a sequence transducer setup where different acoustic encoders share a common predictor and joiner modules. The acoustic encoders are also trained using co-distillation through an auxiliary task for frame level chenone prediction, along with the transducer loss. We perform experiments using the LibriSpeech corpus and demonstrate that the collaboratively trained acoustic encoders can provide up to a 11% relative improvement in the word error rate on both the test partitions.


title: A Direct Slip Ratio Estimation Method based on an Intelligent Tire and Machine Learning

abstract: Accurate estimation of the tire slip ratio is critical for vehicle safety, as it is necessary for vehicle control purposes. In this paper, an intelligent tire system is presented to develop a novel slip ratio estimation model using machine learning algorithms. The accelerations, generated by a triaxial accelerometer installed onto the inner liner of the tire, are varied when the tire rotates to update the contact patch. Meanwhile, the slip ratio reference value can be measured by the MTS Flat-Trac tire test platform. Then, by analyzing the variation between the accelerations and slip ratio, highly useful features are discovered, which are especially promising for assessing vertical acceleration. For these features, machine learning (ML) algorithms are trained to build the slip ratio estimation model, in which the ML algorithms include artificial neural networks (ANNs), gradient boosting machines (GBMs), random forests (RFs), and support vector machines (SVMs). Finally, the estimated NRMS errors are evaluated using 10-fold cross-validation (CV). The proposed estimation model is able to estimate the slip ratio continuously and stably using only the acceleration from the intelligent tire system, and the estimated slip ratio range can reach 30%. The estimation results have high robustness to vehicle velocity and load, where the best NRMS errors can reach 4.88%. In summary, the present study with the fusion of an intelligent tire system and machine learning paves the way for the accurate estimation of the tire slip ratio under different driving conditions, which create new opportunities for autonomous vehicles, intelligent tires, and tire slip ratio estimation.


title: Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Better

abstract: Deep Learning has revolutionized the fields of computer vision, natural language understanding, speech recognition, information retrieval and more. However, with the progressive improvements in deep learning models, their number of parameters, latency, resources required to train, etc. have all have increased significantly. Consequently, it has become important to pay attention to these footprint metrics of a model as well, not just its quality. We present and motivate the problem of efficiency in deep learning, followed by a thorough survey of the five core areas of model efficiency (spanning modeling techniques, infrastructure, and hardware) and the seminal work there. We also present an experiment-based guide along with code, for practitioners to optimize their model training and deployment. We believe this is the first comprehensive survey in the efficient deep learning space that covers the landscape of model efficiency from modeling techniques to hardware support. Our hope is that this survey would provide the reader with the mental model and the necessary understanding of the field to apply generic efficiency techniques to immediately get significant improvements, and also equip them with ideas for further research and experimentation to achieve additional gains.


title: Deep-learning based Tools for Automated Protocol Definition of Advanced Diagnostic Imaging Exams

abstract: Purpose: This study evaluates the effectiveness and impact of automated order-based protocol assignment for magnetic resonance imaging (MRI) exams using natural language processing (NLP) and deep learning (DL). Methods: NLP tools were applied to retrospectively process orders from over 116,000 MRI exams with 200 unique sub-specialized protocols ("Local" protocol class). Separate DL models were trained on 70\% of the processed data for "Local" protocols as well as 93 American College of Radiology ("ACR") protocols and 48 "General" protocols. The DL Models were assessed in an "auto-protocoling (AP)" inference mode which returns the top recommendation and in a "clinical decision support (CDS)" inference mode which returns up to 10 protocols for radiologist review. The accuracy of each protocol recommendation was computed and analyzed based on the difference between the normalized output score of the corresponding neural net for the top two recommendations. Results: The top predicted protocol in AP mode was correct for 82.8%, 73.8%, and 69.3% of the test cases for "General", "ACR", and "Local" protocol classes, respectively. Higher levels of accuracy over 96% were obtained for all protocol classes in CDS mode. However, at current validation performance levels, the proposed models offer modest, positive, financial impact on large-scale imaging networks. Conclusions: DL-based protocol automation is feasible and can be tuned to route substantial fractions of exams for auto-protocoling, with higher accuracy with more general protocols. Economic analyses of the tested algorithms indicate that improved algorithm performance is required to yield a practical exam auto-protocoling tool for sub-specialized imaging exams.


title: Economic thermodynamics

abstract: A thermodynamic approach to the description of economic systems and processes is developed. It is shown that there is a deep analogy between the parameters of thermodynamic and economic systems (markets); so each thermodynamic parameter can be associated with a certain economic parameter or indicator. The economic meaning of such primordially thermodynamic concepts as internal energy and temperature has been established. It is shown that many economic laws, which in economic theory are a generalization of the results of observations, or are based on the analysis of the psychology of the behavior of market actors, within the framework of economic thermodynamics can be obtained as the natural and formal results of the theory. In particular, we show that economic thermodynamics allows a natural description of such a phenomenon as inflation. The thermodynamic conditions of market equilibrium stability are derived and analyzed, as well as the Le Chatelier's principle as applied to economic systems.


title: Desarrollo de experiencias para la ense\~nanza y difusion de la Optica con impresion 3D

abstract: In this work, we present three experiences developed with 3D printing technology for teaching in Optics. These activities were planned, designed, and implemented to go deeper into knowledge about light polarization, reflection and refraction phenomena, and colour perception. The planning methodology is also detailed, in particular, the design and description of the activity. Experimental guides, 3D models and assembly manuals are available in a free and freely accessible web space. In summary, we demonstrate that the 3D printing can be used as a technological, inclusive and pedagogical resource for teaching. This methodology can be extended and adapted to other disciplines, as well as applied locally in educational institutions.


title: Social stress drives the multi-wave dynamics of COVID-19 outbreaks

abstract: The dynamics of epidemics depend on how people's behavior changes during an outbreak. At the beginning of the epidemic, people do not know about the virus, then, after the outbreak of epidemics and alarm, they begin to comply with the restrictions and the spreading of epidemics may decline. Over time, some people get tired/frustrated by the restrictions and stop following them (exhaustion), especially if the number of new cases drops down. After resting for a while, they can follow the restrictions again. But during this pause the second wave can come and become even stronger then the first one. Studies based on SIR models do not predict the observed quick exit from the first wave of epidemics. Social dynamics should be considered. The appearance of the second wave also depends on social factors. Many generalizations of the SIR model have been developed that take into account the weakening of immunity over time, the evolution of the virus, vaccination and other medical and biological details. However, these more sophisticated models do not explain the apparent differences in outbreak profiles between countries with different intrinsic socio-cultural features. In our work, a system of models of the COVID-19 pandemic is proposed, combining the dynamics of social stress with classical epidemic models. Social stress is described by the tools of sociophysics. The combination of a dynamic SIR-type model with the classical triad of stages of the general adaptation syndrome, alarm-resistance-exhaustion, makes it possible to describe with high accuracy the available statistical data for 13 countries. The sets of kinetic constants corresponding to optimal fit of model to data were found. They characterize the ability of society to mobilize efforts against epidemics and maintain this concentration over time, and can further help in the development of strategies specific to a particular society.


title: Estimating the Robustness of Public Transport Systems Using Machine Learning

abstract: The planning of attractive and cost efficient public transport systems is a highly complex optimization process involving many steps. Integrating robustness from a passenger's point of view makes the task even more challenging. With numerous different definitions of robustness in literature, a real-world acceptable evaluation of the robustness of a public transport system is to simulate its performance under a large number of possible scenarios. Unfortunately, this is computationally very expensive. In this paper, we therefore explore a new way of such a scenario-based robustness approximation by using methods from machine learning. We achieve a fast approach with a very high accuracy by gathering a subset of key features of a public transport system and its passenger demand and training an artificial neural network to learn the outcome of a given set of robustness tests. The network is then able to predict the robustness of untrained instances with high accuracy using only its key features, allowing for a robustness oracle for transport planners that approximates the robustness in constant time. Such an oracle can be used as black box to increase the robustness within a local search framework for integrated public transportation planning. In computational experiments with different benchmark instances we demonstrate an excellent quality of our predictions.


title: Optimized ensemble deep learning framework for scalable forecasting of dynamics containing extreme events

abstract: The remarkable flexibility and adaptability of both deep learning models and ensemble methods have led to the proliferation for their application in understanding many physical phenomena. Traditionally, these two techniques have largely been treated as independent methodologies in practical applications. This study develops an optimized ensemble deep learning (OEDL) framework wherein these two machine learning techniques are jointly used to achieve synergistic improvements in model accuracy, stability, scalability, and reproducibility prompting a new wave of applications in the forecasting of dynamics. Unpredictability is considered as one of the key features of chaotic dynamics, so forecasting such dynamics of nonlinear systems is a relevant issue in the scientific community. It becomes more challenging when the prediction of extreme events is the focus issue for us. In this circumstance, the proposed OEDL model based on a best convex combination of feed-forward neural networks, reservoir computing, and long short-term memory can play a key role in advancing predictions of dynamics consisting of extreme events. The combined framework can generate the best out-of-sample performance than the individual deep learners and standard ensemble framework for both numerically simulated and real world data sets. We exhibit the outstanding performance of the OEDL framework for forecasting extreme events generated from Lienard-type system, prediction of COVID-19 cases in Brazil, dengue cases in San Juan, and sea surface temperature in Nino 3.4 region.


title: Unusual dynamic susceptibility arising from soft ferromagnetic domains in MnBi8Te13 and Sb-doped MnBi2nTe3n+1 (n=2, 3)

abstract: MnBi2nTe3n+1(MBT) is the first intrinsic magnetic topological insulator and is promising to hostemergent phenomena such as quantum anomalous Hall effect. They can be made ferromagnetic by having n >= 4 or with Sb doping. We studied the magnetic dynamics in a few selected ferromag-netic (FM) MBT compounds, including MnBi8Te13and Sb doped MnBi2nTe3n+1(n= 2,3) usingAC susceptibility and magneto-optical imaging. Slow relaxation behavior is observed in all threecompounds, suggesting its universality among FM MBT. We attribute the origin of the relaxationbehavior to the irreversible domain movements since they only appear below the saturation fieldswhen ferromagnetic domains form. The very soft ferromagnetic domain nature is revealed by thelow-field fine-structured domains and high-field sea-urchin-shaped remanent-state domains imagedvia our magneto-optical measurements. Finally, we ascribe the rare "double-peak" behavior ob-served in the AC susceptibility under small DC bias fields to the very soft ferromagnetic domainformations.


title: Sleeper Agent: Scalable Hidden Trigger Backdoors for Neural Networks Trained from Scratch

abstract: As the curation of data for machine learning becomes increasingly automated, dataset tampering is a mounting threat. Backdoor attackers tamper with training data to embed a vulnerability in models that are trained on that data. This vulnerability is then activated at inference time by placing a "trigger" into the model's input. Typical backdoor attacks insert the trigger directly into the training data, although the presence of such an attack may be visible upon inspection. In contrast, the Hidden Trigger Backdoor Attack achieves poisoning without placing a trigger into the training data at all. However, this hidden trigger attack is ineffective at poisoning neural networks trained from scratch. We develop a new hidden trigger attack, Sleeper Agent, which employs gradient matching, data selection, and target model re-training during the crafting process. Sleeper Agent is the first hidden trigger backdoor attack to be effective against neural networks trained from scratch. We demonstrate its effectiveness on ImageNet and in black-box settings. Our implementation code can be found at https://github.com/hsouri/Sleeper-Agent.


title: Model-Based Counterfactual Synthesizer for Interpretation

abstract: Counterfactuals, serving as one of the emerging type of model interpretations, have recently received attention from both researchers and practitioners. Counterfactual explanations formalize the exploration of ``what-if'' scenarios, and are an instance of example-based reasoning using a set of hypothetical data samples. Counterfactuals essentially show how the model decision alters with input perturbations. Existing methods for generating counterfactuals are mainly algorithm-based, which are time-inefficient and assume the same counterfactual universe for different queries. To address these limitations, we propose a Model-based Counterfactual Synthesizer (MCS) framework for interpreting machine learning models. We first analyze the model-based counterfactual process and construct a base synthesizer using a conditional generative adversarial net (CGAN). To better approximate the counterfactual universe for those rare queries, we novelly employ the umbrella sampling technique to conduct the MCS framework training. Besides, we also enhance the MCS framework by incorporating the causal dependence among attributes with model inductive bias, and validate its design correctness from the causality identification perspective. Experimental results on several datasets demonstrate the effectiveness as well as efficiency of our proposed MCS framework, and verify the advantages compared with other alternatives.


title: Redefining Neural Architecture Search of Heterogeneous Multi-Network Models by Characterizing Variation Operators and Model Components

abstract: With neural architecture search methods gaining ground on manually designed deep neural networks -even more rapidly as model sophistication escalates-, the research trend shifts towards arranging different and often increasingly complex neural architecture search spaces. In this conjuncture, delineating algorithms which can efficiently explore these search spaces can result in a significant improvement over currently used methods, which, in general, randomly select the structural variation operator, hoping for a performance gain. In this paper, we investigate the effect of different variation operators in a complex domain, that of multi-network heterogeneous neural models. These models have an extensive and complex search space of structures as they require multiple sub-networks within the general model in order to answer to different output types. From that investigation, we extract a set of general guidelines, whose application is not limited to that particular type of model, and are useful to determine the direction in which an architecture optimization method could find the largest improvement. To deduce the set of guidelines, we characterize both the variation operators, according to their effect on the complexity and performance of the model; and the models, relying on diverse metrics which estimate the quality of the different parts composing it.


title: Data-driven, structure-preserving approximations to entropy-based moment closures for kinetic equations

abstract: We present a data-driven approach to construct entropy-based closures for the moment system from kinetic equations. The proposed closure learns the entropy function by fitting the map between the moments and the entropy of the moment system, and thus does not depend on the space-time discretization of the moment system and specific problem configurations such as initial and boundary conditions. With convex and $C^2$ approximations, this data-driven closure inherits several structural properties from entropy-based closures, such as entropy dissipation, hyperbolicity, and H-Theorem. We construct convex approximations to the Maxwell-Boltzmann entropy using convex splines and neural networks, test them on the plane source benchmark problem for linear transport in slab geometry, and compare the results to the standard, optimization-based M$_N$ closures. Numerical results indicate that these data-driven closures provide accurate solutions in much less computation time than the M$_N$ closures.


title: Protein-Polymer Mixtures in the Colloid Limit: Aggregation, Sedimentation and Crystallization

abstract: While proteins have been treated as particles with a spherically symmetric interaction, of course in reality the situation is rather more complex. A simple step towards higher complexity is to treat the proteins as non--spherical particles and that is the approach we pursue here. We investigate the phase behavior of enhanced green fluorescent protein (eGFP) under the addition of a non--adsorbing polymer, polyethylene glycol (PEG). From small angle x-ray scattering we infer that the eGFP undergoes dimerization and we treat the dimers as spherocylinders with aspect ratio $L/D-1 = 1.05$. Despite the complex nature of the proteins, we find that the phase behaviour is similar to that of hard spherocylinders with ideal polymer depletant, exhibiting aggregation and, in a small region of the phase diagram, crystallization. By comparing our measurements of the onset of aggregation with predictions for hard colloids and ideal polymers [S.V. Savenko and M. Dijkstra, J. Chem. Phys 124, 234902 (2006) and F. lo Verso et al., Phys. Rev. E 73, 061407 (2006)] we find good agreement, which suggests that the eGFP proteins are consistent with hard spherocylinders and ideal polymer.


title: Short proofs for long induced paths

abstract: We present a modification of the Depth first search algorithm, suited for finding long induced paths. We use it to give simple proofs of the following results. We show that the induced size-Ramsey number of paths satisfies $\hat{R}_{\mathrm{ind}}(P_n)\leq 5\cdot 10^7n$, thus giving an explicit constant in the linear bound, improving the previous bound with a large constant from a regularity lemma argument by Haxell, Kohayakawa and {\L}uczak. We also provide a bound for the $k$-color version, showing that $\hat{R}_{\mathrm{ind}}^k(P_n)=O(k^3\log^4k)n$. Finally, we present a new short proof of the fact that the binomial random graph in the supercritical regime, $G(n,\frac{1+\varepsilon}{n})$, contains typically an induced path of length $\Theta(\varepsilon^2) n$.


title: Ordering the processes with indefinite causal order

abstract: We show a method of describing processes with indefinite causal order (ICO) by a definite causal order. We do so by relabeling the processes that take place in the circuit in accordance with the basis of measurement of control qubit. Causal nonseparability is alleviated at a cost of nonlocality of the acting processes. This result highlights the key role of superposition in creating the paradox of ICO. We also draw attention to the issue of growing incompatibility of language in its current form (especially the logical structures it embodies) with the quantum logic.


title: Named Entity Recognition with Small Strongly Labeled and Large Weakly Labeled Data

abstract: Weak supervision has shown promising results in many natural language processing tasks, such as Named Entity Recognition (NER). Existing work mainly focuses on learning deep NER models only with weak supervision, i.e., without any human annotation, and shows that by merely using weakly labeled data, one can achieve good performance, though still underperforms fully supervised NER with manually/strongly labeled data. In this paper, we consider a more practical scenario, where we have both a small amount of strongly labeled data and a large amount of weakly labeled data. Unfortunately, we observe that weakly labeled data does not necessarily improve, or even deteriorate the model performance (due to the extensive noise in the weak labels) when we train deep NER models over a simple or weighted combination of the strongly labeled and weakly labeled data. To address this issue, we propose a new multi-stage computational framework -- NEEDLE with three essential ingredients: (1) weak label completion, (2) noise-aware loss function, and (3) final fine-tuning over the strongly labeled data. Through experiments on E-commerce query NER and Biomedical NER, we demonstrate that NEEDLE can effectively suppress the noise of the weak labels and outperforms existing methods. In particular, we achieve new SOTA F1-scores on 3 Biomedical NER datasets: BC5CDR-chem 93.74, BC5CDR-disease 90.69, NCBI-disease 92.28.


title: Pattern recognition in Deep Boltzmann machines

abstract: We consider a multi-layer Sherrington-Kirkpatrick spin-glass as a model for deep restricted Boltzmann machines and we solve for its quenched free energy, in the thermodynamic limit and allowing for a first step of replica symmetry breaking. This result is accomplished rigorously exploiting interpolating techniques and recovering the expression already known for the replica-symmetry case. Further, we drop the restriction constraint by introducing intra-layer connections among spins and we show that the resulting system can be mapped into a modular Hopfield network, which is also addressed rigorously via interpolating techniques up to the first step of replica symmetry breaking.


title: Search for gravitational waves from the coalescence of sub-solar mass binaries in the first half of Advanced LIGO and Virgo's third observing run

abstract: We present a search for gravitational waves from the coalescence of sub-solar mass black hole binaries using data from the first half of Advanced LIGO and Virgo's third observing run. The observation of a sub-solar mass black hole merger may be an indication of primordial origin; primordial black holes may contribute to the dark matter distribution. We search for black hole mergers where the primary mass is $0.1-7 M_{\odot}$ and the secondary mass is $0.1-1 M_{\odot}$. A variety of models predict the production and coalescence of binaries containing primordial black holes; some involve dynamical assembly which may allow for residual eccentricity to be observed. For component masses $>0.5 M_{\odot}$, we also search for sources in eccentric orbits, measured at a reference gravitational-wave frequency of 10 Hz, up to $e_{10}\sim 0.3$. We find no convincing candidates and place new upper limits on the rate of primordial black hole mergers. The merger rate of 0.5-0.5 (1.0-1.0)~$M_{\odot}$ sources is $<7100~(1200)$ Gpc$^{-3}$yr$^{-1}$. Our limits are $\sim3-4$ times more constraining than prior analyses. Finally, we demonstrate how our limits can be used to constrain arbitrary models of the primordial black hole mass distribution and merger rate.


title: Influence of magnetic entropy on stability and thermodynamic properties of Laves phase Fe2Mo from first principles

abstract: The thermodynamic and physical properties of the Laves phase Fe2Mo have been investigated using the finite-temperature quantum mechanical calculations within the frame of the density functional theory (DFT). All relevant free energy contributions including electronic, vibrational and magnetic excitations are considered. The quasi-harmonic Debye - Gruneisen theory is used. In this work, a new method of searching a thermal expansion path of compounds is proposed. It allows to reduce the problem to a one-dimensional case and minimize the free energy in one variable, in volume. The heat capacity, thermal expansion, elastic constants and bulk modulus are modelled. The calculated results analyzed and are in an agreement with the available experimental data. It is shown that magnetic entropy must be considered on equal footing with vibrational and electronic energies to reliably predict stability of Fe2Mo.


title: Nonequilibrium thermodynamics of self-supervised learning

abstract: Self-supervised learning (SSL) of energy based models has an intuitive relation to equilibrium thermodynamics because the softmax layer, mapping energies to probabilities, is a Gibbs distribution. However, in what way SSL is a thermodynamic process? We show that some SSL paradigms behave as a thermodynamic composite system formed by representations and self-labels in contact with a nonequilibrium reservoir. Moreover, this system is subjected to usual thermodynamic cycles, such as adiabatic expansion and isochoric heating, resulting in a generalized Gibbs ensemble (GGE). In this picture, we show that learning is seen as a demon that operates in cycles using feedback measurements to extract negative work from the system. As applications, we examine some SSL algorithms using this idea.


title: Augmenting the Sensing Performance of Entangled Photon Pairs through Asymmetry

abstract: We analyze theoretically and experimentally cases of asymmetric detection, stimulation, and loss within a quantum nonlinear interferometer of entangled pairs. We show that the visibility of the SU(1,1) interference directly discerns between loss on the measured mode (signal) and the conjugated mode (idler). This asymmetry also affects the phase sensitivity of the interferometer, where coherent seeding is shown to mitigate losses that are suffered by the conjugated mode; therefore increasing the maximum threshold of loss that permits sub-shot-noise phase detection. Our findings can improve the performance of setups that rely on direct detection of entangled pairs, such as quantum interferometry and imaging with undetected photons.


title: The Oxford Road Boundaries Dataset

abstract: In this paper we present the Oxford Road Boundaries Dataset, designed for training and testing machine-learning-based road-boundary detection and inference approaches. We have hand-annotated two of the 10 km-long forays from the Oxford Robotcar Dataset and generated from other forays several thousand further examples with semi-annotated road-boundary masks. To boost the number of training samples in this way, we used a vision-based localiser to project labels from the annotated datasets to other traversals at different times and weather conditions. As a result, we release 62605 labelled samples, of which 47639 samples are curated. Each of these samples contains both raw and classified masks for left and right lenses. Our data contains images from a diverse set of scenarios such as straight roads, parked cars, junctions, etc. Files for download and tools for manipulating the labelled data are available at: oxford-robotics-institute.github.io/road-boundaries-dataset


title: Four Skewed Tensor Distributions

abstract: With the rise of the "big data" phenomenon in recent years, data is coming in many different complex forms. One example of this is multi-way data that come in the form of higher-order tensors such as coloured images and movie clips. Although there has been a recent rise in models for looking at the simple case of three-way data in the form of matrices, there is a relative paucity of higher-order tensor variate methods. The most common tensor distribution in the literature is the tensor variate normal distribution; however, its use can be problematic if the data exhibit skewness or outliers. Herein, we develop four skewed tensor variate distributions which to our knowledge are the first skewed tensor distributions to be proposed in the literature, and are able to parameterize both skewness and tail weight. Properties and parameter estimation are discussed, and real and simulated data are used for illustration.


title: Analysis and prediction of changes in the temperature of the pure freshwater ice column in the Antarctic and the Arctic

abstract: This paper investigates the initial boundary value problem for a non-stationary one-dimensional heat equation that simulates the temperature distribution in freshwater ice near the Earth's poles. The mathematical model has been constructed taking into account solid-liquid phase transitions. Data from meteorological stations were used to determine the model parameters, with the help of which the necessary physical and thermophysical characteristics of the computational domain were obtained. For the numerical solution of the problem, the finite volume method (FVM) was used. For the obtained periodic regime, the temperature versus depth dependences for each month were plotted, and the depth of the active layer, as well as the depth of zero annual amplitudes were found for each meteorological station. A forecast of the ice temperature regime for 2100 was modeled for three Representative Concentration Pathway (RCP) scenarios of global warming: moderate RCP2.6, corresponding to the current emissions of RCP7 and adopted at the Paris Agreement in 2015 RCP1.9. By analyzing the impact of an additional 0,5 degrees Celsius of warming on other areas, a reduction in the full range of risks to humanity and the planet as a whole becomes evident with the proper efforts of the global community. Thus, the conducted modeling has confirmed the need to reduce the rate of global warming.


title: On uncommon systems of equations

abstract: A system of linear equations $L$ over $\mathbb{F}_q$ is common if the number of monochromatic solutions to $L$ in any two-colouring of $\mathbb{F}_q^n$ is asymptotically at least the expected number of monochromatic solutions in a random two-colouring of $\mathbb{F}_q^n$. Motivated by existing results for specific systems (such as Schur triples and arithmetic progressions), as well as extensive research on common and Sidorenko graphs, the systematic study of common systems of linear equations was recently initiated by Saad and Wolf. Building upon earlier work of Cameron, Cilleruelo and Serra, as well as Saad and Wolf, common linear equations have recently been fully characterised by Fox, Pham and Zhao, who asked about common \emph{systems} of equations. In this paper we move towards a classification of common systems of two or more linear equations. In particular we prove that any system containing an arithmetic progression of length four is uncommon, confirming a conjecture of Saad and Wolf. This follows from a more general result which allows us to deduce the uncommonness of a general system from certain properties of one- or two-equation subsystems.


title: Ookami: Deployment and Initial Experiences

abstract: Ookami is a computer technology testbed supported by the United States National Science Foundation. It provides researchers with access to the A64FX processor developed by Fujitsu in collaboration with RIK{\Xi}N for the Japanese path to exascale computing, as deployed in Fugaku, the fastest computer in the world. By focusing on crucial architectural details, the ARM-based, multi-core, 512-bit SIMD-vector processor with ultrahigh-bandwidth memory promises to retain familiar and successful programming models while achieving very high performance for a wide range of applications. We review relevant technology and system details, and the main body of the paper focuses on initial experiences with the hardware and software ecosystem for micro-benchmarks, mini-apps, and full applications, and starts to answer questions about where such technologies fit into the NSF ecosystem.


title: Learning to predict target location with turbulent odor plumes

abstract: Animal behavior and neural recordings show that the brain is able to measure both the intensity of an odor and the timing of odor encounters. However, whether intensity or timing of odor detections is more informative for olfactory-driven behavior is not understood. To tackle this question, we consider the problem of locating a target using the odor it releases. We ask whether the position of a target is best predicted by measures of timing intensity of its odor, sampled for a short period of time. To answer this question, we feed data from accurate numerical simulations of odor transport to machine learning algorithms that learn how to connect odor to target location. We find that both intensity and timing can separately predict target location even from a distance of several meters; however their efficacy varies with the dilution of the odor in space. Thus organisms that use olfaction from different ranges may have to switch among different modalities. This has implications on how the brain should represent odors as the target is approached. We demonstrate simple strategies to improve accuracy and robustness of the prediction by modifying odor sampling and appropriately combining distinct measures together. To test the predictions, animal behavior and odor representation should be monitored as the animal moves relative to the target, or in virtual conditions that mimic concentrated dilute environments.


title: Galaxy populations in haloes in high-density environments

abstract: There are hints suggesting that properties of galaxy populations in dark matter haloes may depend on their large-scale environment. Recent works point out that very low-density environments influence halo occupation distribution (HOD), however there is not a similar analysis focused on high-density environments. Here we use a simulated set of future virialized superstructures (FVS) to analyse the occupation of galaxies in haloes within these high globally dense regions. We use a publicly available simulated galaxy set constructed with a semi-analytical model to identify FVS in the simulation. Then, we computed the HOD within these superstructures for different absolute magnitude thresholds and make several analysis including the comparison to the global HOD results. We study the dependence on the results on properties of the FVS such as density and volume as well as consider the morphology of galaxies. We also analysed the properties of the stellar content of galaxies and the formation time of the haloes inside FVS. We find a significant increase in the HOD inside FVS. This result is present for all absolute magnitude thresholds explored. The effect is larger in the densest regions of FVS, but does not depend on the volume of the superstructure. We also find that the stellar-mass content of galaxies considerably differs inside the superstructures. Low mass haloes have their central and satellite galaxies with a higher stellar mass content (50%), and exhibit mean star ages (20%) older than average. For massive haloes in FVS we find that only the stellar mass of satellite galaxies varies considerably corresponding to a decrease of 50%. We find a significant statistical difference between the formation times of haloes in FVS and the average population. Haloes residing in superstructures formed earlier, a fact that leads to several changes in the HOD and their member galaxy properties.


title: mSHAP: SHAP Values for Two-Part Models

abstract: Two-part models are important to and used throughout insurance and actuarial science. Since insurance is required for registering a car, obtaining a mortgage, and participating in certain businesses, it is especially important that the models which price insurance policies are fair and non-discriminatory. Black box models can make it very difficult to know which covariates are influencing the results. SHAP values enable interpretation of various black box models, but little progress has been made in two-part models. In this paper, we propose mSHAP (or multiplicative SHAP), a method for computing SHAP values of two-part models using the SHAP values of the individual models. This method will allow for the predictions of two-part models to be explained at an individual observation level. After developing mSHAP, we perform an in-depth simulation study. Although the kernelSHAP algorithm is also capable of computing approximate SHAP values for a two-part model, a comparison with our method demonstrates that mSHAP is exponentially faster. Ultimately, we apply mSHAP to a two-part ratemaking model for personal auto property damage insurance coverage. Additionally, an R package (mshap) is available to easily implement the method in a wide variety of applications.


title: Virus-immune dynamics determined by prey-predator interaction network and epistasis in viral fitness landscape

abstract: Population dynamics and evolutionary genetics underly the structure of ecosystems, changing on the same timescale for interacting species with rapid turnover, such as virus (e.g. HIV) and immune response. Thus, an important problem in mathematical modeling is to connect ecology, evolution and genetics, which often have been treated separately. Here, extending analysis of multiple virus and immune response populations in a resource - prey (consumer) - predator model from Browne and Smith \cite{browne2018dynamics}, we show that long term dynamics of viral mutants evolving resistance at distinct epitopes (viral proteins targeted by immune responses) are governed by epistasis in the virus fitness landscape. In particular, the stability of persistent equilibrium virus-immune (prey-predator) network structures, such as nested and one-to-one, and bifurcations are determined by a collection of circuits defined by combinations of viral fitnesses that are minimally additive within a hypercube of binary sequences representing all possible viral epitope sequences ordered according to immunodominance hierarchy. Numerical solutions of our ordinary differential equation system, along with an extended stochastic version including random mutation, demonstrate how pairwise or multiplicative epistatic interactions shape viral evolution against concurrent immune responses and convergence to the multi-variant steady state predicted by theoretical results. Furthermore, simulations illustrate how periodic infusions of subdominant immune responses can induce a bifurcation in the persistent viral strains, offering superior host outcome over an alternative strategy of immunotherapy with strongest immune response.


title: On the approximation capability of GNNs in node classification/regression tasks

abstract: Graph Neural Networks (GNNs) are a broad class of connectionist models for graph processing. Recent studies have shown that GNNs can approximate any function on graphs, modulo the equivalence relation on graphs defined by the Weisfeiler--Lehman (WL) test. However, these results suffer from some limitations, both because they were derived using the Stone--Weierstrass theorem -- which is existential in nature, -- and because they assume that the target function to be approximated must be continuous. Furthermore, all current results are dedicated to graph classification/regression tasks, where the GNN must produce a single output for the whole graph, while also node classification/regression problems, in which an output is returned for each node, are very common. In this paper, we propose an alternative way to demonstrate the approximation capability of GNNs that overcomes these limitations. Indeed, we show that GNNs are universal approximators in probability for node classification/regression tasks, as they can approximate any measurable function that satisfies the 1--WL equivalence on nodes. The proposed theoretical framework allows the approximation of generic discontinuous target functions and also suggests the GNN architecture that can reach a desired approximation. In addition, we provide a bound on the number of the GNN layers required to achieve the desired degree of approximation, namely $2r-1$, where $r$ is the maximum number of nodes for the graphs in the domain.


title: Challenging luminosity measurements at the Electron-Ion Collider

abstract: A precise determination of absolute luminosity, using the bremsstrahlung process, at the future Electron-Ion Collider (EIC) will be very demanding, and its three major challenges are discussed herein. First, the bremsstrahlung rate suppression due to the so-called beam size effect has to be well controlled. Secondly, the impact of huge synchrotron radiation fluxes should be mitigated. Thirdly, enormous bremsstrahlung event rates, in excess of 10 GHz, have to be coped with. A basic layout of the luminosity measurement setup at the EIC, addressing these issues, is proposed, including preliminary detector technology choices. Finally, the uncertainties of three proposed methods are also discussed.


title: Measuring Abundance with Abundancy Index

abstract: A positive integer $n$ is called perfect if $ \sigma(n)=2n$, where $\sigma(n)$ denote the sum of divisors of $n$. In this paper we study the ratio $\frac{\sigma(n)}{n}$. We define the function Abundancy Index $I:\mathbb{N} \to \mathbb{Q}$ with $I(n)=\frac{\sigma(n)}{n}$. Then we study different properties of the Abundancy Index and discuss the set of Abundancy Index. Using this function we define a new class of numbers known as superabundant numbers. Finally, we study superabundant numbers and their connection with Riemann Hypothesis.


title: Surgical task expertise detected by a self-organizing neural network map

abstract: Individual grip force profiling of bimanual simulator task performance of experts and novices using a robotic control device designed for endoscopic surgery permits defining benchmark criteria that tell true expert task skills from the skills of novices or trainee surgeons. Grip force variability in a true expert and a complete novice executing a robot assisted surgical simulator task reveal statistically significant differences as a function of task expertise. Here we show that the skill specific differences in local grip forces are predicted by the output metric of a Self Organizing neural network Map (SOM) with a bio inspired functional architecture that maps the functional connectivity of somatosensory neural networks in the primate brain.


title: On discontinuities when computing the stress-field from the strain: a finite volume discretization

abstract: Recently, a widely applicable system of hyperbolic partial differential equations has been derived that enables the deterministic computation of a full heterogeneous stress field from a measured deformation field, for example, from a strain field obtained via digital image correlation. This information enables the determination of material properties, making this approach an alternative to finite element model updating or the virtual fields method. This article focuses on developing a finite volume discretization of this system of equations to address instabilities that arise from violations of the Courant-Friedrichs-Lewy condition. The developed discretization enables the system of equations to be applied to irregular geometries and finite deformation. We determine how, in general, one may translate knowledge of the traction at the boundary into boundary conditions, so that the numerical method can be applied to a variety of loading conditions. We analyse the solution structure in the case of deformation discontinuities, and the results are applied to account for discontinuities at the interfaces between finite volumes (this has relevance to other applications such as composite materials). Interestingly, the discontinuities cause reflection and transmission of the principal stresses. The finite volume discretization is validated using data output from commercial finite element software. Furthermore, the discretization is applied to an experimental uniaxial tension test with plastic deformation and necking. The strain field is obtained using digital image correlation, and the stress field is computed using the developed finite volume discretization. Together, these give the stress-strain behavior for each material element.


title: A mechanical analog of Bohr's atom based on de Broglie's double-solution approach

abstract: Motivated by recent developments of hydrodynamical quantum mechanical analogs [J. W. M. Bush, Annu. Rev. Fluid Mech. 47, 269-292 (2015)] we provide a relativistic model for a classical particle coupled to a scalar wave-field through a holonomic constraint. In presence of an external Coulomb field we define a regime where the particle is guided by the wave in a way similar to the old de Broglie phase-wave proposal. Moreover, this dualistic mechanical analog of the quantum theory is reminiscent of the double-solution approach suggested by de Broglie in 1927 and is able to reproduce the Bohr-Sommerfeld semiclassical quantization formula for an electron moving in a atom.


title: Herd Behaviors in Epidemics: A Dynamics-Coupled Evolutionary Games Approach

abstract: The recent COVID-19 pandemic has led to an increasing interest in the modeling and analysis of infectious diseases. The pandemic has made a significant impact on the way we behave and interact in our daily life. The past year has witnessed a strong interplay between human behaviors and epidemic spreading. In this paper, we propose an evolutionary game-theoretic framework to study the coupled evolutions of herd behaviors and epidemics. Our framework extends the classical degree-based mean-field epidemic model over complex networks by coupling it with the evolutionary game dynamics. The statistically equivalent individuals in a population choose their social activity intensities based on the fitness or the payoffs that depend on the state of the epidemics. Meanwhile, the spreading of the infectious disease over the complex network is reciprocally influenced by the players' social activities. We analyze the coupled dynamics by studying the stationary properties of the epidemic for a given herd behavior and the structural properties of the game for a given epidemic process. The decisions of the herd turn out to be strategic substitutes. We formulate an equivalent finite-player game and an equivalent network to represent the interactions among the finite populations. We develop structure-preserving approximation techniques to study time-dependent properties of the joint evolution of the behavioral and epidemic dynamics. The resemblance between the simulated coupled dynamics and the real COVID-19 statistics in the numerical experiments indicates the predictive power of our framework.


title: Virasoro conformal bootstrap with $c > 1$

abstract: We derive new constraints on the spectrum of two-dimensional conformal field theories with central charge $c>1.$ Employing the pillow representation of the four point correlator of identical scalars with dimension $\Delta_{\mathcal{O}}$ and positivity of the coefficients of its expansion in the elliptic nome we place central charge dependent bounds on the dimension of the first excited Virasoro primary the scalar couples to, in the form $\Delta_1<f(c,\Delta_{\mathcal{O}}).$ We give an analytic expression for $f(c,\Delta_{\mathcal{O}})$ and write down transcendental equations that significantly improve the analytic bound. We numerically evaluate the stronger bounds for arbitrary fixed values of $c$ and $\Delta_{\mathcal{O}}.$


title: Deriving Autism Spectrum Disorder Functional Networks from RS-FMRI Data using Group ICA and Dictionary Learning

abstract: The objective of this study is to derive functional networks for the autism spectrum disorder (ASD) population using the group ICA and dictionary learning model together and to classify ASD and typically developing (TD) participants using the functional connectivity calculated from the derived functional networks. In our experiments, the ASD functional networks were derived from resting-state functional magnetic resonance imaging (rs-fMRI) data. We downloaded a total of 120 training samples, including 58 ASD and 62 TD participants, which were obtained from the public repository: Autism Brain Imaging Data Exchange I (ABIDE I). Our methodology and results have five main parts. First, we utilize a group ICA model to extract functional networks from the ASD group and rank the top 20 regions of interest (ROIs). Second, we utilize a dictionary learning model to extract functional networks from the ASD group and rank the top 20 ROIs. Third, we merged the 40 selected ROIs from the two models together as the ASD functional networks. Fourth, we generate three corresponding masks based on the 20 selected ROIs from group ICA, the 20 ROIs selected from dictionary learning, and the 40 combined ROIs selected from both. Finally, we extract ROIs for all training samples using the above three masks, and the calculated functional connectivity was used as features for ASD and TD classification. The classification results showed that the functional networks derived from ICA and dictionary learning together outperform those derived from a single ICA model or a single dictionary learning model.


title: A transference principle for systems of linear equations, and applications to almost twin primes

abstract: The transference principle of Green and Tao enabled various authors to transfer Szemer\'edi's theorem on long arithmetic progressions in dense sets to various sparse sets of integers, mostly sparse sets of primes. In this paper, we provide a transference principle which applies to general affine-linear configurations of finite complexity. We illustrate the broad applicability of our transference principle with the case of almost twin primes, by which we mean either Chen primes or "bounded gap primes", as well as with the case of primes of the form $x^2+y^2+1$. Thus, we show that in these sets of primes the existence of solutions to finite complexity systems of linear equations is determined by natural local conditions. These applications rely on a recent work of the last two authors on Bombieri-Vinogradov type estimates for nilsequences.


title: Topological recursion for fully simple maps from ciliated maps

abstract: Ordinary maps satisfy topological recursion for a certain spectral curve $(x, y)$. We solve a conjecture from arXiv:1710.07851 that claims that fully simple maps, which are maps with non self-intersecting disjoint boundaries, satisfy topological recursion for the exchanged spectral curve $(y, x)$, making use of the topological recursion for ciliated maps arXiv:2105.08035.


title: Invertible Attention

abstract: Attention has been proved to be an efficient mechanism to capture long-range dependencies. However, so far it has not been deployed in invertible networks. This is due to the fact that in order to make a network invertible, every component within the network needs to be a bijective transformation, but a normal attention block is not. In this paper, we propose invertible attention that can be plugged into existing invertible models. We mathematically and experimentally prove that the invertibility of an attention model can be achieved by carefully constraining its Lipschitz constant. We validate the invertibility of our invertible attention on image reconstruction task with 3 popular datasets: CIFAR-10, SVHN, and CelebA. We also show that our invertible attention achieves similar performance in comparison with normal non-invertible attention on dense prediction tasks. The code is available at https://github.com/Schwartz-Zha/InvertibleAttention


title: Learning effective stochastic differential equations from microscopic simulations: linking stochastic numerics to deep learning

abstract: We identify effective stochastic differential equations (SDE) for coarse observables of fine-grained particle- or agent-based simulations; these SDE then provide useful coarse surrogate models of the fine scale dynamics. We approximate the drift and diffusivity functions in these effective SDE through neural networks, which can be thought of as effective stochastic ResNets. The loss function is inspired by, and embodies, the structure of established stochastic numerical integrators (here, Euler-Maruyama and Milstein); our approximations can thus benefit from backward error analysis of these underlying numerical schemes. They also lend themselves naturally to "physics-informed" gray-box identification when approximate coarse models, such as mean field equations, are available. Existing numerical integration schemes for Langevin-type equations and for stochastic partial differential equations (SPDE) can also be used for training; we demonstrate this on a stochastically forced oscillator and the stochastic wave equation. Our approach does not require long trajectories, works on scattered snapshot data, and is designed to naturally handle different time steps per snapshot. We consider both the case where the coarse collective observables are known in advance, as well as the case where they must be found in a data-driven manner.


title: A new probe of the high-redshift Universe: nulling CMB lensing with interloper-free "LIM-pair" lensing

abstract: Intermediate redshifts between galaxy surveys and the cosmic microwave background (CMB) remain unexplored territory. Line intensity mapping (LIM) offers a way to probe the $z\gtrsim 1$ Universe, including the epoch of reionization and the dark ages. Via exact nulling of the lensing kernel, we show that LIM lensing, in combination with galaxy (resp., CMB) lensing, can uniquely probe the $z\gtrsim 1$ (resp., pre-reionization) Universe. However, LIM foregrounds are a key hurdle to this futuristic technique. While continuum foregrounds can be controlled by discarding modes perpendicular to the line of sight (low $k_\parallel$ modes), interloper foregrounds haven't been addressed in the context of LIM lensing. In this paper, we quantify the interloper bias to LIM lensing for the first time, and derive a ''LIM-pair'' estimator which avoids it exactly after cross-correlating with CMB lensing. This new quadratic lensing estimator works by combining two intensity maps in different lines, from the same redshift, whose interlopers are uncorrelated. As a result, this foreground avoidance method is robust to even large changes in the amplitude of the interloper power and non-Gaussianity. The cross-spectrum of the LIM-pair estimator with CMB lensing is thus robust to the currently large theoretical uncertainties in LIM modeling at high redshift.


title: "I have no idea what they're trying to accomplish:" Enthusiastic and Casual Signal Users' Understanding of Signal PINs

abstract: We conducted an online study with $n = 235$ Signal users on their understanding and usage of PINs in Signal. In our study, we observe a split in PIN management and composition strategies between users who can explain the purpose of the Signal PINs (56%; enthusiasts) and users who cannot (44%; casual users). Encouraging adoption of PINs by Signal appears quite successful: only 14% opted-out of setting a PIN entirely. Among those who did set a PIN, most enthusiasts had long, complex alphanumeric PINs generated by and saved in a password manager. Meanwhile more casual Signal users mostly relied on short numeric-only PINs. Our results suggest that better communication about the purpose of the Signal PIN could help more casual users understand the features PINs enable (such as that it is not simply a personal identification number). This communication could encourage a stronger security posture.


title: Fungi anaesthesia

abstract: Electrical activity of fungus \emph{Pleurotus ostreatus} is characterised by slow (hours) irregular waves of baseline potential drift and fast (minutes) action potential likes spikes of the electrical potential. An exposure of the mycelium colonised substrate to a chloroform vapour lead to several fold decrease of the baseline potential waves and increase of their duration. The chloroform vapour also causes either complete cessation of spiking activity or substantial reduction of the spiking frequency. Removal of the chloroform vapour from the growth containers leads to a gradual restoration of the mycelium electrical activity.


title: A Flow-Based Neural Network for Time Domain Speech Enhancement

abstract: Speech enhancement involves the distinction of a target speech signal from an intrusive background. Although generative approaches using Variational Autoencoders or Generative Adversarial Networks (GANs) have increasingly been used in recent years, normalizing flow (NF) based systems are still scarse, despite their success in related fields. Thus, in this paper we propose a NF framework to directly model the enhancement process by density estimation of clean speech utterances conditioned on their noisy counterpart. The WaveGlow model from speech synthesis is adapted to enable direct enhancement of noisy utterances in time domain. In addition, we demonstrate that nonlinear input companding benefits the model performance by equalizing the distribution of input samples. Experimental evaluation on a publicly available dataset shows comparable results to current state-of-the-art GAN-based approaches, while surpassing the chosen baselines using objective evaluation metrics.


title: End-to-End Spoken Language Understanding for Generalized Voice Assistants

abstract: End-to-end (E2E) spoken language understanding (SLU) systems predict utterance semantics directly from speech using a single model. Previous work in this area has focused on targeted tasks in fixed domains, where the output semantic structure is assumed a priori and the input speech is of limited complexity. In this work we present our approach to developing an E2E model for generalized SLU in commercial voice assistants (VAs). We propose a fully differentiable, transformer-based, hierarchical system that can be pretrained at both the ASR and NLU levels. This is then fine-tuned on both transcription and semantic classification losses to handle a diverse set of intent and argument combinations. This leads to an SLU system that achieves significant improvements over baselines on a complex internal generalized VA dataset with a 43% improvement in accuracy, while still meeting the 99% accuracy benchmark on the popular Fluent Speech Commands dataset. We further evaluate our model on a hard test set, exclusively containing slot arguments unseen in training, and demonstrate a nearly 20% improvement, showing the efficacy of our approach in truly demanding VA scenarios.


title: Far-UV Fe Emission as Proxy of Eddington Ratios

abstract: The Eddington ratio is a key parameter that governs the diversity of quasar properties. It can be scaled with a strong anti-correlation between optical Fe II and [O III] emission. In search of such indicators in the far-UV band, the HST far-UV spectra of 150 low-redshift quasars are analyzed in combination with their optical SDSS counterparts. The strength of Fe II+Fe III 1123 emission is significantly correlated with that of optical Fe II. A moderate correlation may also exist between Fe II 1071 and optical Fe II. The finding opens the possibility that far-UV Fe II emission may serve as a new gauge of the Eddington ratios. The high- and low-ionization lines in the far-UV band display different patterns: for the quasars with higher Eddington ratios, the low-ionization UV lines are stronger, and the high-ionization lines are broader and weaker.


title: Evolving Image Compositions for Feature Representation Learning

abstract: Convolutional neural networks for visual recognition require large amounts of training samples and usually benefit from data augmentation. This paper proposes PatchMix, a data augmentation method that creates new samples by composing patches from pairs of images in a grid-like pattern. These new samples are assigned label scores that are proportional to the number of patches borrowed from each image. We then add a set of additional losses at the patch-level to regularize and to encourage good representations at both the patch and image levels. A ResNet-50 model trained on ImageNet using PatchMix exhibits superior transfer learning capabilities across a wide array of benchmarks. Although PatchMix can rely on random pairings and random grid-like patterns for mixing, we explore evolutionary search as a guiding strategy to jointly discover optimal grid-like patterns and image pairings. For this purpose, we conceive a fitness function that bypasses the need to re-train a model to evaluate each possible choice. In this way, PatchMix outperforms a base model on CIFAR-10 (+1.91), CIFAR-100 (+5.31), Tiny Imagenet (+3.52), and ImageNet (+1.16).


title: A learning agent that acquires social norms from public sanctions in decentralized multi-agent settings

abstract: Society is characterized by the presence of a variety of social norms: collective patterns of sanctioning that can prevent miscoordination and free-riding. Inspired by this, we aim to construct learning dynamics where potentially beneficial social norms can emerge. Since social norms are underpinned by sanctioning, we introduce a training regime where agents can access all sanctioning events but learning is otherwise decentralized. This setting is technologically interesting because sanctioning events may be the only available public signal in decentralized multi-agent systems where reward or policy-sharing is infeasible or undesirable. To achieve collective action in this setting we construct an agent architecture containing a classifier module that categorizes observed behaviors as approved or disapproved, and a motivation to punish in accord with the group. We show that social norms emerge in multi-agent systems containing this agent and investigate the conditions under which this helps them achieve socially beneficial outcomes.


title: An Intelligent Question Answering System based on Power Knowledge Graph

abstract: The intelligent question answering (IQA) system can accurately capture users' search intention by understanding the natural language questions, searching relevant content efficiently from a massive knowledge-base, and returning the answer directly to the user. Since the IQA system can save inestimable time and workforce in data search and reasoning, it has received more and more attention in data science and artificial intelligence. This article introduced a domain knowledge graph using the graph database and graph computing technologies from massive heterogeneous data in electric power. It then proposed an IQA system based on the electrical power knowledge graph to extract the intent and constraints of natural interrogation based on the natural language processing (NLP) method, to construct graph data query statements via knowledge reasoning, and to complete the accurate knowledge search and analysis to provide users with an intuitive visualization. This method thoroughly combined knowledge graph and graph computing characteristics, realized high-speed multi-hop knowledge correlation reasoning analysis in tremendous knowledge. The proposed work can also provide a basis for the context-aware intelligent question and answer.


title: Non-Equilibrium Dynamics in Two-Color, Few-Photon Dissociative Excitation and Ionization of D$_2$

abstract: D$_2$ molecules, excited by linearly cross-polarized femtosecond extreme ultraviolet (XUV) and near-infrared (NIR) light pulses, reveal highly structured D$^+$ ion fragment momenta and angular distributions that originate from two different 4-step dissociative ionization pathways after four photon absorption (1 XUV + 3 NIR). We show that, even for very low dissociation kinetic energy release $\le$~240~meV, specific electronic excitation pathways can be identified and isolated in the final ion momentum distributions. With the aid of {\it ab initio} electronic structure and time-dependent Schr\"odinger equation calculations, angular momentum, energy, and parity conservation are used to identify the excited neutral molecular states and molecular orientations relative to the polarization vectors in these different photoexcitation and dissociation sequences of the neutral D$_2$ molecule and its D$_2^+$ cation. In one sequential photodissociation pathway, molecules aligned along either of the two light polarization vectors are excluded, while another pathway selects molecules aligned parallel to the light propagation direction. The evolution of the nuclear wave packet on the intermediate \Bstate electronic state of the neutral D$_2$ molecule is also probed in real time.

categories: physics.atom-ph physics.chem-ph physics.optics quant-ph


title: Cascading Modular Network (CAM-Net) for Multimodal Image Synthesis

abstract: Deep generative models such as GANs have driven impressive advances in conditional image synthesis in recent years. A persistent challenge has been to generate diverse versions of output images from the same input image, due to the problem of mode collapse: because only one ground truth output image is given per input image, only one mode of the conditional distribution is modelled. In this paper, we focus on this problem of multimodal conditional image synthesis and build on the recently proposed technique of Implicit Maximum Likelihood Estimation (IMLE). Prior IMLE-based methods required different architectures for different tasks, which limit their applicability, and were lacking in fine details in the generated images. We propose CAM-Net, a unified architecture that can be applied to a broad range of tasks. Additionally, it is capable of generating convincing high frequency details, achieving a reduction of the Frechet Inception Distance (FID) by up to 45.3% compared to the baseline.


title: Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translation

abstract: Image-to-Image (I2I) multi-domain translation models are usually evaluated also using the quality of their semantic interpolation results. However, state-of-the-art models frequently show abrupt changes in the image appearance during interpolation, and usually perform poorly in interpolations across domains. In this paper, we propose a new training protocol based on three specific losses which help a translation network to learn a smooth and disentangled latent style space in which: 1) Both intra- and inter-domain interpolations correspond to gradual changes in the generated images and 2) The content of the source image is better preserved during the translation. Moreover, we propose a novel evaluation metric to properly measure the smoothness of latent style space of I2I translation models. The proposed method can be plugged into existing translation approaches, and our extensive experiments on different datasets show that it can significantly boost the quality of the generated images and the graduality of the interpolations.


title: Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation

abstract: Multi-task learning (MTL) aims to improve the generalization of several related tasks by learning them jointly. As a comparison, in addition to the joint training scheme, modern meta-learning allows unseen tasks with limited labels during the test phase, in the hope of fast adaptation over them. Despite the subtle difference between MTL and meta-learning in the problem formulation, both learning paradigms share the same insight that the shared structure between existing training tasks could lead to better generalization and adaptation. In this paper, we take one important step further to understand the close connection between these two learning paradigms, through both theoretical analysis and empirical investigation. Theoretically, we first demonstrate that MTL shares the same optimization formulation with a class of gradient-based meta-learning (GBML) algorithms. We then prove that for over-parameterized neural networks with sufficient depth, the learned predictive functions of MTL and GBML are close. In particular, this result implies that the predictions given by these two models are similar over the same unseen task. Empirically, we corroborate our theoretical findings by showing that, with proper implementation, MTL is competitive against state-of-the-art GBML algorithms on a set of few-shot image classification benchmarks. Since existing GBML algorithms often involve costly second-order bi-level optimization, our first-order MTL method is an order of magnitude faster on large-scale datasets such as mini-ImageNet. We believe this work could help bridge the gap between these two learning paradigms, and provide a computationally efficient alternative to GBML that also supports fast task adaptation.


title: End-to-End Semi-Supervised Object Detection with Soft Teacher

abstract: This paper presents an end-to-end semi-supervised object detection approach, in contrast to previous more complex multi-stage methods. The end-to-end training gradually improves pseudo label qualities during the curriculum, and the more and more accurate pseudo labels in turn benefit object detection training. We also propose two simple yet effective techniques within this framework: a soft teacher mechanism where the classification loss of each unlabeled bounding box is weighed by the classification score produced by the teacher network; a box jittering approach to select reliable pseudo boxes for the learning of box regression. On the COCO benchmark, the proposed approach outperforms previous methods by a large margin under various labeling ratios, i.e. 1\%, 5\% and 10\%. Moreover, our approach proves to perform also well when the amount of labeled data is relatively large. For example, it can improve a 40.9 mAP baseline detector trained using the full COCO training set by +3.6 mAP, reaching 44.5 mAP, by leveraging the 123K unlabeled images of COCO. On the state-of-the-art Swin Transformer based object detector (58.9 mAP on test-dev), it can still significantly improve the detection accuracy by +1.5 mAP, reaching 60.4 mAP, and improve the instance segmentation accuracy by +1.2 mAP, reaching 52.4 mAP. Further incorporating with the Object365 pre-trained model, the detection accuracy reaches 61.3 mAP and the instance segmentation accuracy reaches 53.0 mAP, pushing the new state-of-the-art.


title: Amortized Synthesis of Constrained Configurations Using a Differentiable Surrogate

abstract: In design, fabrication, and control problems, we are often faced with the task of synthesis, in which we must generate an object or configuration that satisfies a set of constraints while maximizing one or more objective functions. The synthesis problem is typically characterized by a physical process in which many different realizations may achieve the goal. This many-to-one map presents challenges to the supervised learning of feed-forward synthesis, as the set of viable designs may have a complex structure. In addition, the non-differentiable nature of many physical simulations prevents efficient direct optimization. We address both of these problems with a two-stage neural network architecture that we may consider to be an autoencoder. We first learn the decoder: a differentiable surrogate that approximates the many-to-one physical realization process. We then learn the encoder, which maps from goal to design, while using the fixed decoder to evaluate the quality of the realization. We evaluate the approach on two case studies: extruder path planning in additive manufacturing and constrained soft robot inverse kinematics. We compare our approach to direct optimization of the design using the learned surrogate, and to supervised learning of the synthesis problem. We find that our approach produces higher quality solutions than supervised learning, while being competitive in quality with direct optimization, at a greatly reduced computational cost.


title: Dispersive temporal holography for single-shot recovering comprehensive ultrafast dynamics

abstract: It is critical to characterize the carrier and instantaneous frequency distribution variation in ultrafast processes, all of which are determined by the optical phase. Nevertheless, there is no method that can single-shot record the intro-pulse phase evolution of pico/femtosecond signals, to date. By analogying holographic principle in space to the time domain and using the time-stretch method, we propose the dispersive temporal holography to single-shot recover the phase and amplitude of ultrafast signals. It is a general and comprehensive technology and can be applied to analyze ultrafast signals with highly complex dynamics. The method provides a new powerful tool for exploring ultrafast science, which may benefit many fields, including laser dynamics, ultrafast diagnostics, nonlinear optics, and so on.


title: On the training of sparse and dense deep neural networks: less parameters, same performance

abstract: Deep neural networks can be trained in reciprocal space, by acting on the eigenvalues and eigenvectors of suitable transfer operators in direct space. Adjusting the eigenvalues, while freezing the eigenvectors, yields a substantial compression of the parameter space. This latter scales by definition with the number of computing neurons. The classification scores, as measured by the displayed accuracy, are however inferior to those attained when the learning is carried in direct space, for an identical architecture and by employing the full set of trainable parameters (with a quadratic dependence on the size of neighbor layers). In this Letter, we propose a variant of the spectral learning method as appeared in Giambagli et al {Nat. Comm.} 2021, which leverages on two sets of eigenvalues, for each mapping between adjacent layers. The eigenvalues act as veritable knobs which can be freely tuned so as to (i) enhance, or alternatively silence, the contribution of the input nodes, (ii) modulate the excitability of the receiving nodes with a mechanism which we interpret as the artificial analogue of the homeostatic plasticity. The number of trainable parameters is still a linear function of the network size, but the performances of the trained device gets much closer to those obtained via conventional algorithms, these latter requiring however a considerably heavier computational cost. The residual gap between conventional and spectral trainings can be eventually filled by employing a suitable decomposition for the non trivial block of the eigenvectors matrix. Each spectral parameter reflects back on the whole set of inter-nodes weights, an attribute which we shall effectively exploit to yield sparse networks with stunning classification abilities, as compared to their homologues trained with conventional means.


title: A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detection

abstract: Mahalanobis distance (MD) is a simple and popular post-processing method for detecting out-of-distribution (OOD) inputs in neural networks. We analyze its failure modes for near-OOD detection and propose a simple fix called relative Mahalanobis distance (RMD) which improves performance and is more robust to hyperparameter choice. On a wide selection of challenging vision, language, and biology OOD benchmarks (CIFAR-100 vs CIFAR-10, CLINC OOD intent detection, Genomics OOD), we show that RMD meaningfully improves upon MD performance (by up to 15% AUROC on genomics OOD).


title: The cold circumgalactic medium in emission: MgII halos in TNG50

abstract: We outline theoretical predictions for extended emission from MgII, tracing cool ~10^4 K gas in the circumgalactic medium (CGM) of star-forming galaxies in the high-resolution TNG50 cosmological magnetohydrodynamical simulation. We synthesize surface brightness maps of this strong rest-frame ultraviolet metal emission doublet (2796, 2803), adopting the assumption that the resonant scattering of MgII can be neglected and connecting to recent and upcoming observations with the Keck/KCWI, VLT/MUSE, and BlueMUSE optical integral field unit spectrographs. Studying galaxies with stellar masses 7.5 < log(M*/M_sun) < 11 at redshifts z=0.3, 0.7, 1 and 2 we find that extended MgII halos in emission, similar to their Lyman-alpha counterparts, are ubiquitous across the galaxy population. Median surface brightness profiles exceed 10^-19 erg/s/cm^2/arcsec^2 in the central ~10s of kpc, and total halo MgII luminosity increases with mass for star-forming galaxies, reaching 10^40 erg/s for M* ~ 10^9.5 Msun. MgII halo sizes increase from a few kpc to > 20 kpc at the highest masses, and sizes are larger for halos in denser environments. MgII halos are highly structured, clumpy, and asymmetric, with isophotal axis ratio increasing with galaxy mass. Similarly, the amount and distribution of MgII emission depends on the star formation activity of the central galaxy. Kinematically, inflowing versus outflowing gas dominates the MgII luminosity at high and low galaxy masses, respectively, although the majority of MgII halo emission at z~0.7 traces near-equilibrium fountain flows and gas with non-negligible rotational support, rather than rapidly outflowing galactic winds.


title: Disentangling Online Chats with DAG-Structured LSTMs

abstract: Many modern messaging systems allow fast and synchronous textual communication among many users. The resulting sequence of messages hides a more complicated structure in which independent sub-conversations are interwoven with one another. This poses a challenge for any task aiming to understand the content of the chat logs or gather information from them. The ability to disentangle these conversations is then tantamount to the success of many downstream tasks such as summarization and question answering. Structured information accompanying the text such as user turn, user mentions, timestamps, is used as a cue by the participants themselves who need to follow the conversation and has been shown to be important for disentanglement. DAG-LSTMs, a generalization of Tree-LSTMs that can handle directed acyclic dependencies, are a natural way to incorporate such information and its non-sequential nature. In this paper, we apply DAG-LSTMs to the conversation disentanglement task. We perform our experiments on the Ubuntu IRC dataset. We show that the novel model we propose achieves state of the art status on the task of recovering reply-to relations and it is competitive on other disentanglement metrics.


title: Collisions in a gas-rich white dwarf planetary debris disc

abstract: WD 0145+234 is a white dwarf that is accreting metals from a circumstellar disc of planetary material. It has exhibited a substantial and sustained increase in 3-5 micron flux since 2018. Follow-up Spitzer photometry reveals that emission from the disc had begun to decrease by late 2019. Stochastic brightening events superimposed on the decline in brightness suggest the liberation of dust during collisional evolution of the circumstellar solids. A simple model is used to show that the observations are indeed consistent with ongoing collisions. Rare emission lines from circumstellar gas have been detected at this system, supporting the emerging picture of white dwarf debris discs as sites of collisional gas and dust production.


title: Asymptotic Observables and the Swampland

abstract: We show that constraints on scalar field potentials and towers of light massive states in asymptotic limits of scalar field space (as posited by the de Sitter Conjecture and the Swampland Distance Conjecture, respectively) are correlated with the prospects for defining asymptotic observables in expanding FRW cosmologies. The observations of a "census taker" in an eternally inflating cosmology are further related to the question of whether certain domain walls satisfy a version of the Weak Gravity Conjecture. This suggests that answers to fundamental questions about asymptotic observables in cosmology could help shed light on the Swampland program, and vice versa.


title: Causal State Updates in Real Scalar Quantum Field Theory

abstract: In relativistic Quantum Field Theory (QFT) ideal measurements of certain observables are physically impossible without violating causality. This prompts two questions: i) can a given observable be ideally measured in QFT, and ii) if not, in what sense can it be measured? Here we formulate a necessary and sufficient condition that any measurement, and more generally any state update (quantum operation), must satisfy to respect causality in real scalar QFT. We argue that for unitary `kicks' and operations involving 1-parameter families of Kraus operators, e.g. Gaussian measurements, the only causal observables are smeared fields and the identity -- the basic observables in real scalar QFT. We provide examples with more complicated operators such as products of smeared fields, and show that the associated state updates are acausal, and hence impossible. Despite this, one can still recover expectation values of such operators, and we show how to do this using only causal measurements of smeared fields.


title: Exponential Error Convergence in Data Classification with Optimized Random Features: Acceleration by Quantum Machine Learning

abstract: Classification is a common task in machine learning. Random features (RFs) stand as a central technique for scalable learning algorithms based on kernel methods, and more recently proposed optimized random features, sampled depending on the model and the data distribution, can significantly reduce and provably minimize the required number of features. However, existing research on classification using optimized RFs has suffered from computational hardness in sampling each optimized RF; moreover, it has failed to achieve the exponentially fast error-convergence speed that other state-of-the-art kernel methods can achieve under a low-noise condition. To overcome these slowdowns, we here construct a classification algorithm with optimized RFs accelerated by means of quantum machine learning (QML) and study its runtime to clarify overall advantage. We prove that our algorithm can achieve the exponential error convergence under the low-noise condition even with optimized RFs; at the same time, our algorithm can exploit the advantage of the significant reduction of the number of features without the computational hardness owing to QML. These results discover a promising application of QML to acceleration of the leading kernel-based classification algorithm without ruining its wide applicability and the exponential error-convergence speed.