title: Asymptotic Symmetry and Classical holographic dual of $dS_3$ supergravity

abstract: We consider minimal supergravity on (2+1)dimensional de-Sitter background. We fix the fall-off conditions for gravitini fields in order to fix the asymptotic phase space. Using the Chern-Simons formulation, we then derive the asymptotic symmetry algebra for this theory. The fall-off conditions impose constraints on the phase space which reduces the Chern Simons theory to a WZW model. Further constraints reduce it to a super-Liouville theory at the boundary. This can be treated as a classical dual for the supergravity theory in the bulk.


title: Type Checking Extracted Methods

abstract: Many object-oriented dynamic languages allow programmers to _extract methods_ from objects and treat them as functions. This allows for flexible programming patterns, but presents challenges for type systems. In particular, a simple treatment of method extraction would require methods to be contravariant in the receiver type, making overriding all-but-impossible. We present a detailed investigation of this problem, as well as an implemented and evaluated solution. Method extraction is a feature of many dynamically-typed and gradually-typed languages, ranging from Python and PHP to Flow and TypeScript. In these languages, the underlying representation of objects as records of procedures can be accessed, and the procedures that implement methods can be reified as functions that can be called independently. In many of these languages, the programmer can then explicitly specify the `this` value to be used when the method implementation is called. Unfortunately, as we show, existing gradual type systems such as TypeScript and Flow are unsound in the presence of method extraction. The problem for typing any such system is that the flexibility it allows must be tamed by requiring a connection between the object the method was extracted from, and the function value that is later called. In Racket, where a method extraction-like facility, dubbed "structure type properties", is fundamental to classes, generic methods, and other APIs, these same challenges arise, and must be solved to support this feature in Typed Racket. We show how to combine two existing type system features -- existential types and occurrence typing -- to produce a sound approach to typing method extraction. We formalize our design, extending an existing formal model of the Typed Racket type system, and prove that our extension is sound. Our design is also implemented in the released version of Racket, and is compatible with all existing Typed Racket packages, many of which already used a previous version of this feature.


title: The Manhattan and Lorentz Mirror Models -- A result on the Cylinder with low density of mirrors

abstract: We study the Manhattan and Lorentz Mirror models on an infinite cylinder of finite even width $n$, with the mirror probability $p$ satisfying $p<Cn^{-1}$, $C$ a constant. We use the Brauer and Walled Brauer algebras to show that the maximum height along the cylinder reached by a walker is order $p^{-2}$.


title: The QuaStar Survey: Detecting Hidden Low-Velocity Gas in the Milky Way's Circumgalactic Medium

abstract: From our position embedded within the Milky Way's interstellar medium (ISM), we have limited ability to detect gas at low relative velocities in the extended Galactic halo because those spectral lines are blended with much stronger signals from dense foreground gas. As a result, the content of the Milky Way's circumgalactic medium (CGM) is poorly constrained at $|v_{\rm LSR}|$ $\lesssim$ 150 km s$^{-1}$. To overcome this complication, the QuaStar Survey applies a spectral differencing technique using paired quasar-star sightlines to measure the obscured content of the Milky Way's CGM for the first time. We present measurements of the CIV doublet ($\lambda\lambda$ 1548 \r{A}, 1550 \r{A}), a rest-frame UV metal line transition detected in HST/COS spectra of 30 halo-star/quasar pairs evenly distributed across the sky at Galactic latitudes $|b|>30^\circ$. The 30 halo stars have well-constrained distances (d$\approx$5-14 kpc), and are paired with quasars separated by $<$ 2.8$^\circ$. We argue that the difference in absorption between the quasar and stellar sightlines originates primarily in the Milky Way's extended CGM beyond $\sim$10 kpc. For the Milky Way's extended, low velocity CGM ($|v|<$150 km/s), we place an upper limit on the mean CIV column density of $\rm \Delta logN_{LVCGM} < 13.39$ and find a covering fraction of $f_{\rm CIV,LVCGM} (\rm logN>13.65)=$ 20% [6/30], a value significantly lower than the covering fraction for star-forming galaxies at low redshift. Our results suggest either that the bulk of Milky Way's CIV-traced CGM lies at low Galactic latitudes, or that the Milky Way's CGM is lacking in warm, ionized material compared to low-redshift ($z < 0.1$) star-forming galaxy halos.


title: Ribbonlength and crossing number for folded ribbon knots

abstract: We study Kauffman's model of folded ribbon knots: knots made of a thin strip of paper folded flat in the plane. The ribbonlength is the length to width ratio of such a folded ribbon knot. We show for any knot or link type that there exist constants $c_1, c_2>0$ such that the ribbonlength is bounded above by $c_1\cdot Cr(K)^2$, and also by $c_2\cdot Cr(K)^{3/2}$. We use a different method for each bound. The constant $c_1$ is quite small in comparison to $c_2$, and the first bound is lower than the second for knots and links with $Cr(K)\leq$ 12,748.


title: On the impact of boundary conditions on weakly coupled thermoelastic wave model

abstract: The purpose of this paper is to demonstrate how different types of boundary conditions do not impact the asymptotic behaviour of the solutions of thermoelastic wave model. For an initial-boundary value problem associated with this system, we prove a global well-posedness result in a certain topology under appropriate regularity conditions on the data. Further, we show that under particular classes of boundary conditions, the energy associated to the system decays polynomially to zero and not exponentially.


title: Measure equivalence classification of transvection-free right-angled Artin groups

abstract: We prove that if two transvection-free right-angled Artin groups are measure equivalent, then they have isomorphic extension graphs. As a consequence, two right-angled Artin groups with finite outer automorphism groups are measure equivalent if and only if they are isomorphic. This matches the quasi-isometry classification. However, in contrast with the quasi-isometry question, we observe that no right-angled Artin group is superrigid for measure equivalence in the strongest possible sense, for two reasons. First, a right-angled Artin group $G$ is always measure equivalent to any graph product of infinite countable amenable groups over the same defining graph. Second, when $G$ is nonabelian, the automorphism group of the universal cover of the Salvetti complex of $G$ always contains infinitely generated (non-uniform) lattices.


title: Combining Deep Learning and String Kernels for the Localization of Swiss German Tweets

abstract: In this work, we introduce the methods proposed by the UnibucKernel team in solving the Social Media Variety Geolocation task featured in the 2020 VarDial Evaluation Campaign. We address only the second subtask, which targets a data set composed of nearly 30 thousand Swiss German Jodels. The dialect identification task is about accurately predicting the latitude and longitude of test samples. We frame the task as a double regression problem, employing a variety of machine learning approaches to predict both latitude and longitude. From simple models for regression, such as Support Vector Regression, to deep neural networks, such as Long Short-Term Memory networks and character-level convolutional neural networks, and, finally, to ensemble models based on meta-learners, such as XGBoost, our interest is focused on approaching the problem from a few different perspectives, in an attempt to minimize the prediction error. With the same goal in mind, we also considered many types of features, from high-level features, such as BERT embeddings, to low-level features, such as characters n-grams, which are known to provide good results in dialect identification. Our empirical results indicate that the handcrafted model based on string kernels outperforms the deep learning approaches. Nevertheless, our best performance is given by the ensemble model that combines both handcrafted and deep learning models.


title: Deflection of Light and Shadow Cast by a Dual Charged Stringy Black Hole

abstract: Gravitational lensing and black hole shadows are one of the strongest observational evidences to prove the existence of black holes in the universe. The gravitational lensing arises due to the deflection of light by the gravitational field of a gravitating body such as a black hole. Investigation of the shadow cast by a compact object as well as deflection of light around it may provide the useful information about physical nature of the particular compact object and other related aspects. In this paper, we study the deflection of light by a dual charged stringy black hole spacetime derived in dilaton-Maxwell gravity. The variation of deflection angle with the impact parameter for different values of electric and magnetic charges is studied. We also study the shadow of this black hole spacetime to obtain the radius of shadow cast by it. We have considered an optically thin emission disk around it and observed that there are not significant changes in the shadow cast by this black hole compared to well-known Schwarzschild black hole spacetime in GR.


title: Establishing limits for the monopole production in pp accelerators

abstract: The spin 1/2 magnetic monopole pair production and the spin 0 monopolium production are studied in proton-proton collisions. For the pair production, the velocity-dependent coupling model and the additional effective coupling with a magnetic moment parameter are used for the calculation of photon fusion and Drell Yan cross sections. Since the monopole mass is unknown, the mass range employed is based on the last results of ATLAS and the MoEDAL experiment, which set a minimal value of around 2 TeV. The cross sections are calculated for the center of mass energies of the LHC, for its successor, the HE-LHC and for the future collider FCC. As a result, the estimated mass limits for observation in LHC and the other accelerators are obtained and the advantages in using both effective couplings and the monopolium as an indirect measure are discussed.


title: MuSeM: Detecting Incongruent News Headlines using Mutual Attentive Semantic Matching

abstract: Measuring the congruence between two texts has several useful applications, such as detecting the prevalent deceptive and misleading news headlines on the web. Many works have proposed machine learning based solutions such as text similarity between the headline and body text to detect the incongruence. Text similarity based methods fail to perform well due to different inherent challenges such as relative length mismatch between the news headline and its body content and non-overlapping vocabulary. On the other hand, more recent works that use headline guided attention to learn a headline derived contextual representation of the news body also result in convoluting overall representation due to the news body's lengthiness. This paper proposes a method that uses inter-mutual attention-based semantic matching between the original and synthetically generated headlines, which utilizes the difference between all pairs of word embeddings of words involved. The paper also investigates two more variations of our method, which use concatenation and dot-products of word embeddings of the words of original and synthetic headlines. We observe that the proposed method outperforms prior arts significantly for two publicly available datasets.


title: Spectrum of Trace Deformed Yang-Mills Theories

abstract: In this paper we study, by means of numerical simulations, the behaviour of the scalar glueball mass and the ground state of the torelon for trace deformed Yang-Mills theory defined on $ \mathbb{R}^3\times S^1$, in which center symmetry is recovered even at small compactification radii. We find, by investigating both $SU(3)$ and $SU(4)$ pure gauge theories, that the glueball mass computed in the deformed theory, when center symmetry is recovered, is compatible with its value at zero temperature and does not show any significant dependence on the compactification radius; moreover, we establish a connection between the deformation parameter and an effective compactification size, which works well at least for small deformations. In addition, we observe that the ground state of the torelon which winds around the small traced deformed circle with size $l$ acquires a pleateau for large values of the strength $h$, with values which are compatible with a $1/l$ behavior but, on the other hand, are still not in complete agreement with the asymptotic semiclassical large-$N$ predictions.


title: How to detect a salami slicer: a stochastic controller-stopper game with unknown competition

abstract: We consider a stochastic game of control and stopping specified in terms of a process $X_t=-\theta \Lambda_t+W_t$, representing the holdings of Player 1, where $W$ is a Brownian motion, $\theta$ is a Bernoulli random variable indicating whether Player 2 is active or not, and $\Lambda$ is a non-decreasing process representing the accumulated "theft" or "fraud" performed by Player 2 (if active) against Player 1. Player 1 cannot observe $\theta$ or $\Lambda$ directly, but can merely observe the path of the process $X$ and may choose a stopping rule $\tau$ to deactivate Player 2 at a cost $M$. Player 1 thus does not know if she is the victim of fraud and operates in this sense under unknown competition. Player 2 can observe both $\theta$ and $W$ and seeks to choose the fraud strategy $\Lambda$ that maximizes the expected discounted amount \[{\mathbb E} \left [\theta\int _0^{\tau} e^{-rs} d\Lambda_s \right ],\] whereas Player 1 seeks to choose the stopping strategy $\tau$ so as to minimize the expected discounted cost \[{\mathbb E} \left [\theta\int _0^{\tau} e^{-rs} d\Lambda_s + e^{-r\tau}M{\mathbb I}_{\{\tau<\infty\}} \right ].\] This non-zero-sum game appears to be novel and is motivated by applications in fraud detection; it combines filtering (detection), non-singular control, stopping, strategic features (games) and asymmetric information. We derive Nash equilibria for this game; for some parameter values we find an equilibrium in pure strategies, and for other parameter values we find an equilibrium by allowing for randomized stopping strategies.


title: Integrated Approximate Dynamic Programming and Equivalent Consumption Minimization Strategy for Eco-Driving in a Connected and Automated Vehicle

abstract: This paper focuses on the velocity planning and energy management problems for Connected and Automated Vehicles (CAVs) with hybrid electric powertrains. The eco-driving problem is formulated in the spatial domain as a nonlinear dynamic optimization problem, in which information about the upcoming speed limits and road topography is assumed to be known a priori. To solve this problem, a novel Dynamic Programming (DP) based optimization method is proposed, in which a causal Equivalent Consumption Minimization Strategy (ECMS) is embedded. The underlying vehicle model to predict energy consumption over real-world routes is validated using experimental data. Further, a multi-layer hierarchical control architecture is proposed as a pathway to real-time implementation in a vehicle. The DP-ECMS algorithm is introduced for a long-horizon optimization problem, and then adapted for a receding horizon implementation using principles in Approximate Dynamic Programming (ADP). This computationally economical alternative to the traditional DP solution is then benchmarked and evaluated.


title: An effective field theory approach for electroweak interactions in the high energy limit

abstract: We present an effective action for the electroweak sector of the Standard Model valid for the calculation of scattering amplitudes in the high energy (Regge) limit. Gauge invariant Wilson lines are introduced to describe reggeized degrees of freedom whose interactions are generated by effective emission vertices. From this approach previous results at leading logarithmic accuracy for electroweak boson Regge trajectories are reproduced together with the corresponding interaction kernels. The proposed framework lays the path for calculations at higher orders in perturbation theory.


title: Theoretical Analysis of Self-Training with Deep Networks on Unlabeled Data

abstract: Self-training algorithms, which train a model to fit pseudolabels predicted by another previously-learned model, have been very successful for learning with unlabeled data using neural networks. However, the current theoretical understanding of self-training only applies to linear models. This work provides a unified theoretical analysis of self-training with deep networks for semi-supervised learning, unsupervised domain adaptation, and unsupervised learning. At the core of our analysis is a simple but realistic "expansion" assumption, which states that a low probability subset of the data must expand to a neighborhood with large probability relative to the subset. We also assume that neighborhoods of examples in different classes have minimal overlap. We prove that under these assumptions, the minimizers of population objectives based on self-training and input-consistency regularization will achieve high accuracy with respect to ground-truth labels. By using off-the-shelf generalization bounds, we immediately convert this result to sample complexity guarantees for neural nets that are polynomial in the margin and Lipschitzness. Our results help explain the empirical successes of recently proposed self-training algorithms which use input consistency regularization.


title: Domain Adversarial Neural Networks for Dysarthric Speech Recognition

abstract: Speech recognition systems have improved dramatically over the last few years, however, their performance is significantly degraded for the cases of accented or impaired speech. This work explores domain adversarial neural networks (DANN) for speaker-independent speech recognition on the UAS dataset of dysarthric speech. The classification task on 10 spoken digits is performed using an end-to-end CNN taking raw audio as input. The results are compared to a speaker-adaptive (SA) model as well as speaker-dependent (SD) and multi-task learning models (MTL). The experiments conducted in this paper show that DANN achieves an absolute recognition rate of 74.91% and outperforms the baseline by 12.18%. Additionally, the DANN model achieves comparable results to the SA model's recognition rate of 77.65%. We also observe that when labelled dysarthric speech data is available DANN and MTL perform similarly, but when they are not DANN performs better than MTL.


title: Infant-ID: Fingerprints for Global Good

abstract: In many of the least developed and developing countries, a multitude of infants continue to suffer and die from vaccine-preventable diseases and malnutrition. Lamentably, the lack of official identification documentation makes it exceedingly difficult to track which infants have been vaccinated and which infants have received nutritional supplements. Answering these questions could prevent this infant suffering and premature death around the world. To that end, we propose Infant-Prints, an end-to-end, low-cost, infant fingerprint recognition system. Infant-Prints is comprised of our (i) custom built, compact, low-cost (85 USD), high-resolution (1,900 ppi), ergonomic fingerprint reader, and (ii) high-resolution infant fingerprint matcher. To evaluate the efficacy of Infant-Prints, we collected a longitudinal infant fingerprint database captured in 4 different sessions over a 12-month time span (December 2018 to January 2020), from 315 infants at the Saran Ashram Hospital, a charitable hospital in Dayalbagh, Agra, India. Our experimental results demonstrate, for the first time, that Infant-Prints can deliver accurate and reliable recognition (over time) of infants enrolled between the ages of 2-3 months, in time for effective delivery of vaccinations, healthcare, and nutritional supplements (TAR=95.2% @ FAR = 1.0% for infants aged 8-16 weeks at enrollment and authenticated 3 months later).


title: Online Safety Assurance for Deep Reinforcement Learning

abstract: Recently, deep learning has been successfully applied to a variety of networking problems. A fundamental challenge is that when the operational environment for a learning-augmented system differs from its training environment, such systems often make badly informed decisions, leading to bad performance. We argue that safely deploying learning-driven systems requires being able to determine, in real time, whether system behavior is coherent, for the purpose of defaulting to a reasonable heuristic when this is not so. We term this the online safety assurance problem (OSAP). We present three approaches to quantifying decision uncertainty that differ in terms of the signal used to infer uncertainty. We illustrate the usefulness of online safety assurance in the context of the proposed deep reinforcement learning (RL) approach to video streaming. While deep RL for video streaming bests other approaches when the operational and training environments match, it is dominated by simple heuristics when the two differ. Our preliminary findings suggest that transitioning to a default policy when decision uncertainty is detected is key to enjoying the performance benefits afforded by leveraging ML without compromising on safety.


title: Improved accuracy and transferability of molecular-orbital-based machine learning: Organics, transition-metal complexes, non-covalent interactions, and transition states

abstract: Molecular-orbital-based machine learning (MOB-ML) provides a general framework for the prediction of accurate correlation energies at the cost of obtaining molecular orbitals. We demonstrate the importance of preserving physical constraints, including invariance conditions and size consistency, when generating the input for the machine learning model. Numerical improvements are demonstrated for different data sets covering total and relative energies for thermally accessible organic and transition-metal containing molecules, non-covalent interactions, and transition-state energies. MOB-ML requires training data from only 1% of the QM7b-T data set (i.e., only 70 organic molecules with seven and fewer heavy atoms) to predict the total energy of the remaining 99% of this data set with sub-kcal/mol accuracy. This MOB-ML model is significantly more accurate than other methods when transferred to a data set comprised of thirteen heavy atom molecules, exhibiting no loss of accuracy on a size intensive (i.e., per-electron) basis. It is shown that MOB-ML also works well for extrapolating to transition-state structures, predicting the barrier region for malonaldehyde intramolecular proton-transfer to within 0.35 kcal/mol when only trained on reactant/product-like structures. Finally, the use of the Gaussian process variance enables an active learning strategy for extending MOB-ML model to new regions of chemical space with minimal effort. We demonstrate this active learning strategy by extending a QM7b-T model to describe non-covalent interactions in the protein backbone-backbone interaction data set to an accuracy of 0.28 kcal/mol.


title: Ionic structure around polarizable metal nanoparticles in aqueous electrolytes

abstract: Metal nanoparticles are receiving increased scientific attention owing to their unique physical and chemical properties that make them suitable for a wide range of applications in diverse fields, such as electrochemistry, biochemistry, and nanomedicine. Their high metallic polarizability is a crucial determinant that defines their electrostatic character in various electrolyte solutions. Here, we introduce a continuum-based model of a metal nanoparticle with explicit polarizability in the presence of different kinds of electrolytes. We employ several, variously sophisticated, theoretical approaches, corroborated by Monte Carlo simulations in order to elucidate the basic electrostatics principles of the model. We investigate how different kinds of asymmetries between the ions result in non-trivial phenomena, such as charge separation and a build-up of a so-called zero surface-charge double layer.


title: Two-epoch orbit estimation for wide binaries resolved in Hipparcos and Gaia

abstract: The Hipparcos catalog and its Double and Multiple System Annex (DMSA) lists 4099 components with individual proper motions and coordinates on the epoch 1991.25. Many of these long-period binary stars are also present in the Gaia Data Release 2 (DR2). Using the available relative positions and proper motions separated by 25.25 years, the equations of relative orbital motion can be solved for the two epoch eccentric anomalies, orbital period, and eccentricity. The method employs elimination of the linear Thiele-Innes unknowns and nonlinear optimization of the remaining condition equations. The quality of these solutions is compromised by the insufficient condition and modest precision of the Hipparcos astrometric data, as revealed by Monte-Carlo simulations with artificially perturbed data points. The presence of multiple systems and optical pairs can also perturb the results. Limited experiments with artificial data indicate that useful estimates can be obtained with a 25-year epoch difference for wide binaries with orbital periods up to $\sim 500$ years. The prospects of this method dramatically improve with the proposed next-generation space astrometry missions such as Gaia-NIR and Theia, especially when additional conditions are included from astrometric or spectroscopic measurements. A ancillary catalog of cross-identification and astrometric information for 1295 double star pairs cross-matched in Gaia DR2 and Hipparcos is published.


title: Studying the UK Job Market During the COVID-19 Crisis with Online Job Ads

abstract: The COVID-19 global pandemic and the lockdown policies enacted to mitigate it have had profound effects on the labour market. Understanding these effects requires us to obtain and analyse data in as close to real time as possible, especially as rules change rapidly and local lockdowns are enacted. In this work we study the UK labour market by analysing data from the online job board Reed.co.uk. Using topic modelling and geo-inference methods we are able to break down the data by sector and geography. We also study how the salary, contract type and mode of work have changed since the COVID-19 crisis hit the UK in March. Overall, vacancies were down by 60 to 70\% in the first weeks of lockdown. By the end of the year numbers had recovered somewhat, but the total job ad deficit is measured to be over 40\%. Broken down by sector, vacancies for hospitality and graduate jobs are greatly reduced, while there were more care work and nursing vacancies during lockdown. Differences by geography are less significant than between sectors, though there is some indication that local lockdowns stall recovery and less badly hit areas may have experienced a smaller reduction in vacancies. There are also small but significant changes in the salary distribution and number of full time and permanent jobs. In addition to these results, this work presents an open methodology that enables a rapid and detailed survey of the job market in these unsettled conditions and we describe a web application \url{jobtrender.com} that allows others to query this data set.


title: Revisiting Batch Normalization for Improving Corruption Robustness

abstract: The performance of DNNs trained on clean images has been shown to decrease when the test images have common corruptions. In this work, we interpret corruption robustness as a domain shift and propose to rectify batch normalization (BN) statistics for improving model robustness. This is motivated by perceiving the shift from the clean domain to the corruption domain as a style shift that is represented by the BN statistics. We find that simply estimating and adapting the BN statistics on a few (32 for instance) representation samples, without retraining the model, improves the corruption robustness by a large margin on several benchmark datasets with a wide range of model architectures. For example, on ImageNet-C, statistics adaptation improves the top1 accuracy of ResNet50 from 39.2% to 48.7%. Moreover, we find that this technique can further improve state-of-the-art robust models from 58.1% to 63.3%.


title: Generalized Backlund transformations for Affine Toda Hierarchies

abstract: The construction of generalized Backlund transformation for the $A_n$ Affine Toda hierarchy is proposed in terms of gauge transformation acting on the zero curvature representation. Such construction is based upon the graded structure of the underlying affine algebra which induces a classification of generalized Backlund transformations. Moreover, explicit examples for $su(3)$ and $su(4)$ lead to uncover interesting composition properties of various types of Backlund transformations. The universality character of the gauge-Backlund transformation method is extended to all equations of the hierarchy. Such interesting property provides a systematic framework to construct Backlund transformations to higher flow equations. Explicit example for the simplest higher flow of the $sl(3)$ hierarchy is presented.


title: Inflation of Universe by Nonlinear Electrodynamics

abstract: Nonlinear electrodynamics with two dimensional parameters is studied. The range of electromagnetic fields when principles of causality, unitarity and the classical stability hold, are obtained. A singularity of the electric field at the center of charges is absent within our model and there are corrections to the Coulomb law as $r\rightarrow\infty$. The universe inflation takes place in the background of stochastic magnetic fields. The second stage of the universe evolution is the radiation era so that the graceful exit exists. We estimated the spectral index, the tensor-to-scalar ratio, and the running of the spectral index that are in a rough accord with the PLANCK and WMAP data.


title: Simplicial Neural Networks

abstract: We present simplicial neural networks (SNNs), a generalization of graph neural networks to data that live on a class of topological spaces called simplicial complexes. These are natural multi-dimensional extensions of graphs that encode not only pairwise relationships but also higher-order interactions between vertices - allowing us to consider richer data, including vector fields and $n$-fold collaboration networks. We define an appropriate notion of convolution that we leverage to construct the desired convolutional neural networks. We test the SNNs on the task of imputing missing data on coauthorship complexes.


title: Exploring the hydrostatic mass bias in MUSIC clusters: application to the NIKA2 mock sample

abstract: Clusters of galaxies are useful tools to constrain cosmological parameters, only if their masses can be correctly inferred from observations. In particular, X-ray and Sunyaev-Zeldovich (SZ) effect observations can be used to derive masses within the framework of the hydrostatic equilibrium. Therefore, it is crucial to have a good control of the possible mass biases that can be introduced when this hypothesis is not valid. In this work, we analyzed a set of 260 synthetic clusters from the MUSIC simulation project, at redshifts $0 \leq z \leq 0.82$. We estimate the hydrostatic mass of the MUSIC clusters from X-ray only (temperature and density) and from X-ray and SZ (density and pressure). Then, we compare them with the true 3D dynamical mass. The biases are of the order of 20%. We find that using the temperature instead of the pressure leads to a smaller bias, although the two values are compatible within 1$\sigma$. Non-thermal contributions to the total pressure support, arising from bulk motion and turbulence of the gas, are also computed and show that they are sufficient to account for this bias. We also present a study of the correlation between the mass bias and the dynamical state of the clusters. A clear correlation is shown between the relaxation state of the clusters and the bias factor. We applied the same analysis on a subsample of 32 objects, already selected for supporting the NIKA2 SZ Large Program.


title: Hierarchical Relational Inference

abstract: Common-sense physical reasoning in the real world requires learning about the interactions of objects and their dynamics. The notion of an abstract object, however, encompasses a wide variety of physical objects that differ greatly in terms of the complex behaviors they support. To address this, we propose a novel approach to physical reasoning that models objects as hierarchies of parts that may locally behave separately, but also act more globally as a single whole. Unlike prior approaches, our method learns in an unsupervised fashion directly from raw visual images to discover objects, parts, and their relations. It explicitly distinguishes multiple levels of abstraction and improves over a strong baseline at modeling synthetic and real-world videos.


title: MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metrics

abstract: Posing reading comprehension as a generation problem provides a great deal of flexibility, allowing for open-ended questions with few restrictions on possible answers. However, progress is impeded by existing generation metrics, which rely on token overlap and are agnostic to the nuances of reading comprehension. To address this, we introduce a benchmark for training and evaluating generative reading comprehension metrics: MOdeling Correctness with Human Annotations. MOCHA contains 40K human judgement scores on model outputs from 6 diverse question answering datasets and an additional set of minimal pairs for evaluation. Using MOCHA, we train a Learned Evaluation metric for Reading Comprehension, LERC, to mimic human judgement scores. LERC outperforms baseline metrics by 10 to 36 absolute Pearson points on held-out annotations. When we evaluate robustness on minimal pairs, LERC achieves 80% accuracy, outperforming baselines by 14 to 26 absolute percentage points while leaving significant room for improvement. MOCHA presents a challenging problem for developing accurate and robust generative reading comprehension metrics.


title: Dehn Function of Finitely Presented Metabelian Groups

abstract: In this paper, we compute an upper bound for the Dehn function of a finitely presented metabelian group. In addition, we prove that the same upper bound works for the relative Dehn function of a finitely generated metabelian group. We also show that every wreath product of a free abelian group of finite rank with a finitely generated abelian group can be embedded into a metabelian group with exponential Dehn function.


title: St\"ackel Equivalence of Non-Degenerate Superintegrable Systems, and Invariant Quadrics

abstract: A non-degenerate second-order maximally conformally superintegrable system in dimension 2 naturally gives rise to a quadric with position dependent coefficients. It is shown how the system's St\"ackel class can be obtained from this associated quadric.The St\"ackel class of a second-order maximally conformally superintegrable system is its equivalence class under St\"ackel transformations, i.e., under coupling-constant metamorphosis.


title: pymia: A Python package for data handling and evaluation in deep learning-based medical image analysis

abstract: Background and Objective: Deep learning enables tremendous progress in medical image analysis. One driving force of this progress are open-source frameworks like TensorFlow and PyTorch. However, these frameworks rarely address issues specific to the domain of medical image analysis, such as 3-D data handling and distance metrics for evaluation. pymia, an open-source Python package, tries to address these issues by providing flexible data handling and evaluation independent of the deep learning framework. Methods: The pymia package provides data handling and evaluation functionalities. The data handling allows flexible medical image handling in every commonly used format (e.g., 2-D, 2.5-D, and 3-D; full- or patch-wise). Even data beyond images like demographics or clinical reports can easily be integrated into deep learning pipelines. The evaluation allows stand-alone result calculation and reporting, as well as performance monitoring during training using a vast amount of domain-specific metrics for segmentation, reconstruction, and regression. Results: The pymia package is highly flexible, allows for fast prototyping, and reduces the burden of implementing data handling routines and evaluation methods. While data handling and evaluation are independent of the deep learning framework used, they can easily be integrated into TensorFlow and PyTorch pipelines. The developed package was successfully used in a variety of research projects for segmentation, reconstruction, and regression. Conclusions: The pymia package fills the gap of current deep learning frameworks regarding data handling and evaluation in medical image analysis. It is available at https://github.com/rundherum/pymia and can directly be installed from the Python Package Index using pip install pymia.


title: Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representations

abstract: Stance detection is an important component of understanding hidden influences in everyday life. Since there are thousands of potential topics to take a stance on, most with little to no training data, we focus on zero-shot stance detection: classifying stance from no training examples. In this paper, we present a new dataset for zero-shot stance detection that captures a wider range of topics and lexical variation than in previous datasets. Additionally, we propose a new model for stance detection that implicitly captures relationships between topics using generalized topic representations and show that this model improves performance on a number of challenging linguistic phenomena.


title: Generative machine learning with tensor networks: benchmarks on near-term quantum computers

abstract: Noisy, intermediate-scale quantum (NISQ) computing devices have become an industrial reality in the last few years, and cloud-based interfaces to these devices are enabling exploration of near-term quantum computing on a range of problems. As NISQ devices are too noisy for many of the algorithms with a known quantum advantage, discovering impactful applications for near-term devices is the subject of intense research interest. We explore quantum-assisted machine learning (QAML) on NISQ devices through the perspective of tensor networks (TNs), which offer a robust platform for designing resource-efficient and expressive machine learning models to be dispatched on quantum devices. In particular, we lay out a framework for designing and optimizing TN-based QAML models using classical techniques, and then compiling these models to be run on quantum hardware, with demonstrations for generative matrix product state (MPS) models. We put forth a generalized canonical form for MPS models that aids in compilation to quantum devices, and demonstrate greedy heuristics for compiling with a given topology and gate set that outperforms known generic methods in terms of the number of entangling gates, e.g., CNOTs, in some cases by an order of magnitude. We present an exactly solvable benchmark problem for assessing the performance of MPS QAML models, and also present an application for the canonical MNIST handwritten digit dataset. The impacts of hardware topology and day-to-day experimental noise fluctuations on model performance are explored by analyzing both raw experimental counts and statistical divergences of inferred distributions. We also present parametric studies of depolarization and readout noise impacts on model performance using hardware simulators.


title: Parkland Trauma Index of Mortality (PTIM): Real-time Predictive Model for PolyTrauma Patients

abstract: Vital signs and laboratory values are routinely used to guide clinical decision-making for polytrauma patients, such as the decision to use damage control techniques versus early definitive fracture fixation. Prior multivariate models have tried to predict mortality risk, but due to several limitations like one-time prediction at the time of admission, they have not proven clinically useful. There is a need for a dynamic model that captures evolving physiologic changes during patient's hospital course to trauma and resuscitation for mortality prediction. The Parkland Trauma Index of Mortality (PTIM) is a machine learning algorithm that uses electronic medical record (EMR) data to predict $48-$hour mortality during the first $72$ hours of hospitalization. The model updates every hour, evolving with the patient's physiologic response to trauma. Area under (AUC) the receiver-operator characteristic curve (ROC), sensitivity, specificity, positive (PPV) and negative predictive value (NPV), and positive and negative likelihood ratios (LR) were used to evaluate model performance. By evolving with the patient's physiologic response to trauma and relying only on EMR data, the PTIM overcomes many of the limitations of prior mortality risk models. It may be a useful tool to inform clinical decision-making for polytrauma patients early in their hospitalization.


title: Prescribing Ricci curvature on homogeneous spaces

abstract: The prescribed Ricci curvature problem in the context of G-invariant metrics on a homogeneous space M=G/K is studied. We focus on the metrics at which the Ricci curvature map is, locally, as injective and surjective as it can be. Our main result is that such property is generic in the compact case. Our main tool is a formula for the Lichnerowicz Laplacian we prove in terms of the moment map for the variety of algebras.


title: Towards Understanding Sample Variance in Visually Grounded Language Generation: Evaluations and Observations

abstract: A major challenge in visually grounded language generation is to build robust benchmark datasets and models that can generalize well in real-world settings. To do this, it is critical to ensure that our evaluation protocols are correct, and benchmarks are reliable. In this work, we set forth to design a set of experiments to understand an important but often ignored problem in visually grounded language generation: given that humans have different utilities and visual attention, how will the sample variance in multi-reference datasets affect the models' performance? Empirically, we study several multi-reference datasets and corresponding vision-and-language tasks. We show that it is of paramount importance to report variance in experiments; that human-generated references could vary drastically in different datasets/tasks, revealing the nature of each task; that metric-wise, CIDEr has shown systematically larger variances than others. Our evaluations on reference-per-instance shed light on the design of reliable datasets in the future.


title: Interpolating with outer functions

abstract: The classical theorems of Mittag-Leffler and Weierstrass show that when $\{\lambda_n\}$ is a sequence of distinct points in the open unit disk $\D$, with no accumulation points in $\D$, and $\{w_n\}$ is any sequence of complex numbers, there is an analytic function $\phi$ on $\D$ for which $\phi(\lambda_n) = w_n$. A celebrated theorem of Carleson \cite{MR117349} characterizes when, for a bounded sequence $\{w_n\}$, this interpolating problem can be solved with a bounded analytic function. A theorem of Earl \cite{MR284588} goes further and shows that when Carleson's condition is satisfied, the interpolating function $\phi$ can be a constant multiple of a Blaschke product. In this paper, we explore when the interpolating $\phi$ can be an outer function. We then use our results to refine a result of McCarthy \cite{MR1065054} and explore the common range of the co-analytic Toeplitz operators on a model space.


title: Spatial transient behavior in waveguides with lossy impedance boundary conditions

abstract: Attenuation in acoustic waveguides with lossy impedance boundary conditions are associated with non-Hermitian and non-normal operators. This subject has been extensively studied in fundamental and engineering research, and it has been traditionally assumed that the attenuation behavior of total sound power can be totally captured by considering the decay of each transverse mode individually. One of the classical tools in this context is the Cremer optimum concept that aims to maximize the attenuation of the least attenuated mode. However, a typical sound field may be a superposition of a large number of transverse modes which are nonorthogonal, and the individual mode attenuation may have little to do with the total sound power attenuation. By using singular value decomposition, we link the least attenuated total sound power to the maximum singular value of the non-normal propagator. The behaviors of the least attenuated total sound power depend only on the lossy boundary conditions and frequency, but are independent of sources. The sound may be almost non-decaying along the waveguide transition region for any lossy impedance boundary conditions although all modes attenuate exponentially. This spatial transient appears particularly strongly if the impedance is close to an exceptional point of the propagator, at which a pair of adjacent modes achieve maximum attenuation predicted by Cremer optimum concept. These results are confirmed using non-modal numerical calculations and a two-by-two toy model.


title: Actor-Critic Algorithm for High-dimensional Partial Differential Equations

abstract: We develop a deep learning model to effectively solve high-dimensional nonlinear parabolic partial differential equations (PDE). We follow Feynman-Kac formula to reformulate PDE into the equivalent stochastic control problem governed by a Backward Stochastic Differential Equation (BSDE) system. The Markovian property of the BSDE is utilized in designing our neural network architecture, which is inspired by the Actor-Critic algorithm usually applied for deep Reinforcement Learning. Compared to the State-of-the-Art model, we make several improvements including 1) largely reduced trainable parameters, 2) faster convergence rate and 3) fewer hyperparameters to tune. We demonstrate those improvements by solving a few well-known classes of PDEs such as Hamilton-Jacobian-Bellman equation, Allen-Cahn equation and Black-Scholes equation with dimensions on the order of 100.


title: A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks

abstract: Autoregressive language models, pretrained using large text corpora to do well on next word prediction, have been successful at solving many downstream tasks, even with zero-shot usage. However, there is little theoretical understanding of this success. This paper initiates a mathematical study of this phenomenon for the downstream task of text classification by considering the following questions: (1) What is the intuitive connection between the pretraining task of next word prediction and text classification? (2) How can we mathematically formalize this connection and quantify the benefit of language modeling? For (1), we hypothesize, and verify empirically, that classification tasks of interest can be reformulated as sentence completion tasks, thus making language modeling a meaningful pretraining task. With a mathematical formalization of this hypothesis, we make progress towards (2) and show that language models that are $\epsilon$-optimal in cross-entropy (log-perplexity) learn features that can linearly solve such classification tasks with $\mathcal{O}(\sqrt{\epsilon})$ error, thus demonstrating that doing well on language modeling can be beneficial for downstream tasks. We experimentally verify various assumptions and theoretical findings, and also use insights from the analysis to design a new objective function that performs well on some classification tasks.


title: Calibration of Elastoplastic Constitutive Model Parameters from Full-field Data with Automatic Differentiation-based Sensitivities

abstract: We present a framework for calibration of parameters in elastoplastic constitutive models that is based on the use of automatic differentiation (AD). The model calibration problem is posed as a partial differential equation-constrained optimization problem where a finite element (FE) model of the coupled equilibrium equation and constitutive model evolution equations serves as the constraint. The objective function quantifies the mismatch between the displacement predicted by the FE model and full-field digital image correlation data, and the optimization problem is solved using gradient-based optimization algorithms. Forward and adjoint sensitivities are used to compute the gradient at considerably less cost than its calculation from finite difference approximations. Through the use of AD, we need only to write the constraints in terms of AD objects, where all of the derivatives required for the forward and inverse problems are obtained by appropriately seeding and evaluating these quantities. We present three numerical examples that verify the correctness of the gradient, demonstrate the AD approach's parallel computation capabilities via application to a large-scale FE model, and highlight the formulation's ease of extensibility to other classes of constitutive models.


title: A Tale of Two Transition Disks: ALMA long-baseline observations of ISO-Oph 2 reveal two closely packed non-axisymmetric rings and a $\sim$2 au cavity

abstract: ISO-Oph 2 is a wide-separation (240 au) binary system where the primary star harbors a massive (M$_{dust}$ $\sim$40 M$_{\oplus}$) ring-like disk with a dust cavity $\sim$50 au in radius and the secondary hosts a much lighter (M$_{dust}$ $\sim$0.8 M$_{\oplus}$) disk. As part of the high-resolution follow-up of the "Ophiuchus Disk Survey Employing ALMA" (ODISEA) project, we present 1.3 mm continuum and $^{12}$CO molecular line observations of the system at 0''02 (3 au) resolution. We resolve the disk around the primary into two non-axisymmetric rings and find that the disk around the secondary is only $\sim$7 au across and also has a dust cavity (r $\sim$2.2 au). Based on the infrared flux ratio of the system and the M0 spectral type of the primary, we estimate the mass of the companion to be close to the brown dwarf limit. Hence, we conclude that the ISO-Oph 2 system contains the largest and smallest cavities, the smallest measured disk size, and the resolved cavity around the lowest mass object (M$_{\star}$ $\sim$0.08 M$_\odot$) in Ophiuchus. From the $^{12}$CO data, we find a bridge of gas connecting both disks. While the morphology of the rings around the primary might be due to an unseen disturber within the cavity, we speculate that the bridge might indicate an alternative scenario in which the secondary has recently flown by the primary star causing the azimuthal asymmetries in its disk. The ISO-Oph 2 system is therefore a remarkable laboratory to study disk evolution, planet formation, and companion-disk interactions.


title: Learning the aerodynamic design of supercritical airfoils through deep reinforcement learning

abstract: The aerodynamic design of modern civil aircraft requires a true sense of intelligence since it requires a good understanding of transonic aerodynamics and sufficient experience. Reinforcement learning is an artificial general intelligence that can learn sophisticated skills by trial-and-error, rather than simply extracting features or making predictions from data. The present paper utilizes a deep reinforcement learning algorithm to learn the policy for reducing the aerodynamic drag of supercritical airfoils. The policy is designed to take actions based on features of the wall Mach number distribution so that the learned policy can be more general. The initial policy for reinforcement learning is pretrained through imitation learning, and the result is compared with randomly generated initial policies. The policy is then trained in environments based on surrogate models, of which the mean drag reduction of 200 airfoils can be effectively improved by reinforcement learning. The policy is also tested by multiple airfoils in different flow conditions using computational fluid dynamics calculations. The results show that the policy is effective in both the training condition and other similar conditions, and the policy can be applied repeatedly to achieve greater drag reduction.


title: Cross-Thought for Sentence Encoder Pre-training

abstract: In this paper, we propose Cross-Thought, a novel approach to pre-training sequence encoder, which is instrumental in building reusable sequence embeddings for large-scale NLP tasks such as question answering. Instead of using the original signals of full sentences, we train a Transformer-based sequence encoder over a large set of short sequences, which allows the model to automatically select the most useful information for predicting masked words. Experiments on question answering and textual entailment tasks demonstrate that our pre-trained encoder can outperform state-of-the-art encoders trained with continuous sentence signals as well as traditional masked language modeling baselines. Our proposed approach also achieves new state of the art on HotpotQA (full-wiki setting) by improving intermediate information retrieval performance.


title: Efficient Temporal Pattern Mining in Big Time Series Using Mutual Information -- Full Version

abstract: Very large time series are increasingly available from an ever wider range of IoT-enabled sensors deployed in different environments. Significant insights can be gained by mining temporal patterns from these time series. Unlike traditional pattern mining, temporal pattern mining (TPM) adds event time intervals into extracted patterns, making them more expressive at the expense of increased mining time complexity. Existing TPM methods either cannot scale to large datasets, or work only on pre-processed temporal events rather than on time series. This paper presents our Frequent Temporal Pattern Mining from Time Series (FTPMf TS) approach which provides: (1) The end-to-end FTPMf TS process taking time series as input and producing frequent temporal patterns as output. (2) The efficient Hierarchical Temporal Pattern Graph Mining (HTPGM) algorithm that uses efficient data structures for fast support and confidence computation, and employs effective pruning techniques for significantly faster mining. (3) An approximate version of HTPGM that uses mutual information, a measure of data correlation known from information theory, to prune unpromising time series from the search space. (4) An extensive experimental evaluation showing that HTPGM outperforms the baselines in runtime and memory consumption, and can scale to big datasets. The approximate HTPGM is up to two orders of magnitude faster and less memory consuming than the baselines, while retaining high accuracy.


title: On the Combined Role of Cosmic Rays and Supernova-Driven Turbulence for Galactic Dynamos

abstract: Large-scale coherent magnetic fields observed in the nearby galaxies are thought to originate by a mean-field dynamo. This is governed via the turbulent electromotive force (EMF, $\overline{\mathcal{E}} $) generated by the helical turbulence driven by supernova (SN) explosions in the differentially rotating interstellar medium (ISM). In this paper we aim to investigate the possibility of dynamo action by the virtue of buoyancy due to a cosmic ray (CR) component injected through the SN explosions. We do this by analysing the magnetohydrodynamic simulations of local shearing box of ISM, in which the turbulence is driven via random SN explosions and the energy of the explosion is distributed in the CR and/or thermal energy components. We use the magnetic field aligned diffusion prescription for the propagation of CR. We compare the evolution of magnetic fields in the models with the CR component to our previous models that did not involve the CR. We demonstrate that the inclusion of CR component enhances the growth of dynamo slightly. We further compute the underlying dynamo coefficients using the test-fields method, and argue that the entire evolution of the large scale mean magnetic field can be reproduced with an $\alpha-\Omega$ dynamo model. We also show that the inclusion of CR component leads to an unbalanced turbulent pumping between magnetic field components and additional dynamo action by the R\"adler effect.


title: Reinforcement Learning for Many-Body Ground-State Preparation Inspired by Counterdiabatic Driving

abstract: The quantum alternating operator ansatz (QAOA) is a prominent example of variational quantum algorithms. We propose a generalized QAOA called CD-QAOA, which is inspired by the counterdiabatic driving procedure, designed for quantum many-body systems and optimized using a reinforcement learning (RL) approach. The resulting hybrid control algorithm proves versatile in preparing the ground state of quantum-chaotic many-body spin chains by minimizing the energy. We show that using terms occurring in the adiabatic gauge potential as generators of additional control unitaries, it is possible to achieve fast high-fidelity many-body control away from the adiabatic regime. While each unitary retains the conventional QAOA-intrinsic continuous control degree of freedom such as the time duration, we consider the order of the multiple available unitaries appearing in the control sequence as an additional discrete optimization problem. Endowing the policy gradient algorithm with an autoregressive deep learning architecture to capture causality, we train the RL agent to construct optimal sequences of unitaries. The algorithm has no access to the quantum state, and we find that the protocol learned on small systems may generalize to larger systems. By scanning a range of protocol durations, we present numerical evidence for a finite quantum speed limit in the nonintegrable mixed-field spin-1/2 Ising and Lipkin-Meshkov-Glick models, and for the suitability to prepare ground states of the spin-1 Heisenberg chain in the long-range and topologically ordered parameter regimes. This work paves the way to incorporate recent success from deep learning for the purpose of quantum many-body control.

categories: quant-ph cond-mat.quant-gas cs.LG physics.comp-ph


title: Exposing Shallow Heuristics of Relation Extraction Models with Challenge Data

abstract: The process of collecting and annotating training data may introduce distribution artifacts which may limit the ability of models to learn correct generalization behavior. We identify failure modes of SOTA relation extraction (RE) models trained on TACRED, which we attribute to limitations in the data annotation process. We collect and annotate a challenge-set we call Challenging RE (CRE), based on naturally occurring corpus examples, to benchmark this behavior. Our experiments with four state-of-the-art RE models show that they have indeed adopted shallow heuristics that do not generalize to the challenge-set data. Further, we find that alternative question answering modeling performs significantly better than the SOTA models on the challenge-set, despite worse overall TACRED performance. By adding some of the challenge data as training examples, the performance of the model improves. Finally, we provide concrete suggestion on how to improve RE data collection to alleviate this behavior.


title: Four annular structures in a protostellar disk less than 500,000 years old

abstract: Annular structures, or rings and gaps, in disks around pre-main sequence stars have been detected in abundance towards Class II objects ~1,000,000 years in age. These structures are often interpreted as evidence of planet formation, with planet-mass bodies carving rings and gaps in the disk. This implies that planet formation may already be underway in even younger disks in the Class I phase, when the protostar is still embedded in a larger scale dense envelope of gas and dust. While younger disks likely play an important role in the onset of planet formation, only within the past decade have detailed properties of disks in the youngest star-forming phases begun to be observed. Here we present 1.3 mm dust emission observations with 5 au resolution that show four annular substructures in the disk of the young (<500,000 years) protostar IRS 63. IRS 63, a single Class I source located in the nearby Ophiuchus molecular cloud (at a distance of 144 pc), is one of the brightest Class I protostars at (sub)millimeter wavelengths that also has a relatively large disk (>50 au). Multiple annular substructures observed towards disks at young times can act as an early foothold for dust grain growth, a prerequisite of planet formation. Whether planets already exist or not in the disk of IRS 63, it is clear that the planet formation process begins in the young protostellar phases, earlier than predicted by current planet formation theories.


title: How Out-of-Distribution Data Hurts Semi-Supervised Learning

abstract: Recent semi-supervised learning algorithms have demonstrated greater success with higher overall performance due to better-unlabeled data representations. Nonetheless, recent research suggests that the performance of the SSL algorithm can be degraded when the unlabeled set contains out-of-distribution examples (OODs). This work addresses the following question: How do out-of-distribution (OOD) data adversely affect semi-supervised learning algorithms? To answer this question, we investigate the critical causes of OOD's negative effect on SSL algorithms. In particular, we found that 1) certain kinds of OOD data instances that are close to the decision boundary have a more significant impact on performance than those that are further away, and 2) Batch Normalization (BN), a popular module, may degrade rather than improve performance when the unlabeled set contains OODs. In this context, we developed a unified weighted robust SSL framework that can be easily extended to many existing SSL algorithms and improve their robustness against OODs. More specifically, we developed an efficient bi-level optimization algorithm that could accommodate high-order approximations of the objective and scale to multiple inner optimization steps to learn a massive number of weight parameters while outperforming existing low-order approximations of bi-level optimization. Further, we conduct a theoretical study of the impact of faraway OODs in the BN step and propose a weighted batch normalization (WBN) procedure for improved performance. Finally, we discuss the connection between our approach and low-order approximation techniques. Our experiments on synthetic and real-world datasets demonstrate that our proposed approach significantly enhances the robustness of four representative SSL algorithms against OODs compared to four state-of-the-art robust SSL strategies.


title: COHORT: Coordination of Heterogeneous Thermostatically Controlled Loads for Demand Flexibility

abstract: Demand flexibility is increasingly important for power grids. Careful coordination of thermostatically controlled loads (TCLs) can modulate energy demand, decrease operating costs, and increase grid resiliency. We propose a novel distributed control framework for the Coordination Of HeterOgeneous Residential Thermostatically controlled loads (COHORT). COHORT is a practical, scalable, and versatile solution that coordinates a population of TCLs to jointly optimize a grid-level objective, while satisfying each TCL's end-use requirements and operational constraints. To achieve that, we decompose the grid-scale problem into subproblems and coordinate their solutions to find the global optimum using the alternating direction method of multipliers (ADMM). The TCLs' local problems are distributed to and computed in parallel at each TCL, making COHORT highly scalable and privacy-preserving. While each TCL poses combinatorial and non-convex constraints, we characterize these constraints as a convex set through relaxation, thereby making COHORT computationally viable over long planning horizons. After coordination, each TCL is responsible for its own control and tracks the agreed-upon power trajectory with its preferred strategy. In this work, we translate continuous power back to discrete on/off actuation, using pulse width modulation. COHORT is generalizable to a wide range of grid objectives, which we demonstrate through three distinct use cases: generation following, minimizing ramping, and peak load curtailment. In a notable experiment, we validated our approach through a hardware-in-the-loop simulation, including a real-world air conditioner (AC) controlled via a smart thermostat, and simulated instances of ACs modeled after real-world data traces. During the 15-day experimental period, COHORT reduced daily peak loads by an average of 12.5% and maintained comfortable temperatures.


title: Fast Stencil-Code Computation on a Wafer-Scale Processor

abstract: The performance of CPU-based and GPU-based systems is often low for PDE codes, where large, sparse, and often structured systems of linear equations must be solved. Iterative solvers are limited by data movement, both between caches and memory and between nodes. Here we describe the solution of such systems of equations on the Cerebras Systems CS-1, a wafer-scale processor that has the memory bandwidth and communication latency to perform well. We achieve 0.86 PFLOPS on a single wafer-scale system for the solution by BiCGStab of a linear system arising from a 7-point finite difference stencil on a 600 X 595 X 1536 mesh, achieving about one third of the machine's peak performance. We explain the system, its architecture and programming, and its performance on this problem and related problems. We discuss issues of memory capacity and floating point precision. We outline plans to extend this work towards full applications.


title: Multivariate Temporal Autoencoder for Predictive Reconstruction of Deep Sequences

abstract: Time series sequence prediction and modelling has proven to be a challenging endeavor in real world datasets. Two key issues are the multi-dimensionality of data and the interaction of independent dimensions forming a latent output signal, as well as the representation of multi-dimensional temporal data inside of a predictive model. This paper proposes a multi-branch deep neural network approach to tackling the aforementioned problems by modelling a latent state vector representation of data windows through the use of a recurrent autoencoder branch and subsequently feeding the trained latent vector representation into a predictor branch of the model. This model is henceforth referred to as Multivariate Temporal Autoencoder (MvTAe). The framework in this paper utilizes a synthetic multivariate temporal dataset which contains dimensions that combine to create a hidden output target.


title: Detecting Fine-Grained Cross-Lingual Semantic Divergences without Supervision by Learning to Rank

abstract: Detecting fine-grained differences in content conveyed in different languages matters for cross-lingual NLP and multilingual corpora analysis, but it is a challenging machine learning problem since annotation is expensive and hard to scale. This work improves the prediction and annotation of fine-grained semantic divergences. We introduce a training strategy for multilingual BERT models by learning to rank synthetic divergent examples of varying granularity. We evaluate our models on the Rationalized English-French Semantic Divergences, a new dataset released with this work, consisting of English-French sentence-pairs annotated with semantic divergence classes and token-level rationales. Learning to rank helps detect fine-grained sentence-level divergences more accurately than a strong sentence-level similarity model, while token-level predictions have the potential of further distinguishing between coarse and fine-grained divergences.


title: Chern characters for supersymmetric field theories

abstract: We construct a map from $d|1$-dimensional Euclidean field theories to complexified K-theory when $d=1$ and complex analytic elliptic cohomology when $d=2$. This provides further evidence for the Stolz--Teichner program, while also identifying candidate geometric models for Chern characters within their framework. The construction arises as a higher-dimensional and parameterized generalization of Fei Han's realization of the Chern character in K-theory as dimensional reduction for $1|1$-dimensional Euclidean field theories. In the elliptic case, the main new feature is a subtle interplay between the geometry of the super moduli space of $2|1$-dimensional tori and the derived geometry of complex analytic elliptic cohomology. As a corollary, we obtain an entirely geometric proof that partition functions of $\mathcal{N}=(0,1)$ supersymmetric quantum field theories are weak modular forms, following a suggestion of Stolz and Teichner.


title: Flow: the Axiom of Choice is independent from the Partition Principle

abstract: We introduce a general theory of functions called Flow. We prove ZF, non-well founded ZF and ZFC can be immersed within Flow as a natural consequence from our framework. The existence of strongly inaccessible cardinals is entailed from our axioms. And our first important application is the introduction of a model of Zermelo-Fraenkel set theory where the Partition Principle (PP) holds but not the Axiom of Choice (AC). So, Flow allows us to answer to the oldest open problem in set theory: if PP entails AC.


title: A Bandit-Based Algorithm for Fairness-Aware Hyperparameter Optimization

abstract: Considerable research effort has been guided towards algorithmic fairness but there is still no major breakthrough. In practice, an exhaustive search over all possible techniques and hyperparameters is needed to find optimal fairness-accuracy trade-offs. Hence, coupled with the lack of tools for ML practitioners, real-world adoption of bias reduction methods is still scarce. To address this, we present Fairband, a bandit-based fairness-aware hyperparameter optimization (HO) algorithm. Fairband is conceptually simple, resource-efficient, easy to implement, and agnostic to both the objective metrics, model types and the hyperparameter space being explored. Moreover, by introducing fairness notions into HO, we enable seamless and efficient integration of fairness objectives into real-world ML pipelines. We compare Fairband with popular HO methods on four real-world decision-making datasets. We show that Fairband can efficiently navigate the fairness-accuracy trade-off through hyperparameter optimization. Furthermore, without extra training cost, it consistently finds configurations attaining substantially improved fairness at a comparatively small decrease in predictive accuracy.


title: An optimization-based approach to parameter learning for fractional type nonlocal models

abstract: Nonlocal operators of fractional type are a popular modeling choice for applications that do not adhere to classical diffusive behavior; however, one major challenge in nonlocal simulations is the selection of model parameters. In this work we propose an optimization-based approach to parameter identification for fractional models with an optional truncation radius. We formulate the inference problem as an optimal control problem where the objective is to minimize the discrepancy between observed data and an approximate solution of the model, and the control variables are the fractional order and the truncation length. For the numerical solution of the minimization problem we propose a gradient-based approach, where we enhance the numerical performance by an approximation of the bilinear form of the state equation and its derivative with respect to the fractional order. Several numerical tests in one and two dimensions illustrate the theoretical results and show the robustness and applicability of our method.


title: Rescribe: Authoring and Automatically Editing Audio Descriptions

abstract: Audio descriptions make videos accessible to those who cannot see them by describing visual content in audio. Producing audio descriptions is challenging due to the synchronous nature of the audio description that must fit into gaps of other video content. An experienced audio description author will produce content that fits narration necessary to understand, enjoy, or experience the video content into the time available. This can be especially tricky for novices to do well. In this paper, we introduce a tool, Rescribe, that helps authors create and refine their audio descriptions. Using Rescribe, authors first create a draft of all the content they would like to include in the audio description. Rescribe then uses a dynamic programming approach to optimize between the length of the audio description, available automatic shortening approaches, and source track lengthening approaches. Authors can iteratively visualize and refine the audio descriptions produced by Rescribe, working in concert with the tool. We evaluate the effectiveness of Rescribe through interviews with blind and visually impaired audio description users who preferred Rescribe-edited descriptions to extended descriptions. In addition, we invite novice users to create audio descriptions with Rescribe and another tool, finding that users produce audio descriptions with fewer placement errors using Rescribe.


title: Modeling Kilonova Light Curves: Dependence on Nuclear Inputs

abstract: The mergers of binary neutron stars, as well as black hole-neutron star systems, are expected to produce an electromagnetic counterpart that can be analyzed to infer the element synthesis that occurred in these events. We investigate one source of uncertainties pertinent to lanthanide-rich outflows: the nuclear inputs to rapid neutron capture nucleosynthesis calculations. We begin by examining thirty-two different combinations of nuclear inputs: eight mass models, two types of spontaneous fission rates, and two types of fission daughter product distributions. We find that such nuclear physics uncertainties typically generate at least one order of magnitude uncertainty in key quantities such as the nuclear heating (one and a half orders of magnitude at one day post-merger), the bolometric luminosity (one order of magnitude at five days post-merger), and the inferred mass of material from the bolometric luminosity (factor of eight when considering the eight to ten days region). Since particular nuclear processes are critical for determining the electromagnetic signal, we provide tables of key nuclei undergoing $\beta$-decay, $\alpha$-decay, and spontaneous fission important for heating at different times, identifying decays that are common among the many nuclear input combinations.


title: An eigensystem approach to Anderson localization for multi-particle systems

abstract: This paper revisits the proof of Anderson localization for multi-particle systems. We introduce a multi-particle version of the eigensystem multi-scale analysis by Elgart and Klein, which had previously been used for single-particle systems.


title: Parameter Estimation for Mixed-Mechanism Tear Film Thinning

abstract: Etiologies of tear breakup include evaporation-driven, divergent flow-driven, and a combination of these two. A mathematical model incorporating evaporation and lipid-driven tangential flow is fit to fluorescence imaging data. The lipid-driven motion is hypothesized to be caused by localized excess lipid, or "globs." Tear breakup quantities such as evaporation rates and tangential flow rates cannot currently be directly measured during breakup. We determine such variables by fitting mathematical models for tear breakup and the computed fluorescent intensity to experimental intensity data gathered in vivo. Parameter estimation is conducted via least squares minimization of the difference between experimental data and computed answers using either the trust-region-reflective or Levenberg-Marquardt algorithm. Best-fit determination of tear breakup parameters supports the notion that evaporation and divergent tangential flow can cooperate to drive breakup. The resulting tear breakup is typically faster than purely evaporative cases. Many instances of tear breakup may have similar causes, which suggests that interpretation of experimental results may benefit from considering multiple mechanisms.


title: Adversarial Attacks to Machine Learning-Based Smart Healthcare Systems

abstract: The increasing availability of healthcare data requires accurate analysis of disease diagnosis, progression, and realtime monitoring to provide improved treatments to the patients. In this context, Machine Learning (ML) models are used to extract valuable features and insights from high-dimensional and heterogeneous healthcare data to detect different diseases and patient activities in a Smart Healthcare System (SHS). However, recent researches show that ML models used in different application domains are vulnerable to adversarial attacks. In this paper, we introduce a new type of adversarial attacks to exploit the ML classifiers used in a SHS. We consider an adversary who has partial knowledge of data distribution, SHS model, and ML algorithm to perform both targeted and untargeted attacks. Employing these adversarial capabilities, we manipulate medical device readings to alter patient status (disease-affected, normal condition, activities, etc.) in the outcome of the SHS. Our attack utilizes five different adversarial ML algorithms (HopSkipJump, Fast Gradient Method, Crafting Decision Tree, Carlini & Wagner, Zeroth Order Optimization) to perform different malicious activities (e.g., data poisoning, misclassify outputs, etc.) on a SHS. Moreover, based on the training and testing phase capabilities of an adversary, we perform white box and black box attacks on a SHS. We evaluate the performance of our work in different SHS settings and medical devices. Our extensive evaluation shows that our proposed adversarial attack can significantly degrade the performance of a ML-based SHS in detecting diseases and normal activities of the patients correctly, which eventually leads to erroneous treatment.


title: Privacy and Data Balkanization: Circumventing the Barriers

abstract: The rapid growth in digital data forms the basis for a wide range of new services and research, e.g, large-scale medical studies. At the same time, increasingly restrictive privacy concerns and laws are leading to significant overhead in arranging for sharing or combining different data sets to obtain these benefits. For new applications, where the benefit of combined data is not yet clear, this overhead can inhibit organizations from even trying to determine whether they can mutually benefit from sharing their data. In this paper, we discuss techniques to overcome this difficulty by employing private information transfer to determine whether there is a benefit from sharing data, and whether there is room to negotiate acceptable prices. These techniques involve cryptographic protocols. While currently considered secure, these protocols are potentially vulnerable to the development of quantum technology, particularly for ensuring privacy over significant periods of time into the future. To mitigate this concern, we describe how developments in practical quantum technology can improve the security of these protocols.


title: Sliding Mode Control Barrier Function

abstract: This work proposes a sliding mode control barrier function to robustly deal with high relative-degree safety constraints in safety-critical control systems. Stability/tracking objectives, expressed as a nominal control law, and safety constraints, expressed as control barrier functions are unified through quadratic programming. The proposed control framework is numerically validated considering a Furuta pendulum and a magnetic levitation system. For the first system, a linear quadratic regulator is considered as a nominal control law, and a safety constraint is considered to guarantee that the pendulum angular position never exceeds a predetermined value. For the second one, a sliding mode controller is considered as a nominal control law and multiple safety constraints are considered to guarantee that the magnetic levitation system positions never exceed predetermined values. For both systems, we consider high relative-degree safety constraints robust against model uncertainties. The numerical results indicate that the stability/tracking objectives are reached and the safety constraints are respected even with model uncertainties.


title: Designing Sequence with Minimum PSL Using Chebyshev Distance and its Application for Chaotic MIMO Radar Waveform Design

abstract: Controlling peak side-lobe level (PSL) is of great importance in high-resolution applications of multiple-input multiple-output (MIMO) radars. In this paper, designing sequences with good autocorrelation properties are studied. The PSL of the autocorrelation is regarded as the main merit and is optimized through newly introduced cyclic algorithms, namely; PSL Minimization Quadratic Approach (PMQA), PSL Minimization Algorithm, the smallest Rectangular (PMAR), and PSL Optimization Cyclic Algorithm (POCA). It is revealed that minimizing PSL results in better sequences in terms of autocorrelation side-lobes when compared with traditional integrated side-lobe level (ISL) minimization. In order to improve the performance of these algorithms, fast-randomized Singular Value Decomposition (SVD) is utilized. To achieve waveform design for MIMO radars, this algorithm is applied to the waveform generated from a modified Bernoulli chaotic system. The numerical experiments confirm the superiority of the newly developed algorithms compared to high-performance algorithms in mono-static and MIMO radars.


title: Predicting Mechanical Properties from Microstructure Images in Fiber-reinforced Polymers using Convolutional Neural Networks

abstract: Evaluating the mechanical response of fiber-reinforced composites can be extremely time consuming and expensive. Machine learning (ML) techniques offer a means for faster predictions via models trained on existing input-output pairs and have exhibited success in composite research. This paper explores a fully convolutional neural network modified from StressNet, which was originally for lin-ear elastic materials and extended here for a non-linear finite element (FE) simulation to predict the stress field in 2D slices of segmented tomography images of a fiber-reinforced polymer specimen. The network was trained and evaluated on data generated from the FE simulations of the exact microstructure. The testing results show that the trained network accurately captures the characteristics of the stress distribution, especially on fibers, solely from the segmented microstructure images. The trained model can make predictions within seconds in a single forward pass on an ordinary laptop, given the input microstructure, compared to 92.5 hours to run the full FE simulation on a high-performance computing cluster. These results show promise in using ML techniques to conduct fast structural analysis for fiber-reinforced composites and suggest a corollary that the trained model can be used to identify the location of potential damage sites in fiber-reinforced polymers.


title: Hyperbolic volume, mod 2 homology, and k-freeness

abstract: We show that if $M$ is any closed, orientable hyperbolic $3$-manifold with ${\rm vol}\ M\le3.69$, we have ${\rm dim}\ H_1(M;{\bf F}_2)\le7$. This may be regarded as a qualitative improvement of a result due to Culler and Shalen, because the constant $3.69$ is greater than the ordinal corresponding to $\omega^2$ in the well-ordered set of finite volumes of hyperbolic $3$-manifolds. We also show that if ${\rm vol}\ M\le 3.77$, we have ${\rm dim}\ H_1(M;{\bf F}_2)\le10$. These results are applications of a new method for obtaining lower bounds for the volume of a closed, orientable hyperbolic $3$-manifold such that $\pi_1(M)$ is $k$-free for a given $k\ge4$. Among other applications we show that if $\pi_1(M)$ is $4$-free we have ${\rm vol}\ M>3.57$ (improving the lower bound of $3.44$ given by Culler and Shalen), and that if $\pi_1(M)$ is $5$-free we have ${\rm vol}\ M>3.77$.


title: Agent Based Computational Model Aided Approach to Improvise the Inequality-Adjusted Human Development Index (IHDI) for Greater Parity in Real Scenario Assessments

abstract: To design, evaluate and tune policies for all-inclusive human development, the primary requisite is to assess the true state of affairs of the society. Statistical indices like GDP, Gini Coefficients have been developed to accomplish the evaluation of the socio-economic systems. They have remained prevalent in the conventional economic theories but little do they have in the offing regarding true well-being and development of humans. Human Development Index (HDI) and thereafter Inequality-adjusted Human Development Index (IHDI) has been the path changing composite-index having the focus on human development. However, even though its fundamental philosophy has an all-inclusive human development focus, the composite-indices appear to be unable to grasp the actual assessment in several scenarios. This happens due to the dynamic non-linearity of social-systems where superposition principle cannot be applied between all of its inputs and outputs of the system as the system's own attributes get altered upon each input. We would discuss the apparent shortcomings and probable refinement of the existing index using an agent based computational system model approach.


title: Quantum Sensing of Intermittent Stochastic Signals

abstract: Realistic quantum sensors face a trade-off between the number of sensors measured in parallel and the control and readout fidelity ($F$) across the ensemble. We investigate how the number of sensors and fidelity affect sensitivity to continuous and intermittent signals. For continuous signals, we find that increasing the number of sensors by $1/F^2$ for $F<1$ always recovers the sensitivity achieved when $F=1$. However, when the signal is intermittent, more sensors are needed to recover the sensitivity achievable with one perfect quantum sensor. We also demonstrate the importance of near-unity control fidelity and readout at the quantum projection noise limit by estimating the frequency components of a stochastic, intermittent signal with a single trapped ion sensor. Quantum sensing has historically focused on large ensembles of sensors operated far from the standard quantum limit. The results presented in this manuscript show that this is insufficient for quantum sensing of intermittent signals and re-emphasizes the importance of the unique scaling of quantum projection noise near an eigenstate.


title: Sharp exponential inequalities for the Ornstein-Uhlenbeck operator

abstract: The optimal constants in a class of exponential type inequalities for the Ornstein-Uhlenbeck operator in the Gauss space are detected. The existence of extremal functions in the relevant inequalities is also established. Our results disclose analogies and dissimilarities in comparison with Adams' inequality for the Laplace operator, a companion of our inequalities in the Euclidean space.


title: Adaptive Self-training for Few-shot Neural Sequence Labeling

abstract: Sequence labeling is an important technique employed for many Natural Language Processing (NLP) tasks, such as Named Entity Recognition (NER), slot tagging for dialog systems and semantic parsing. Large-scale pre-trained language models obtain very good performance on these tasks when fine-tuned on large amounts of task-specific labeled data. However, such large-scale labeled datasets are difficult to obtain for several tasks and domains due to the high cost of human annotation as well as privacy and data access constraints for sensitive user applications. This is exacerbated for sequence labeling tasks requiring such annotations at token-level. In this work, we develop techniques to address the label scarcity challenge for neural sequence labeling models. Specifically, we develop self-training and meta-learning techniques for training neural sequence taggers with few labels. While self-training serves as an effective mechanism to learn from large amounts of unlabeled data -- meta-learning helps in adaptive sample re-weighting to mitigate error propagation from noisy pseudo-labels. Extensive experiments on six benchmark datasets including two for massive multilingual NER and four slot tagging datasets for task-oriented dialog systems demonstrate the effectiveness of our method. With only 10 labeled examples for each class for each task, our method obtains 10% improvement over state-of-the-art systems demonstrating its effectiveness for the low-resource setting.


title: A note on embeddings of 3-manifolds in symplectic 4-manifolds

abstract: We show that any closed oriented 3-manifold can be topologically embedded in some simply-connected closed symplectic 4-manifold, and that it can be made a smooth embedding after one stabilization. As a corollary of the proof we show that the homology cobordism group is generated by Stein fillable 3-manifolds. We also find obstructions on smooth embeddings: there exists 3-manifolds which cannot smoothly embed in a way that appropriately respect orientations in any symplectic manifold with weakly convex boundary. This embedding obstruction can also be used to detect exotic smooth structures on 4-manifolds.


title: Formation of dispersive shock waves in evolution of a two-temperature collisionless plasma

abstract: The nonlinear dynamics of pulses in a two-temperature collisionless plasma with formation of dispersion shock waves is studied. An analytical description is given for arbitrary form of an initial disturbance with smooth enough density profile on a uniform density background. For large time after the wave breaking moment dispersive shock waves are formed. Motion of their edges is studied in framework of Gurevich-Pitaevskii theory and Whitham theory of modulations. The analytical results are compared with numerical solution.


title: Photon Ring Autocorrelations

abstract: In the presence of a black hole, light sources connect to observers along multiple paths. As a result, observed brightness fluctuations must be correlated across different times and positions in black hole images. Photons that execute multiple orbits around the black hole appear near a critical curve in the observer sky, giving rise to the photon ring. In this paper, a novel observable is proposed: the two-point correlation function of intensity fluctuations on the photon ring. This correlation function is analytically computed for a Kerr black hole surrounded by stochastic equatorial emission, with source statistics motivated by simulations of a turbulent accretion flow. It is shown that this two-point function exhibits a universal, self-similar structure consisting of multiple peaks of identical shape: while the profile of each peak encodes statistical properties of fluctuations in the source, the locations and heights of the peaks are determined purely by the black hole parameters. Measuring these peaks would demonstrate the existence of the photon ring without resolving its thickness, and would provide estimates of black hole mass and spin. With regular monitoring over sufficiently long timescales, this measurement could be possible via interferometric imaging with modest improvements to the Event Horizon Telescope.


title: Magnetostriction in elastomers with mixtures of magnetically hard and soft microparticles: effects of non-linear magnetization and matrix rigidity

abstract: In this contribution a magnetoactive elastomer (MAE) of mixed content, i.e., a polymer matrix filled with a mixture of magnetically soft and magnetically hard spherical particles, is considered. The object we focus at is an elementary unit of this composite, for which we take a set consisting of a permanent spherical micromagnet surrounded by an elastomer layer filled with magnetically soft microparticles. We present a comparative treatment of this unit from two essentially different viewpoints. The first one is a coarse-grained molecular dynamics simulation model, which presents the composite as a bead-spring assembly and is able to deliver information of all the microstructural changes of the assembly. The second approach is entirely based on the continuum magnetomechanical description of the system, whose direct yield is the macroscopic field-induced response of the MAE to external field, as this model ignores all the microstructural details of the magnetization process. We find that, differing in certain details, both frameworks are coherent in predicting that a unit comprising magnetically soft and hard particles may display a non-trivial re-entrant (prolate/oblate/prolate) axial deformation under variation of the applied field strength. The flexibility of the proposed combination of the two complementary frameworks enables us to look deeper into the manifestation of the magnetic response: with respect to the magnetically soft particles, we compare the linear regime of magnetization to that with saturation, which we describe by the Fr\"{o}hlich-Kennelly approximation; with respect to the polymer matrix, we analyze the dependence of the re-rentrant deformation on its rigidity.


title: Lie groupoids and logarithmic connections

abstract: Using tools from the theory of Lie groupoids, we study the category of logarithmic flat connections on principal $G$-bundles, where $G$ is a complex reductive structure group. Flat connections on the affine line with a logarithmic singularity at the origin are equivalent to representations of a groupoid associated to the exponentiated action of $\mathbb{C}$. We show that such representations admit a canonical Jordan-Chevalley decomposition and use this to give a functorial classification. Flat connections on a complex manifold with logarithmic singularities along a hypersurface are equivalent to representations of a twisted fundamental groupoid. Using a Morita equivalence, whose construction is inspired by Deligne's notion of paths with tangential basepoints, we prove a van Kampen type theorem for this groupoid. This allows us to show that the category of representations of the twisted fundamental groupoid can be localized to the normal bundle of the hypersurface. As a result, we obtain a functorial Riemann-Hilbert correspondence for logarithmic connections in terms of generalized monodromy data.


title: Islanding microgrid with solar and fuel cell for providing load

abstract: Solar and Fuel cell energy resources are two major of Renewable Energy Resources (RES) which is using to power electrical grids. They can provide clean energy and help to reduce greenhouse emissions. RES is changing the structure of electrical systems day by day. They have provided to supply the loads and have distributed systems. The concept of Microgrid has been defined by connecting distributed generation sources and load which can run in islanding and interconnected modes. In this research, solar and fuel cell are used as a source for providing variable loads. They try to deliver defined power to the load. The solar system created by one diode corresponding circuit is given and a Perturbation and observation (P&O) approach is applied to obtain full power from the solar panels. Direct Methanol Fuel Cell Model (DFMC) is another renewable energy resource that is utilized in this microgrid to provide the load. This model has included two Gibbs reactors that considered for the anode and cathode respectively and a splitter among the anode and cathode. The droop controller is used to control the injected power from the resources to the loads. The effectiveness of the designed microgrid is justified in MATLAB/SIMULINK environment


title: Heat kernels for time-dependent non-symmetric mixed L\'evy-type operators

abstract: In this paper we establish the existence and uniqueness of heat kernels to a large class of time-inhomogenous non-symmetric nonlocal operators with Dini's continuous kernels. Moreover, quantitative estimates including two-sided estimates, gradient estimate and fractional derivative estimate of the heat kernels are obtained.


title: AxFormer: Accuracy-driven Approximation of Transformers for Faster, Smaller and more Accurate NLP Models

abstract: Transformers have greatly advanced the state-of-the-art in Natural Language Processing (NLP) in recent years, but present very large computation and storage requirements. We observe that the design process of Transformers (pre-train a foundation model on a large dataset in a self-supervised manner, and subsequently fine-tune it for different downstream tasks) leads to task-specific models that are highly over-parameterized, adversely impacting both accuracy and inference efficiency. We propose AxFormer, a systematic framework that applies accuracy-driven approximations to create optimized transformer models for a given downstream task. AxFormer combines two key optimizations -- accuracy-driven pruning and selective hard attention. Accuracy-driven pruning identifies and removes parts of the fine-tuned transformer that hinder performance on the given downstream task. Sparse hard-attention optimizes attention blocks in selected layers by eliminating irrelevant word aggregations, thereby helping the model focus only on the relevant parts of the input. In effect, AxFormer leads to models that are more accurate, while also being faster and smaller. Our experiments on GLUE and SQUAD tasks show that AxFormer models are up to 4.5% more accurate, while also being up to 2.5X faster and up to 3.2X smaller than conventional fine-tuned models. In addition, we demonstrate that AxFormer can be combined with previous efforts such as distillation or quantization to achieve further efficiency gains.