title: PlaTe: Visually-Grounded Planning with Transformers in Procedural Tasks

abstract: In this work, we study the problem of how to leverage instructional videos to facilitate the understanding of human decision-making processes, focusing on training a model with the ability to plan a goal-directed procedure from real-world videos. Learning structured and plannable state and action spaces directly from unstructured videos is the key technical challenge of our task. There are two problems: first, the appearance gap between the training and validation datasets could be large for unstructured videos; second, these gaps lead to decision errors that compound over the steps. We address these limitations with Planning Transformer (PlaTe), which has the advantage of circumventing the compounding prediction errors that occur with single-step models during long model-based rollouts. Our method simultaneously learns the latent state and action information of assigned tasks and the representations of the decision-making process from human demonstrations. Experiments conducted on real-world instructional videos and an interactive environment show that our method can achieve a better performance in reaching the indicated goal than previous algorithms. We also validated the possibility of applying procedural tasks on a UR-5 platform. We make our code publicly available and support academic research purposes.


title: MultiAzterTest: a Multilingual Analyzer on Multiple Levels of Language for Readability Assessment

abstract: Readability assessment is the task of determining how difficult or easy a text is or which level/grade it has. Traditionally, language dependent readability formula have been used, but these formulae take few text characteristics into account. However, Natural Language Processing (NLP) tools that assess the complexity of texts are able to measure more different features and can be adapted to different languages. In this paper, we present the MultiAzterTest tool: (i) an open source NLP tool which analyzes texts on over 125 measures of cohesion,language, and readability for English, Spanish and Basque, but whose architecture is designed to easily adapt other languages; (ii) readability assessment classifiers that improve the performance of Coh-Metrix in English, Coh-Metrix-Esp in Spanish and ErreXail in Basque; iii) a web tool. MultiAzterTest obtains 90.09 % in accuracy when classifying into three reading levels (elementary, intermediate, and advanced) in English and 95.50 % in Basque and 90 % in Spanish when classifying into two reading levels (simple and complex) using a SMO classifier. Using cross-lingual features, MultiAzterTest also obtains competitive results above all in a complex vs simple distinction.


title: Spatio-Temporal Recurrent Networks for Event-Based Optical Flow Estimation

abstract: Event camera has offered promising alternative for visual perception, especially in high speed and high dynamic range scenes. Recently, many deep learning methods have shown great success in providing promising solutions to many event-based problems, such as optical flow estimation. However, existing deep learning methods did not address the importance of temporal information well from the perspective of architecture design and cannot effectively extract spatio-temporal features. Another line of research that utilizes Spiking Neural Network suffers from training issues for deeper architecture.To address these points, a novel input representation is proposed that captures the events' temporal distribution for signal enhancement. Moreover, we introduce a spatio-temporal recurrent encoding-decoding neural network architecture for event-based optical flow estimation, which utilizes Convolutional Gated Recurrent Units to extract feature maps from a series of event images. Besides, our architecture allows some traditional frame-based core modules, such as correlation layer and iterative residual refine scheme, to be incorporated. The network is end-to-end trained with self-supervised learning on the Multi-Vehicle Stereo Event Camera dataset. We have shown that it outperforms all the existing state-of-the-art methods by a large margin. The code link is https://github.com/ruizhao26/STE-FlowNet.


title: Negative Sample Matters: A Renaissance of Metric Learning for Temporal Grounding

abstract: Temporal grounding aims to localize a video moment which is semantically aligned with a given natural language query. Existing methods typically apply a detection or regression pipeline on the fused representation with the research focus on designing complicated prediction heads or fusion strategies. Instead, from a perspective on temporal grounding as a metric-learning problem, we present a Mutual Matching Network (MMN), to directly model the similarity between language queries and video moments in a joint embedding space. This new metric-learning framework enables fully exploiting negative samples from two new aspects: constructing negative cross-modal pairs in a mutual matching scheme and mining negative pairs across different videos. These new negative samples could enhance the joint representation learning of two modalities via cross-modal mutual matching to maximize their mutual information. Experiments show that our MMN achieves highly competitive performance compared with the state-of-the-art methods on four video grounding benchmarks. Based on MMN, we present a winner solution for the HC-STVG challenge of the 3rd PIC workshop. This suggests that metric learning is still a promising method for temporal grounding via capturing the essential cross-modal correlation in a joint embedding space. Code is available at https://github.com/MCG-NJU/MMN.


title: Reasons, Persons, and Physics

abstract: Starting from general considerations, some ideas of the philosopher Derek Parfit on consciousness, self-awareness, and reductionism are briefly reviewed and critically examined from the standpoint of physics.


title: Discretizing Dynamics for Maximum Likelihood Constraint Inference

abstract: Maximum likelihood constraint inference is a powerful technique for identifying unmodeled constraints that affect the behavior of a demonstrator acting under a known objective function. However, it was originally formulated only for discrete state-action spaces. Continuous dynamics are more useful for modeling many real-world systems of interest, including the movements of humans and robots. We present a method to generate a tabular state-action space that approximates continuous dynamics and can be used for constraint inference on demonstrations that obey the true system dynamics. We then demonstrate accurate constraint inference on nonlinear pendulum systems with 2- and 4-dimensional state spaces, and show that performance is robust to a range of hyperparameters. The demonstrations are not required to be fully optimal with respect to the objective, and the most likely constraints can be identified even when demonstrations cover only a small portion of the state space. For these reasons, the proposed approach may be especially useful for inferring constraints on human demonstrators, which has important applications in human-robot interaction and biomechanical medicine.


title: Neural Networks for Latent Budget Analysis of Compositional Data

abstract: Compositional data are non-negative data collected in a rectangular matrix with a constant row sum. Due to the non-negativity the focus is on conditional proportions that add up to 1 for each row. A row of conditional proportions is called an observed budget. Latent budget analysis (LBA) assumes a mixture of latent budgets that explains the observed budgets. LBA is usually fitted to a contingency table, where the rows are levels of one or more explanatory variables and the columns the levels of a response variable. In prospective studies, there is only knowledge about the explanatory variables of individuals and interest goes out to predicting the response variable. Thus, a form of LBA is needed that has the functionality of prediction. Previous studies proposed a constrained neural network (NN) extension of LBA that was hampered by an unsatisfying prediction ability. Here we propose LBA-NN, a feed forward NN model that yields a similar interpretation to LBA but equips LBA with a better ability of prediction. A stable and plausible interpretation of LBA-NN is obtained through the use of importance plots and table, that show the relative importance of all explanatory variables on the response variable. An LBA-NN-K- means approach that applies K-means clustering on the importance table is used to produce K clusters that are comparable to K latent budgets in LBA. Here we provide different experiments where LBA-NN is implemented and compared with LBA. In our analysis, LBA-NN outperforms LBA in prediction in terms of accuracy, specificity, recall and mean square error. We provide open-source software at GitHub.


title: Integrating Approaches to Word Representation

abstract: The problem of representing the atomic elements of language in modern neural learning systems is one of the central challenges of the field of natural language processing. I present a survey of the distributional, compositional, and relational approaches to addressing this task, and discuss various means of integrating them into systems, with special emphasis on the word level and the out-of-vocabulary phenomenon.


title: Efficient Test Time Adapter Ensembling for Low-resource Language Varieties

abstract: Adapters are light-weight modules that allow parameter-efficient fine-tuning of pretrained models. Specialized language and task adapters have recently been proposed to facilitate cross-lingual transfer of multilingual pretrained models (Pfeiffer et al., 2020b). However, this approach requires training a separate language adapter for every language one wishes to support, which can be impractical for languages with limited data. An intuitive solution is to use a related language adapter for the new language variety, but we observe that this solution can lead to sub-optimal performance. In this paper, we aim to improve the robustness of language adapters to uncovered languages without training new adapters. We find that ensembling multiple existing language adapters makes the fine-tuned model significantly more robust to other language varieties not included in these adapters. Building upon this observation, we propose Entropy Minimized Ensemble of Adapters (EMEA), a method that optimizes the ensemble weights of the pretrained language adapters for each test sentence by minimizing the entropy of its predictions. Experiments on three diverse groups of language varieties show that our method leads to significant improvements on both named entity recognition and part-of-speech tagging across all languages.


title: On the differentiability of interval functions

abstract: Two articles published by Information Science discuss the derivatives of interval functions, in the sense of Svetoslav Markov. The authors of these articles tried to characterize for which functions and points such derivatives exist. Unfortunately, their characterization is inaccurate. This article describes this inaccuracy and explains how it can be corrected.


title: Calderon-Zygmund theory for non-convolution type nonlocal equations with continuous coefficient

abstract: Given $2\leq p<\infty$, $s\in (0, 1)$ and $t\in (1, 2s)$, we establish interior $W^{t,p}$ Calderon-Zygmund estimates for solutions of nonlocal equations of the form \[ \int_{\Omega} \int_{\Omega} K\left (x,|x-y|,\frac{x-y}{|x-y|}\right ) \frac{(u(x)-u(y))(\varphi(x)-\varphi(y))}{|x-y|^{n+2s}} dx dy = g[\varphi], \quad \forall \phi\in C_c^{\infty}(\Omega) \] where $\Omega\subset \mathbb{R}^{n}$ is an open set. Here we assume $K$ is bounded, nonnegative and continuous in the first entry -- and ellipticity is ensured by assuming that $K$ is strictly positive in a cone. The setup is chosen so that it is applicable for nonlocal equations on manifolds, but the structure of the equation is general enough that it also applies to the certain fractional $p$-Laplace equations around points where $u \in C^1$ and $|\nabla u| \neq 0$.


title: Hybrid modeling of the human cardiovascular system using NeuralFMUs

abstract: Hybrid modeling, the combination of first principle and machine learning models, is an emerging research field that gathers more and more attention. Even if hybrid models produce formidable results for academic examples, there are still different technical challenges that hinder the use of hybrid modeling in real-world applications. By presenting NeuralFMUs, the fusion of a FMU, a numerical ODE solver and an ANN, we are paving the way for the use of a variety of first principle models from different modeling tools as parts of hybrid models. This contribution handles the hybrid modeling of a complex, real-world example: Starting with a simplified 1D-fluid model of the human cardiovascular system (arterial side), the aim is to learn neglected physical effects like arterial elasticity from data. We will show that the hybrid modeling process is more comfortable, needs less system knowledge and is therefore less error-prone compared to modeling solely based on first principle. Further, the resulting hybrid model has improved in computation performance, compared to a pure first principle white-box model, while still fulfilling the requirements regarding accuracy of the considered hemodynamic quantities. The use of the presented techniques is explained in a general manner and the considered use-case can serve as example for other modeling and simulation applications in and beyond the medical domain.


title: ProcK: Machine Learning for Knowledge-Intensive Processes

abstract: We present a novel methodology to build powerful predictive process models. Our method, denoted ProcK (Process & Knowledge), relies not only on sequential input data in the form of event logs, but can learn to use a knowledge graph to incorporate information about the attribute values of the events and their mutual relationships. The idea is realized by mapping event attributes to nodes of a knowledge graph and training a sequence model alongside a graph neural network in an end-to-end fashion. This hybrid approach substantially enhances the flexibility and applicability of predictive process monitoring, as both the static and dynamic information residing in the databases of organizations can be directly taken as input data. We demonstrate the potential of ProcK by applying it to a number of predictive process monitoring tasks, including tasks with knowledge graphs available as well as an existing process monitoring benchmark where no such graph is given. The experiments provide evidence that our methodology achieves state-of-the-art performance and improves predictive power when a knowledge graph is available.


title: Large 1-systems of Curves in Non-orientable Surfaces

abstract: A longstanding avenue of research in orientable surface topology is to create and enumerate collections of curves in surfaces with certain intersection properties. We look for similar collections of curves in non-orientable surfaces. A surface is non-orientable if and only if it contains a M\"obius band. We generalize a construction of Malestein-Rivin-Theran to non-orientable surfaces to exhibit a lower bound for the maximum number of curves that pairwise intersect 0 or 1 times in a generic non-orientable surface.


title: Resolving gas bubbles ascending in liquid metal from low-SNR neutron radiography images

abstract: We demonstrate a new image processing methodology for resolving gas bubbles travelling through liquid metal from dynamic neutron radiography images with intrinsically low signal-to-noise ratio. Image pre-processing, denoising and bubble segmentation are described in detail, with practical recommendations. Experimental validation is presented - stationary and moving reference bodies with neutron-transparent cavities are radiographed with imaging conditions similar to the cases with bubbles in liquid metal. The new methods are applied to our experimental data from previous and recent imaging campaigns, and the performance of the methods proposed in this paper is compared against our previously developed methods. Significant improvements are observed as well as the capacity to reliably extract physically meaningful information from measurements performed under highly adverse imaging conditions. The showcased image processing solution and separate elements thereof are readily extendable beyond the present application, and have been made open-source.


title: SO-SLAM: Semantic Object SLAM with Scale Proportional and Symmetrical Texture Constraints

abstract: Object SLAM introduces the concept of objects into Simultaneous Localization and Mapping (SLAM) and helps understand indoor scenes for mobile robots and object-level interactive applications. The state-of-art object SLAM systems face challenges such as partial observations, occlusions, unobservable problems, limiting the mapping accuracy and robustness. This paper proposes a novel monocular Semantic Object SLAM (SO-SLAM) system that addresses the introduction of object spatial constraints. We explore three representative spatial constraints, including scale proportional constraint, symmetrical texture constraint and plane supporting constraint. Based on these semantic constraints, we propose two new methods - a more robust object initialization method and an orientation fine optimization method. We have verified the performance of the algorithm on the public datasets and an author-recorded mobile robot dataset and achieved a significant improvement on mapping effects. We will release the code here: https://github.com/XunshanMan/SoSLAM.


title: BP-cohomology of projective Stiefel manifolds

abstract: In this paper, we compute the BP-cohomology of complex projective Stiefel manifolds. The method involves the homotopy fixed point spectral sequence, and works for complex oriented cohomology theories. We also use these calculations and BP-operations to prove new results about equivariant maps between Stiefel manifolds.


title: Proceedings 18th International Conference on Quantum Physics and Logic

abstract: This volume contains the proceedings of the 18th International Conference on Quantum Physics and Logic (QPL 2021), which was held June 7-11, 2021 at the University of Gdansk and online. QPL is an annual conference that brings together researchers working on mathematical foundations of quantum physics, quantum computing, and related areas, with a focus on structural perspectives and the use of logical tools, ordered algebraic and category-theoretic structures, formal languages, semantical methods, and other computer science techniques applied to the study of physical behaviour in general.


title: Mid-wave infrared super-resolution imaging based on compressive calibration and sampling

abstract: Mid-wave infrared (MWIR) cameras for large number pixels are extremely expensive compared with their counterparts in visible light, thus, super-resolution imaging (SRI) for MWIR by increasing imaging pixels has always been a research hotspot in recent years. Over the last decade, with the extensively investigation of the compressed sensing (CS) method, focal plane array (FPA) based compressive imaging in MWIR developed rapidly for SRI. This paper presents a long-distance super-resolution FPA compressive imaging in MWIR with improved calibration method and imaging effect. By the use of CS, we measure and calculate the calibration matrix of optical system efficiently and precisely, which improves the imaging contrast and signal-to-noise ratio(SNR) compared with previous work. We also achieved the 4x4 times super-resolution reconstruction of the long-distance objects which reaches the limit of the system design in our experiment.


title: Auctioning with Strategically Reticent Bidders

abstract: We propose and study a novel mechanism design setup where each bidder holds two kinds of private information: (1) type variable, which can be misreported; (2) information variable, which the bidder may want to conceal or partially reveal, but importantly, not to misreport. We refer to bidders with such behaviors as strategically reticent bidders. Among others, one direct motivation of our model is the ad auction in which many ad platforms today elicit from each bidder not only their private value per conversion but also their private information about Internet users (e.g., user activities on the advertiser's websites) in order to improve the platform's estimation of conversion rates. We show that in this new setup, it is still possible to design mechanisms that are both Incentive and Information Compatible (IIC). We develop two different black-box transformations, which convert any mechanism $\mathcal{M}$ for classic bidders to a mechanism $\bar{\mathcal{M}}$ for strategically reticent bidders, based on either outcome of expectation or expectation of outcome, respectively. We identify properties of the original mechanism $\mathcal{M}$ under which the transformation leads to IIC mechanisms $\bar{\mathcal{M}}$. Interestingly, as corollaries of these results, we show that running VCG with bidders' expected values maximizes welfare, whereas the mechanism using expected outcome of Myerson's auction maximizes revenue. Finally, we study how regulation on the auctioneer's usage of information can lead to more robust mechanisms.


title: Virasoro constraints for moduli spaces of sheaves on surfaces

abstract: We introduce a conjecture on Virasoro constraints for the moduli space of stable sheaves on a smooth projective surface. These generalise the Virasoro constraints on the Hilbert scheme of a surface found by Moreira (arXiv:2008.13746) and Moreira, Oblomkov, Okounkov and Pandharipande (arXiv:2008.12514). We verify the conjecture in many nontrivial cases by using a combinatorial description of equivariant sheaves found by Klyachko.


title: One dimensional consensus based algorithm for non-convex optimization

abstract: We analyze the consensus based optimization method proposed by Pinnau et al.(2017) in one dimension. We rigorously provide a quantitative error estimate between the consensus point and global minimizer of a given objective function. Our analysis covers general objective functions; we do not require any structural assumption on the objective function.


title: Property {A} and duality in linear programming

abstract: Property A is a form of weak amenability for groups and metric spaces introduced as an approach to the famous Novikov higher signature conjecture, one of the most important unsolved problems in topology. We show that property A can be reduced to a sequence of linear programming optimization problems on finite graphs. We explore the dual problems, which turn out to have interesting interpretations as combinatorial problems concerning the maximum total supply of flows on a network. Using isoperimetric inequalities, we relate the dual problems to the Cheeger constant of the graph and explore the role played by symmetry of a graph to obtain a striking characterization of the difference between an expander and a graph without property A. Property A turns out to be a new measure of connectivity of a graph that is relevant to graph theory. The dual linear problems can be solved using a variety of methods, which we demonstrate on several enlightening examples. As a demonstration of the power of this linear programming approach we give elegant proofs of theorems of Nowak and Willett about graphs without property A.


title: Polarized solitons in higher-spin wave dark matter

abstract: We first show that the effective non-relativistic theory of gravitationally interacting, massive integer-spin fields (spin-$0$, $1$, and $2$ in particular) is described by a $2s+1$ component Schr\"{o}dinger-Poisson action, where $s$ is the spin of the field. We then construct $s+1$ distinct, gravitationally supported solitons in this non-relativistic theory from identically polarized plane waves. Such solitons are extremally polarized, with macroscopically large spin, but no orbital angular momentum. These $s+1$ solitons form a basis set, out of which partially polarized solitons can be constructed. All such solitons are ground states, have a spherically symmetric energy density but not field configurations. We discuss how solitons in higher-spin fields can be distinguished from scalar solitons, and potential gravitational and non-gravitational probes of them.


title: AID: Efficient Prediction of Aggregated Intensity of Dependency in Large-scale Cloud Systems

abstract: Service reliability is one of the key challenges that cloud providers have to deal with. In cloud systems, unplanned service failures may cause severe cascading impacts on their dependent services, deteriorating customer satisfaction. Predicting the cascading impacts accurately and efficiently is critical to the operation and maintenance of cloud systems. Existing approaches identify whether one service depends on another via distributed tracing but no prior work focused on discriminating to what extent the dependency between cloud services is. In this paper, we survey the outages and the procedure for failure diagnosis in two cloud providers to motivate the definition of the intensity of dependency. We define the intensity of dependency between two services as how much the status of the callee service influences the caller service. Then we propose AID, the first approach to predict the intensity of dependencies between cloud services. AID first generates a set of candidate dependency pairs from the spans. AID then represents the status of each cloud service with a multivariate time series aggregated from the spans. With the representation of services, AID calculates the similarities between the statuses of the caller and the callee of each candidate pair. Finally, AID aggregates the similarities to produce a unified value as the intensity of the dependency. We evaluate AID on the data collected from an open-source microservice benchmark and a cloud system in production. The experimental results show that AID can efficiently and accurately predict the intensity of dependencies. We further demonstrate the usefulness of our method in a large-scale commercial cloud system.


title: Large-vocabulary Audio-visual Speech Recognition in Noisy Environments

abstract: Audio-visual speech recognition (AVSR) can effectively and significantly improve the recognition rates of small-vocabulary systems, compared to their audio-only counterparts. For large-vocabulary systems, however, there are still many difficulties, such as unsatisfactory video recognition accuracies, that make it hard to improve over audio-only baselines. In this paper, we specifically consider such scenarios, focusing on the large-vocabulary task of the LRS2 database, where audio-only performance is far superior to video-only accuracies, making this an interesting and challenging setup for multi-modal integration. To address the inherent difficulties, we propose a new fusion strategy: a recurrent integration network is trained to fuse the state posteriors of multiple single-modality models, guided by a set of model-based and signal-based stream reliability measures. During decoding, this network is used for stream integration within a hybrid recognizer, where it can thus cope with the time-variant reliability and information content of its multiple feature inputs. We compare the results with end-to-end AVSR systems as well as with competitive hybrid baseline models, finding that the new fusion strategy shows superior results, on average even outperforming oracle dynamic stream weighting, which has so far marked the -- realistically unachievable -- upper bound for standard stream weighting. Even though the pure lipreading performance is low, audio-visual integration is helpful under all -- clean, noisy, and reverberant -- conditions. On average, the new system achieves a relative word error rate reduction of 42.18\% compared to the audio-only model, pointing at a high effectiveness of the proposed integration approach.


title: Simplified derivation of the Kompaneets equation

abstract: An isotropic electromagnetic field in a plasma of thermalized electrons undergoes changes in energy as a result of Compton scattering and an Einstein-Hopf drag force on the electrons, eventually approaching a Bose-Einstein photon distribution at the electron temperature. The rate of change of feld energy due to the combined effects of Compton scattering and the drag force is shown to be described by the Kompaneets equation for photon diffusion in frequency space. A similarity is noted between this approach and Einstein's derivation of the Planck spectrum based on the recoil of atoms as they absorb and emit radiation.


title: Primordial black hole formation with full numerical relativity

abstract: We study the formation of black holes from subhorizon and superhorizon perturbations in a matter dominated universe with 3+1D numerical relativity simulations. We find that there are two primary mechanisms of formation depending on the initial perturbation's mass and geometry -- via $\textit{direct collapse}$ of the initial overdensity and via $\textit{post-collapse accretion}$ of the ambient dark matter. In particular, for the latter case, the initial perturbation does not have to satisfy the hoop conjecture for a black hole to form. In both cases, the duration of the formation the process is around a Hubble time, and the initial mass of the black hole is $M_\mathrm{BH} \sim 10^{-2} H^{-1} M_\mathrm{Pl}^2$. Post formation, we find that the PBH undergoes rapid mass growth beyond the self-similar limit $M_\mathrm{BH}\propto H^{-1}$, at least initially. We argue that this implies that most of the final mass of the PBH is accreted from its ambient surroundings post formation.


title: On the eigenvalues associated with the limit null distribution of the Epps-Pulley test of normality

abstract: The Shapiro--Wilk test (SW) and the Anderson--Darling test (AD) turned out to be strong procedures for testing for normality. They are joined by a class of tests for normality proposed by Epps and Pulley that, in contrary to SW and AD, have been extended by Baringhaus and Henze to yield easy-to-use affine invariant and universally consistent tests for normality in any dimension. The limit null distribution of the Epps--Pulley test involves a sequences of eigenvalues of a certain integral operator induced by the covariance kernel of the limiting Gaussian process. We solve the associated integral equation and present the corresponding eigenvalues.


title: LibFewShot: A Comprehensive Library for Few-shot Learning

abstract: Few-shot learning, especially few-shot image classification, has received increasing attention and witnessed significant advances in recent years. Some recent studies implicitly show that many generic techniques or ``tricks'', such as data augmentation, pre-training, knowledge distillation, and self-supervision, may greatly boost the performance of a few-shot learning method. Moreover, different works may employ different software platforms, backbone architectures and input image sizes, making fair comparisons difficult and practitioners struggle with reproducibility. To address these situations, we propose a comprehensive library for few-shot learning (LibFewShot) by re-implementing eighteen state-of-the-art few-shot learning methods in a unified framework with the same single codebase in PyTorch. Furthermore, based on LibFewShot, we provide comprehensive evaluations on multiple benchmarks with various backbone architectures to evaluate common pitfalls and effects of different training tricks. In addition, with respect to the recent doubts on the necessity of meta- or episodic-training mechanism, our evaluation results confirm that such a mechanism is still necessary especially when combined with pre-training. We hope our work can not only lower the barriers for beginners to enter the area of few-shot learning but also elucidate the effects of nontrivial tricks to facilitate intrinsic research on few-shot learning. The source code is available from https://github.com/RL-VIG/LibFewShot.


title: Prospects for Mapping Temporal Height Variations of the Seasonal CO2 Snow/Ice Caps at the Martian Poles by Co-registration of MOLA Profiles

abstract: We investigate the feasibility and demonstrate the merits of using Mars Orbiter Laser Altimeter (MOLA) profiles to retrieve seasonal height variations of CO2 snow/ice cap in Mars' polar areas by applying a co-registration strategy. We present a prototype analysis on the research region of [85.75{\deg}S, 86.25{\deg}S, 300{\deg}E, 330{\deg}E] that is located on the residual south polar cap. Our method comprises the recomputation of MOLA footprint coordinates with an updated Mars Global Surveyor (MGS) ephemeris and a revised Mars rotation model. The reprocessed MOLA dataset at the South Pole of Mars (poleward of 78{\deg}S) is then self-registered to form a coherent reference digital terrain model (DTM). We co-register segments of reprocessed MOLA profiles to the self-registered MOLA reference DTM to obtain the temporal height differences at either footprints or cross-overs. Subsequently, a two-step Regional Pseudo Cross-over Adjustment (RPCA) procedure is proposed and applied to post-correct the aforementioned temporal height differences for a temporal systematic bias and other residual errors. These pseudo cross-overs are formed by profile pairs that do not necessarily intersect, but are connected through the underlaying DTM. Finally, CO2 snow/ice temporal height variation is obtained by median-filtering those post-corrected temporal height differences. The precision of the derived height change time series is ~4.9 cm. The peak-to-peak height variation is estimated to be ~2 m. In addition, a pronounced "pit" (transient height accumulation) of ~0.5 m in magnitude centered at Ls=210{\deg} in southern spring is observed. The proposed method opens the possibility to map the seasonal CO2 snow/ice height variations at the entire North and South polar regions of Mars.


title: Large Monochromatic Components of Small Diameter

abstract: Gy\'arf\'as conjectured in 2011 that every $r$-edge-colored $K_n$ contains a monochromatic component of bounded ("perhaps three") diameter on at least $n/(r-1)$ vertices. Letzter proved this conjecture with diameter four. In this note we improve the result in the case of $r=3$: We show that in every $3$-edge-coloring of $K_n$ either there is a monochromatic component of diameter at most three on at least $n/2$ vertices or every color class is spanning and has diameter at most four.


title: Document-level Entity-based Extraction as Template Generation

abstract: Document-level entity-based extraction (EE), aiming at extracting entity-centric information such as entity roles and entity relations, is key to automatic knowledge acquisition from text corpora for various domains. Most document-level EE systems build extractive models, which struggle to model long-term dependencies among entities at the document level. To address this issue, we propose a generative framework for two document-level EE tasks: role-filler entity extraction (REE) and relation extraction (RE). We first formulate them as a template generation problem, allowing models to efficiently capture cross-entity dependencies, exploit label semantics, and avoid the exponential computation complexity of identifying N-ary relations. A novel cross-attention guided copy mechanism, TopK Copy, is incorporated into a pre-trained sequence-to-sequence model to enhance the capabilities of identifying key information in the input document. Experiments done on the MUC-4 and SciREX dataset show new state-of-the-art results on REE (+3.26%), binary RE (+4.8%), and 4-ary RE (+2.7%) in F1 score.


title: Controlling nonlinear interaction in a many-mode laser by tuning disorder

abstract: A many-mode laser with nonlinear modal interaction could serve as a model system to study many-body physics. However, precise and continuous tuning of the interaction strength over a wide range is challenging. Here, we present a unique method for controlling lasing mode structures by introducing random phase fluctuation to a nearly degenerate cavity. We show numerically and experimentally that as the characteristic scale of phase fluctuation decreases by two orders of magnitude, the transverse modes become fragmented and the reduction of their spatial overlap suppresses modal competition for gain, allowing more modes to lase. The tunability, flexibility and robustness of our system provides a powerful platform for investigating many-body phenomena.


title: HELIX: Data-driven characterization of Brazilian land snails

abstract: Decision-support systems benefit from hidden patterns extracted from digital information. In the specific domain of gastropod characterization, morphometrical measurements support biologists in the identification of land snail specimens. Although snails can be easily identified by their excretory and reproductive systems, the after-death mollusk body is commonly inaccessible because of either soft material deterioration or fossilization. This study aims at characterizing Brazilian land snails by morphometrical data features manually taken from the shells. In particular, we examined a dataset of shells by using different learning models that labeled snail specimens with a precision up to 97.5% (F1-Score = .975, CKC = .967 and ROC Area = .998). The extracted patterns describe similarities and trends among land snail species and indicates possible outliers physiologies due to climate traits and breeding. Finally, we show some morphometrical characteristics dominate others according to different feature selection biases. Those data-based patterns can be applied to fast land snail identification whenever their bodies are unavailable, as in the recurrent cases of lost shells in nature or private and museum collections.


title: Experimental study of charging of dust grains in presence of energetic electrons

abstract: The role of hot electrons in charging of dust grains is investigated in a two-temperature hydrogen plasma. A variety of dust particles are introduced into the system and secondary electron emission (SEE) from each of the dust grains has been reported. A cylindrical Langmuir probe is used for determining the plasma parameters and a Faraday cup is connected to an electrometer in order to measure the dust current. The electrometer readings confirm the electron emission from the dust and SEE is observed from the tungsten dust in a low-pressure experimental plasma device for the first time.


title: Smooth Selection for Infinite Sets

abstract: Whitney's extension problem asks the following: Given a compact set $E\subset\mathbb{R}^n$ and a function $f:E\to \mathbb{R}$, how can we tell whether there exists $F\in C^m(\mathbb{R}^n)$ such that $F=f$ on $E$? A 2006 theorem of Charles Fefferman \cite{F06} answers this question in its full generality. In this paper, we establish a version of this theorem adapted for variants of the Whitney extension problem, including nonnegative extensions and the smooth selection problems. Among other things, we generalize the Finiteness Principle for smooth selection by Fefferman-Israel-Luli \cite{FIL16} to the setting of infinite sets. Our main result is stated in terms of the iterated Glaeser refinement of a bundle formed by taking potential Taylor polynomials at each point of $E$. In particular, we show that such bundles (and any bundles with closed, convex fibers) stabilize after a bounded number of Glaeser refinements, thus strengthening the previous results of Glaeser, Bierstone-Milman-Paw{\l}ucki, and Fefferman which only hold for bundles with affine fibers.


title: Emergent second law for non-equilibrium steady states

abstract: The Gibbs distribution universally characterizes states of thermal equilibrium. In order to extend the Gibbs distribution to non-equilibrium steady states, one must relate the self-information $\mathcal{I}(x) = -\log(P_\text{ss}(x))$ of microstate $x$ to measurable physical quantities. This is a central problem in non-equilibrium statistical physics. By considering open systems described by stochastic dynamics which become deterministic in the macroscopic limit, we show that changes $\Delta \mathcal{I} = \mathcal{I}(x_t) - \mathcal{I}(x_0)$ in steady state self-information along deterministic trajectories can be bounded by the macroscopic entropy production $\Sigma$. This bound takes the form of an emergent second law $\Sigma + k_b \Delta \mathcal{I}\geq 0$, which contains the usual second law $\Sigma \geq 0$ as a corollary, and is saturated in the linear regime close to equilibrium. We thus obtain a tighter version of the second law of thermodynamics that provides a link between the deterministic relaxation of a system and the non-equilibrium fluctuations at steady state. In addition to its fundamental value, our result leads to novel methods for computing non-equilibrium distributions, providing a deterministic alternative to Gillespie simulations or spectral methods.


title: GPA-Teleoperation: Gaze Enhanced Perception-aware Safe Assistive Aerial Teleoperation

abstract: Gaze is an intuitive and direct way to represent the intentions of an individual. However, when it comes to assistive aerial teleoperation which aims to perform operators' intention, rare attention has been paid to gaze. Existing methods obtain intention directly from the remote controller (RC) input, which is inaccurate, unstable, and unfriendly to non-professional operators. Further, most teleoperation works do not consider environment perception which is vital to guarantee safety. In this paper, we present GPA-Teleoperation, a gaze enhanced perception-aware assistive teleoperation framework, which addresses the above issues systematically. We capture the intention utilizing gaze information, and generate a topological path matching it. Then we refine the path into a safe and feasible trajectory which simultaneously enhances the perception awareness to the environment operators are interested in. Additionally, the proposed method is integrated into a customized quadrotor system. Extensive challenging indoor and outdoor real-world experiments and benchmark comparisons verify that the proposed system is reliable, robust and applicable to even unskilled users. We will release the source code of our system to benefit related researches.


title: Error State Extended Kalman Filter Multi-Sensor Fusion for Unmanned Aerial Vehicle Localization in GPS and Magnetometer Denied Indoor Environments

abstract: This paper addresses the issues of unmanned aerial vehicle (UAV) indoor navigation, specifically in areas where GPS and magnetometer sensor measurements are unavailable or unreliable. The proposed solution is to use an error state extended Kalman filter (ES -EKF) in the context of multi-sensor fusion. Its implementation is adapted to fuse measurements from multiple sensor sources and the state model is extended to account for sensor drift and possible calibration inaccuracies. Experimental validation is performed by fusing IMU data obtained from the PixHawk 2.1 flight controller with pose measurements from LiDAR Cartographer SLAM, visual odometry provided by the Intel T265 camera and position measurements from the Pozyx UWB indoor positioning system. The estimated odometry from ES-EKF is validated against ground truth data from the Optitrack motion capture system and its use in a position control loop to stabilize the UAV is demonstrated.


title: How Can Subgroup Discovery Help AIOps?

abstract: The genuine supervision of modern IT systems brings new challenges as it requires higher standards of scalability, reliability and efficiency when analysing and monitoring big data streams. Rule-based inference engines are a key component of maintenance systems in detecting anomalies and automating their resolution. However, they remain confined to simple and general rules and cannot handle the huge amount of data, nor the large number of alerts raised by IT systems, a lesson learned from expert systems era. Artificial Intelligence for Operation Systems (AIOps) proposes to take advantage of advanced analytics and machine learning on big data to improve and automate every step of supervision systems and aid incident management in detecting outages, identifying root causes and applying appropriate healing actions. Nevertheless, the best AIOps techniques rely on opaque models, strongly limiting their adoption. As a part of this PhD thesis, we study how Subgroup Discovery can help AIOps. This promising data mining technique offers possibilities to extract interesting hypothesis from data and understand the underlying process behind predictive models. To ensure relevancy of our propositions, this project involves both data mining researchers and practitioners from Infologic, a French software editor.


title: Conversion efficiency in Kerr microresonator optical parametric oscillators: From three modes to many modes

abstract: We study optical parametric oscillations in Kerr-nonlinear microresonators, revealing an intricate solution space -- parameterized by the pump-to-signal conversion efficiency -- that arises from an interplay of nonlinear processes. Using a three-mode approximation, we derive an efficiency-maximizing relation between pump power and frequency mismatch. To move beyond a three-mode approximation, a necessity for geometries such as integrated microring resonators, we numerically simulate the Lugiato-Lefever Equation that accounts for the full spectrum of nonlinearly-coupled resonator modes. We observe and characterize two nonlinear phenomena linked to parametric oscillations in multi-mode resonators: Mode competition and cross phase modulation-induced modulation instability. Both processes may impact conversion efficiency. Finally, we show how to increase the conversion efficiency by tuning the microresonator loss rates. Our analysis will guide microresonator designs that aim for high conversion efficiency and output power.


title: RandSolomon: Optimally Resilient Random Number Generator with Deterministic Termination

abstract: Multi-party random number generation is a key building-block in many practical protocols. While straightforward to solve when all parties are trusted to behave correctly, the problem becomes much more difficult in the presence of faults. In this context, this paper presents RandSolomon, a protocol that allows a network of N processes to produce an unpredictable common random number among the non-faulty of them. We provide optimal resilience for partially-synchronous systems where less than a third of the participants might behave arbitrarily and, contrary to many solutions, we do not require at any point faulty-processes to be responsive.


title: ReasonBERT: Pre-trained to Reason with Distant Supervision

abstract: We present ReasonBert, a pre-training method that augments language models with the ability to reason over long-range relations and multiple, possibly hybrid contexts. Unlike existing pre-training methods that only harvest learning signals from local contexts of naturally occurring texts, we propose a generalized notion of distant supervision to automatically connect multiple pieces of text and tables to create pre-training examples that require long-range reasoning. Different types of reasoning are simulated, including intersecting multiple pieces of evidence, bridging from one piece of evidence to another, and detecting unanswerable cases. We conduct a comprehensive evaluation on a variety of extractive question answering datasets ranging from single-hop to multi-hop and from text-only to table-only to hybrid that require various reasoning capabilities and show that ReasonBert achieves remarkable improvement over an array of strong baselines. Few-shot experiments further demonstrate that our pre-training method substantially improves sample efficiency.


title: Adjoint Differentiation for generic matrix functions

abstract: We derive a formula for the adjoint $\overline{A}$ of a square-matrix operation of the form $C=f(A)$, where $f$ is holomorphic in the neighborhood of each eigenvalue. We then apply the formula to derive closed-form expressions in particular cases of interest such as the case when we have a spectral decomposition $A=UDU^{-1}$, the spectrum cut-off $C=A_+$ and the Nearest Correlation Matrix routine. Finally, we explain how to simplify the computation of adjoints for regularized linear regression coefficients.


title: KM3NeT Detection Unit Line Fit reconstruction using positioning sensors data

abstract: The KM3NeT collaboration is constructing two large neutrino detectors in the Mediterranean Sea: ARCA, located near Sicily and aiming at neutrino astronomy, and ORCA, located near Toulon and designed for neutrino oscillation studies. The two detectors, together, will have hundreds of Detection Units (DUs) with 18 Digital Optical Modules (DOMs) maintained vertical by buoyancy, forming a large 3D optical array for detecting the Cherenkov light produced after the neutrino interactions. To properly reconstruct the direction of the incoming neutrino, the position of the DOMs must be known precisely with an accuracy of less than 10 cm. For this purpose, there are acoustic and orientation sensors inside the DOMs. An Attitude Heading Reference System (AHRS) chip provides the components values of the Acceleration and Magnetic field in the DOM, from which it is possible to calculate Yaw, Pitch, and Roll for each floor of the line. A piezo sensor detects the signals from fixed acoustic emitters on the seafloor, so as to position it by trilateration. Data from these sensors are used as an input to reconstruct the shape of the entire line based on a DU Line Fit mechanical model. This proceeding presents an overview of the KM3NeT monitoring system, as well as the line fit model and a selection of results.


title: On some variational problems involving capacity, torsional rigidity, perimeter and measure

abstract: We investigate the existence of a maximiser among open, bounded, convex sets in $\R^d,\,d\ge 3$ for the product of torsional rigidity and Newtonian capacity (or logarithmic capacity if $d=2$), with constraints involving Lebesgue measure or a combination of Lebesgue measure and perimeter.


title: Unsupervised classification of simulated magnetospheric regions

abstract: In magnetospheric missions, burst mode data sampling should be triggered in the presence of processes of scientific or operational interest. We present an unsupervised classification method for magnetospheric regions, that could constitute the first-step of a multi-step method for the automatic identification of magnetospheric processes of interest. Our method is based on Self Organizing Maps (SOMs), and we test it preliminarily on data points from global magnetospheric simulations obtained with the OpenGGCM-CTIM-RCM code. The dimensionality of the data is reduced with Principal Component Analysis before classification. The classification relies exclusively on local plasma properties at the selected data points, without information on their neighborhood or on their temporal evolution. We classify the SOM nodes into an automatically selected number of classes, and we obtain clusters that map to well defined magnetospheric regions. We validate our classification results by plotting the classified data in the simulated space and by comparing with K-means classification. For the sake of result interpretability, we examine the SOM feature maps (magnetospheric variables are called features in the context of classification), and we use them to unlock information on the clusters. We repeat the classification experiments using different sets of features, we quantitatively compare different classification results, and we obtain insights on which magnetospheric variables make more effective features for unsupervised classification.

categories: physics.space-ph astro-ph.IM cs.LG physics.geo-ph physics.plasm-ph


title: Supersolid phases of ultracold bosons trapped in optical lattices dressed with Rydberg $p$-states

abstract: Engineering quantum phases with spontaneously broken symmetries is a major goal of research in different fields. Trapped ultracold Rydberg-excited atoms in optical lattices are a promising platform for realizing quantum phases with broken lattice translational symmetry since they are interacting over distances larger than the lattice constant. Although numerous theoretical works on trapped Rydberg-excited gases have predicted such phases, in particular density wave or supersolid phases, their experimental observation proves to be difficult due to challenges such as scattering processes and the limited experimentally achievable coupling strength. Most of these previous studies have focused on isotropically interacting gases dressed with Rydberg $s$-states, while the effect of anisotropic interactions due to Rydberg-excited $p$-states in trapped quantum gases remains much less investigated. Additionally, it was shown that the excitation scheme used to excite Rydberg $p$-states possesses advantages regarding achievable coupling strengths and limitation of scattering processes compared to its $s$-state counterpart, which makes the investigation of Rydberg $p$-state dressed quantum gases even more interesting. In the present work, we study the extended, two-component Bose-Hubbard model, realized with a bosonic quantum gas with Rydberg-excited $p$-states trapped in an optical lattice, within Gutzwiller mean-field theory. We compute the ground state phase diagram and investigate its different regimes. By comparison to the phase diagram of the isotropic case, we find the anisotropic interaction to be more advantageous for the observation of supersolid phases.


title: Estimation and Adaption of Indoor Ego Airflow Disturbance with Application to Quadrotor Trajectory Planning

abstract: It is ubiquitously accepted that during the autonomous navigation of the quadrotors, one of the most widely adopted unmanned aerial vehicles (UAVs), safety always has the highest priority. However, it is observed that the ego airflow disturbance can be a significant adverse factor during flights, causing potential safety issues, especially in narrow and confined indoor environments. Therefore, we propose a novel method to estimate and adapt indoor ego airflow disturbance of quadrotors, meanwhile applying it to trajectory planning. Firstly, the hover experiments for different quadrotors are conducted against the proximity effects. Then with the collected acceleration variance, the disturbances are modeled for the quadrotors according to the proposed formulation. The disturbance model is also verified under hover conditions in different reconstructed complex environments. Furthermore, the approximation of Hamilton-Jacobi reachability analysis is performed according to the estimated disturbances to facilitate the safe trajectory planning, which consists of kinodynamic path search as well as B-spline trajectory optimization. The whole planning framework is validated on multiple quadrotor platforms in different indoor environments.


title: EmoWOZ: A Large-Scale Corpus and Labelling Scheme for Emotion Recognition in Task-Oriented Dialogue Systems

abstract: The ability to recognise emotions lends a conversational artificial intelligence a human touch. While emotions in chit-chat dialogues have received substantial attention, emotions in task-oriented dialogues remain largely unaddressed. This is despite emotions and dialogue success having equally important roles in a natural system. Existing emotion-annotated task-oriented corpora are limited in size, label richness, and public availability, creating a bottleneck for downstream tasks. To lay a foundation for studies on emotions in task-oriented dialogues, we introduce EmoWOZ, a large-scale manually emotion-annotated corpus of task-oriented dialogues. EmoWOZ is based on MultiWOZ, a multi-domain task-oriented dialogue dataset. It contains more than 11K dialogues with more than 83K emotion annotations of user utterances. In addition to Wizard-of-Oz dialogues from MultiWOZ, we collect human-machine dialogues within the same set of domains to sufficiently cover the space of various emotions that can happen during the lifetime of a data-driven dialogue system. To the best of our knowledge, this is the first large-scale open-source corpus of its kind. We propose a novel emotion labelling scheme, which is tailored to task-oriented dialogues. We report a set of experimental results to show the usability of this corpus for emotion recognition and state tracking in task-oriented dialogues.


title: An Alternative Approach to Evaluate American Options Price Using HJM Approach

abstract: Developments in finance industry and academic research has led to innovative financial products. This paper presents an alternative approach to price American options. Our approach utilizes famous \cite{heath1992bond} ("HJM") technique to calculate American option written on an asset. Originally, HJM forward modeling approach was introduced as an alternative approach to bond pricing in fixed income market. Since then, \cite{schweizer2008term} and \cite{carmona2008infinite} extended HJM forward modeling approach to equity market by capturing dynamic nature of volatility. They modeled the term structure of volatility, which is commonly observed in the market place as opposed to constant volatility assumption under Black - Scholes framework. Using this approach, we propose an alternative value function, a stopping criteria and a stopping time. We give an example of how to price American put option using proposed methodology.


title: Examining Cross-lingual Contextual Embeddings with Orthogonal Structural Probes

abstract: State-of-the-art contextual embeddings are obtained from large language models available only for a few languages. For others, we need to learn representations using a multilingual model. There is an ongoing debate on whether multilingual embeddings can be aligned in a space shared across many languages. The novel Orthogonal Structural Probe (Limisiewicz and Mare\v{c}ek, 2021) allows us to answer this question for specific linguistic features and learn a projection based only on mono-lingual annotated datasets. We evaluate syntactic (UD) and lexical (WordNet) structural information encoded inmBERT's contextual representations for nine diverse languages. We observe that for languages closely related to English, no transformation is needed. The evaluated information is encoded in a shared cross-lingual embedding space. For other languages, it is beneficial to apply orthogonal transformation learned separately for each language. We successfully apply our findings to zero-shot and few-shot cross-lingual parsing.


title: Beyond the Tip of the Iceberg: Assessing Coherence of Text Classifiers

abstract: As large-scale, pre-trained language models achieve human-level and superhuman accuracy on existing language understanding tasks, statistical bias in benchmark data and probing studies have recently called into question their true capabilities. For a more informative evaluation than accuracy on text classification tasks can offer, we propose evaluating systems through a novel measure of prediction coherence. We apply our framework to two existing language understanding benchmarks with different properties to demonstrate its versatility. Our experimental results show that this evaluation framework, although simple in ideas and implementation, is a quick, effective, and versatile measure to provide insight into the coherence of machines' predictions.


title: An exponential bound on the number of non-isotopic commutative semifields

abstract: We show that the number of non-isotopic commutative semifields of odd order $p^{n}$ is exponential in $n$ when $n = 4t$ and $t$ is not a power of $2$. We introduce a new family of commutative semifields and a method for proving isotopy results on commutative semifields that we use to deduce the aforementioned bound. The previous best bound on the number of non-isotopic commutative semifields of odd order was quadratic in $n$ and given by Zhou and Pott [Adv. Math. 234 (2013)]. Similar bounds in the case of even order were given in Kantor [J. Algebra 270 (2003)] and Kantor and Williams [Trans. Amer. Math. Soc. 356 (2004)].


title: Global dimension of real-exponent polynomial rings

abstract: The ring R of real-exponent polynomials in n variables over any field has global dimension n+1 and flat dimension n. In particular, the residue field k = R/m of R modulo its maximal graded ideal m has flat dimension n via a Koszul-like resolution. Projective and flat resolutions of all R-modules are constructed from this resolution of k. The same results hold when R is replaced by the monoid algebra for the positive cone of any subgroup of $\mathbb{R}^n$ satisfying a mild density condition.


title: Rapid Model Architecture Adaption for Meta-Learning

abstract: Network Architecture Search (NAS) methods have recently gathered much attention. They design networks with better performance and use a much shorter search time compared to traditional manual tuning. Despite their efficiency in model deployments, most NAS algorithms target a single task on a fixed hardware system. However, real-life few-shot learning environments often cover a great number of tasks (T ) and deployments on a wide variety of hardware platforms (H ). The combinatorial search complexity T times H creates a fundamental search efficiency challenge if one naively applies existing NAS methods to these scenarios. To overcome this issue, we show, for the first time, how to rapidly adapt model architectures to new tasks in a many-task many-hardware few-shot learning setup by integrating Model Agnostic Meta Learning (MAML) into the NAS flow. The proposed NAS method (H-Meta-NAS) is hardware-aware and performs optimisation in the MAML framework. H-Meta-NAS shows a Pareto dominance compared to a variety of NAS and manual baselines in popular few-shot learning benchmarks with various hardware platforms and constraints. In particular, on the 5-way 1-shot Mini-ImageNet classification task, the proposed method outperforms the best manual baseline by a large margin (5.21% in accuracy) using 60% less computation.


title: Charge asymmetry in electron/positron energy loss in nuclear Bremsstrahlung

abstract: We calculate the leading Coulomb correction to the energy loss in the electron-nucleus Bremsstrahlung for arbitrary energy of the incoming particle. This correction determines the charge asymmetry, i.e., the difference of electron and positron energy loss. The result is presented in terms of the classical polylogarithms $\mathrm{Li}_2$ and $\mathrm{Li}_3$. We use modern multiloop methods based on the IBP reduction and on the differential equations for master integrals. We provide both the threshold and the high-energy asymptotics of the found asymmetry and compare them with the available results.


title: Learning to Swarm with Knowledge-Based Neural Ordinary Differential Equations

abstract: Understanding decentralized dynamics from collective behaviors in swarms is crucial for informing robot controller designs in artificial swarms and multiagent robotic systems. However, the complexity in agent-to-agent interactions and the decentralized nature of most swarms pose a significant challenge to the extraction of single-robot control laws from global behavior. In this work, we consider the important task of learning decentralized single-robot controllers based solely on the state observations of a swarm's trajectory. We present a general framework by adopting knowledge-based neural ordinary differential equations (KNODE) -- a hybrid machine learning method capable of combining artificial neural networks with known agent dynamics. Our approach distinguishes itself from most prior works in that we do not require action data for learning. We apply our framework to two different flocking swarms in 2D and 3D respectively, and demonstrate efficient training by leveraging the graphical structure of the swarms' information network. We further show that the learnt single-robot controllers can not only reproduce flocking behavior in the original swarm but also scale to swarms with more robots.


title: Trajectory Optimization with Optimization-Based Dynamics

abstract: We present a framework for bi-level trajectory optimization in which a system's dynamics are encoded as the solution to a constrained optimization problem and smooth gradients of this lower-level problem are passed to an upper-level trajectory optimizer. This optimization-based dynamics representation enables constraint handling, additional variables, and non-smooth behavior to be abstracted away from the upper-level optimizer, and allows classical unconstrained optimizers to synthesize trajectories for more complex systems. We provide an interior-point method for efficient evaluation of constrained dynamics and utilize implicit differentiation to compute smooth gradients of this representation. We demonstrate the framework by modeling systems from locomotion, aerospace, and manipulation domains including: acrobot with joint limits, cart-pole subject to Coulomb friction, Raibert hopper, rocket landing with thrust limits, and planar-push task with optimization-based dynamics and then optimize trajectories using iterative LQR.


title: Data Mining for Terahertz Generation Crystals

abstract: We demonstrate a data mining approach to discover and develop new organic nonlinear optical crystals that produce intense pulses of terahertz radiation. We mine the Cambridge Structural Database for non-centrosymmetric materials and use this structural data in tandem with density functional theory calculations to predict new materials that efficiently generate terahertz radiation. This enables us to (in a relatively short time) discover, synthesize, and grow large, high-quality crystals of four promising materials and characterize them for intense terahertz generation. In a direct comparison to the current state-of-the-art organic terahertz generation crystals, these new materials excel. The discovery and characterization of these novel terahertz generators validates the approach of combining data mining with density functional theory calculations to predict properties of high-performance organic materials, potentially for a host of exciting applications.


title: Bodies Uncovered: Learning to Manipulate Real Blankets Around People via Physics Simulations

abstract: While robots present an opportunity to provide physical assistance to older adults and people with mobility impairments in bed, people frequently rest in bed with blankets that cover the majority of their body. To provide assistance for many daily self-care tasks, such as bathing, dressing, or ambulating, a caregiver must first uncover blankets from part of a person's body. In this work, we introduce a formulation for robotic bedding manipulation around people in which a robot uncovers a blanket from a target body part while ensuring the rest of the human body remains covered. We compare two approaches for optimizing policies which provide a robot with grasp and release points that uncover a target part of the body: 1) reinforcement learning and 2) self-supervised learning with optimization to generate training data. We trained and conducted evaluations of these policies in physics simulation environments that consist of a deformable cloth mesh covering a simulated human lying supine on a bed. In addition, we transfer simulation-trained policies to a real mobile manipulator and demonstrate that it can uncover a blanket from target body parts of a manikin lying in bed. Source code is available online.


title: Superconducting properties of MoTe$_2$ from the $ab~initio$ anisotropic Migdal-Eliashberg theory

abstract: Molybdenum ditelluride (MoTe$_2$) is attracting considerable interest since it is the archetypal type-II Weyl semimetal and a candidate for topological superconductivity. We investigate the superconducting phase diagram of two MoTe$_2$ polymorphs using the $ab~initio$ anisotropic Migdal-Eliashberg theory, and we show that the superconducting dome originates from the synergistic contribution of the density of states at the Fermi level and the transverse acoustic Te modes in the 1T$^\prime$ phase. We find that the electron and hole pockets carry trivial $s$-wave order parameters of slightly different magnitude, reminiscent of a two-gap structure as suggested by recent experiments. We suggest that a possible route for enhancing the superconducting critical temperature, and realizing $s_{+-}$ pairing, in the T$_d$ phase is to exploit its non-trivial band topology via electron doping.


title: Energy estimates in sum-product and convexity problems

abstract: We prove a new class of low-energy decompositions which, amongst other consequences, imply that any finite set $A$ of integers may be written as $A = B \cup C$, where $B$ and $C$ are disjoint sets satisfying \[ |\{ (b_1, \dots, b_{2s}) \in B^{2s} \ | \ b_1 + \dots + b_{s} = b_{s+1} + \dots + b_{2s}\}| \ll_{s} |B|^{2s - (\log \log s)^{1/2 - o(1)}} \] and \[ |\{ (c_1, \dots, c_{2s}) \in C^{2s} \ | \ c_1 \dots c_{s} = c_{s+1} \dots c_{2s} \}| \ll_{s} |C|^{2s - (\log \log s)^{1/2 - o(1)}}.\] This generalises previous results of Bourgain--Chang on many-fold sumsets and product sets to the setting of many-fold energies, albeit with a weaker power saving, consequently confirming a speculation of Balog--Wooley. We further use our method to obtain new estimates for $s$-fold additive energies of $k$-convex sets, and these come arbitrarily close to the known lower bounds as $s$ becomes sufficiently large.


title: Predicting the Magnetic Fields of a Stealth CME Detected by Parker Solar Probe at 0.5 AU

abstract: Stealth coronal mass ejection (CMEs) are eruptions from the Sun that are not associated with appreciable low-coronal signatures. Because they often cannot be linked to a well-defined source region on the Sun, analysis of their initial magnetic configuration and eruption dynamics is particularly problematic. In this manuscript, we address this issue by undertaking the first attempt at predicting the magnetic fields of a stealth CME that erupted in 2020 June from the Earth-facing Sun. We estimate its source region with the aid of off-limb observations from a secondary viewpoint and photospheric magnetic field extrapolations. We then employ the Open Solar Physics Rapid Ensemble Information (OSPREI) modelling suite to evaluate its early evolution and forward-model its magnetic fields up to Parker Solar Probe, which detected the CME in situ at a heliocentric distance of 0.5 AU. We compare our hindcast prediction with in-situ measurements and a set of flux rope reconstructions, obtaining encouraging agreement on arrival time, spacecraft crossing location, and magnetic field profiles. This work represents a first step towards reliable understanding and forecasting of the magnetic configuration of stealth CMEs and slow, streamer-blowout events.


title: Constructions of Binary Cross Z-Complementary Pairs With Large CZC Ratio

abstract: Cross Z-complementary pairs (CZCPs) are a special kind of Z-complementary pairs (ZCPs) having zero autocorrelation sums around the in-phase position and end-shift position, also having zero cross-correlation sums around the end-shift position. It can be utilized as a key component in designing optimal training sequences for broadband spatial modulation (SM) systems over frequency selective channels. In this paper, we focus on designing new CZCPs with large cross Z-complementary ratio $(\mathrm{CZC}_{\mathrm{ratio}})$ by exploring two promising approaches. The first one of CZCPs via properly cascading sequences from a Golay complementary pair (GCP). The proposed construction leads to $(28L,13L)-\mathrm{CZCPs}$, $(28L,13L+\frac{L}{2})-\mathrm{CZCPs}$ and $(30L,13L-1)-\mathrm{CZCPs}$, where $L$ is the length of a binary GCP. Besides, we emphasize that, our proposed CZCPs have the largest $\mathrm{CZC}_{\mathrm{ratio}}=\frac{27}{28}$, compared with known CZCPs but no-perfect CZCPs in the literature. Specially, we proposed optimal binary CZCPs with $(28,13)-\mathrm{CZCP}$ and $(56,27)-\mathrm{CZCP}$. The second one of CZCPs based on Boolean functions (BFs), and the construction of CZCPs have the largest $\mathrm{CZC}_{\mathrm{ratio}}=\frac{13}{14}$, compared with known CZCPs but no-perfect CZCPs in the literature.


title: Complete minimal logarithmic energy asymptotics for points in a compact interval: a consequence of the discriminant of Jacobi polynomials

abstract: The electrostatic interpretation of zeros of Jacobi polynomials, due to Stieltjes and Schur, enables us to obtain the complete asymptotic expansion as $n \to \infty$ of the minimal logarithmic potential energy of $n$ point charges restricted to move in the interval $[-1,1]$ in the presence of an external field generated by endpoint charges. By the same methods, we determine the complete asymptotic expansion of the logarithmic energy $\sum_{j\neq k} \log(1/| x_j - x_k |)$ of Fekete points, which, by definition, maximize the product of all mutual distances $\prod_{j\neq k} | x_j - x_k |$ of $N$ points in $[-1,1]$ as $N \to \infty$. The results for other compact intervals differ only in the quadratic and linear term of the asymptotics. Explicit formulas and their asymptotics follow from the discriminant, leading coefficient, and special values at $\pm 1$ of Jacobi polynomials. For all these quantities we derive complete Poincar\'e-type asymptotics.


title: Electronic Structure and Stability of Cs$_{2}$TiX$_{6}$ and Cs$_{2}$ZrX$_{6}$ (X$=$Br,I) Vacancy Ordered Double Perovskites

abstract: Vacancy ordered halide perovskites have been extensively investigated as promising lead-free alternatives to halide perovskites for various opto-electronic applications. Among these Cs$_{2}$TiBr$_{6}$ has been reported as a stable absorber with interesting electronic and optical properties, such as a band-gap in the visible, and long carrier diffusion lengths. Yet, a thorough theoretical analysis of the exhibited properties is still missing in order to further assess its application potential from a materials design point of view. In this letter, we perform a detailed analysis for the established Ti-based compounds and investigate the less-known materials based on Zr. We discuss in details their electronic properties and band symmetries, highlight the similarity between the materials in terms of properties, and reveal limits for tuning electronic and optical properties within this family of vacancy ordered double perovskites that share the same electron configuration. We also show the challenges to compute accurate and meaningful quasi-particle corrections at GW level. Furthermore, we address their chemical stability against different decomposition reaction pathways, identifying stable regions for the formation of all materials, while probing their mechanical stability employing phonon calculations. We predict that Cs$_{2}$ZrI$_{6}$, a material practically unexplored to-date, shall exhibit a quasi-direct electronic band-gap well within the visible range, the smallest charge carrier effective masses within the Cs$_{2}$BX$_{6}$ (B=Ti,Zr; X=Br, I) compounds, and a good chemical stability.


title: Superintegrability of 3-dimensional Hamiltonian systems with conformally Euclidean metrics. Oscillator-related and Kepler-related systems

abstract: We study four particular 3-dimensional natural Hamiltonian systems defined in conformally Euclidean spaces. We prove their superintegrability and we obtain, in the four cases, the maximal number of functionally independent integrals of motion. The two first systems are related to the 3-dimensional isotropic oscillator and the superintegrability is quadratic. The third system is obtained as a continuous deformation of an oscillator with ratio of frequencies 1:1:2 and with three additional nonlinear terms of the form $k_2/x^2$, $k_3/y^2$ and $k_4/z^2$, and the fourth system is obtained as a deformation of the Kepler Hamiltonian also with these three particular nonlinear terms. These third and fourth systems are superintegrable but with higher-order constants of motion. The four systems depend on a real parameter in such a way that they are continuous functions of the parameter (in a certain domain of the parameter) and in the limit of such parameter going to zero the Euclidean dynamics is recovered.


title: An Ennola duality for subgroups of groups of Lie type

abstract: We develop a theory of Ennola duality for subgroups of finite groups of Lie type, relating subgroups of twisted and untwisted groups of the same type. Roughly speaking, one finds that subgroups $H$ of $\mathrm{GU}_d(q)$ correspond to subgroups of $\mathrm{GL}_d(-q)$, where $-q$ is interpreted modulo $|H|$. Analogous results for types other than $\mathrm A$ are established, including for exceptional types where the maximal subgroups are known, although the result for type $\mathrm D$ is still conjectural. Let $M$ denote the Gram matrix of a non-zero orthogonal form for a real, irreducible representation of a finite group, and consider $\alpha=\sqrt{\det(M)}$. If the representation has twice odd dimension, we conjecture that $\alpha$ lies in some cyclotomic field. This does not hold for representations of dimension a multiple of $4$, with a specific example of the Janko group $\mathrm J_1$ in dimension $56$ given. (This tallies with Ennola duality for representations, where type $\mathrm D_{2n}$ has no Ennola duality with ${}^2\mathrm D_{2n}$.)


title: Modeling Human Sentence Processing with Left-Corner Recurrent Neural Network Grammars

abstract: In computational linguistics, it has been shown that hierarchical structures make language models (LMs) more human-like. However, the previous literature has been agnostic about a parsing strategy of the hierarchical models. In this paper, we investigated whether hierarchical structures make LMs more human-like, and if so, which parsing strategy is most cognitively plausible. In order to address this question, we evaluated three LMs against human reading times in Japanese with head-final left-branching structures: Long Short-Term Memory (LSTM) as a sequential model and Recurrent Neural Network Grammars (RNNGs) with top-down and left-corner parsing strategies as hierarchical models. Our computational modeling demonstrated that left-corner RNNGs outperformed top-down RNNGs and LSTM, suggesting that hierarchical and left-corner architectures are more cognitively plausible than top-down or sequential architectures. In addition, the relationships between the cognitive plausibility and (i) perplexity, (ii) parsing, and (iii) beam size will also be discussed.


title: Evaluating Policy Implications on the Restrictiveness of Flow-based Market Coupling with High Shares of Intermittent Generation: A Case Study for Central Western Europe

abstract: The current stage in the evolution of the European internal energy market for electricity is defined by the transformation towards a renewable energy system. The Clean Energy Package aims to ensure that methods for capacity allocation and congestion management, that are at the center of the European internal market for electricity, align with this transformation. Flow-based market coupling, the preferred method for capacity allocation, is first and foremost a formal process to allocate exchange capacities to the markets. However, the process also allows for many considerations of the involved parties that impact the resulting capacities. As part of the Clear Energy Package, the regulatory body enacted their ambition to increase exchange capacities by enforcing transmission system operators to allocate a minimum margin of physical line capacity with the goal of providing a higher level of competition and better integration of renewable energy sources. This study investigates this and other policy relevant consideration of flow-based market coupling. The model results quantify the trade-off between permissive capacity allocation and increased congestion management. For high shares of intermittent renewable generation, less constrained exchange capacities are favorable, however also highlight the importance of the markets ability to integrate high shares of intermittent generation. apacities are favourable, however also highlight the importance of the markets ability to integrate high shares of intermittent generation.


title: Best-Arm Identification in Correlated Multi-Armed Bandits

abstract: In this paper we consider the problem of best-arm identification in multi-armed bandits in the fixed confidence setting, where the goal is to identify, with probability $1-\delta$ for some $\delta>0$, the arm with the highest mean reward in minimum possible samples from the set of arms $\mathcal{K}$. Most existing best-arm identification algorithms and analyses operate under the assumption that the rewards corresponding to different arms are independent of each other. We propose a novel correlated bandit framework that captures domain knowledge about correlation between arms in the form of upper bounds on expected conditional reward of an arm, given a reward realization from another arm. Our proposed algorithm C-LUCB, which generalizes the LUCB algorithm utilizes this partial knowledge of correlations to sharply reduce the sample complexity of best-arm identification. More interestingly, we show that the total samples obtained by C-LUCB are of the form $\mathcal{O}\left(\sum_{k \in \mathcal{C}} \log\left(\frac{1}{\delta}\right)\right)$ as opposed to the typical $\mathcal{O}\left(\sum_{k \in \mathcal{K}} \log\left(\frac{1}{\delta}\right)\right)$ samples required in the independent reward setting. The improvement comes, as the $\mathcal{O}(\log(1/\delta))$ term is summed only for the set of competitive arms $\mathcal{C}$, which is a subset of the original set of arms $\mathcal{K}$. The size of the set $\mathcal{C}$, depending on the problem setting, can be as small as $2$, and hence using C-LUCB in the correlated bandits setting can lead to significant performance improvements. Our theoretical findings are supported by experiments on the Movielens and Goodreads recommendation datasets.


title: Algebraic cycles and Lehn-Lehn-Sorger-van Straten eightfolds

abstract: This article is about Lehn-Lehn-Sorger-van Straten eightfolds $Z$, and their anti-symplectic involution $\iota$. When $Z$ is birational to the Hilbert scheme of points on a K3 surface, we give an explicit formula for the action of $\iota$ on the Chow group of $0$-cycles of $Z$. The formula is in agreement with the Bloch-Beilinson conjectures, and has some non-trivial consequences for the Chow ring of the quotient.


title: Ensemble Density Functional Theory of Neutral and Charged Excitations

abstract: Recent progress in the field of (time-independent) ensemble density-functional theory (DFT) for excited states are reviewed. Both Gross-Oliveira-Kohn (GOK) and $N$-centered ensemble formalisms, which are mathematically very similar and allow for an in-principle-exact description of neutral and charged electronic excitations, respectively, are discussed. Key exact results like, for example, the equivalence between the infamous derivative discontinuity problem and the description of weight dependencies in the ensemble exchange-correlation density functional, are highlighted. The variational evaluation of orbital-dependent ensemble Hartree-exchange (Hx) energies is discussed in detail. We show in passing that state-averaging individual exact Hx energies can lead to severe (solvable though) $v$-representability issues. Finally, we explore the possibility to use the concept of density-driven correlation, which has been recently introduced and does not exist in regular ground-state DFT, for improving state-of-the-art correlation density-functional approximations for ensembles. The present review reflects the efforts of a growing community to turn ensemble DFT into a rigorous and reliable low-cost computational method for excited states. We hope that, in the near future, this contribution will stimulate new formal and practical developments in the field.


title: On $3$-graphs with no four vertices spanning exactly two edges

abstract: Let $D_2$ denote the $3$-uniform hypergraph with $4$ vertices and $2$ edges. Answering a question of Alon and Shapira, we prove an induced removal lemma for $D_2$ having polynomial bounds. We also prove an Erd\H{o}s-Hajnal-type result: every induced $D_2$-free hypergraph on $n$ vertices contains a clique or an independent set of size $n^{c}$ for some absolute constant $c > 0$. In the case of both problems, $D_2$ is the only nontrivial $k$-uniform hypergraph with $k\geq 3$ which admits a polynomial bound.


title: WikiCSSH: Extracting and Evaluating Computer Science Subject Headings from Wikipedia

abstract: Hierarchical domain-specific classification schemas (or subject heading vocabularies) are often used to identify, classify, and disambiguate concepts that occur in scholarly articles. In this work, we develop, apply, and evaluate a human-in-the-loop workflow that first extracts an initial category tree from crowd-sourced Wikipedia data, and then combines community detection, machine learning, and hand-crafted heuristics or rules to prune the initial tree. This work resulted in WikiCSSH; a large-scale, hierarchically organized vocabulary for the domain of computer science (CS). Our evaluation suggests that WikiCSSH outperforms alternative CS vocabularies in terms of vocabulary size as well as the performance of lexicon-based key-phrase extraction from scholarly data. WikiCSSH can further distinguish between coarse-grained versus fine-grained CS concepts. The outlined workflow can serve as a template for building hierarchically-organized subject heading vocabularies for other domains that are covered in Wikipedia.


title: More on the Weak Gravity Conjecture via Convexity of Charged Operators

abstract: The Weak Gravity Conjecture has recently been re-formulated in terms of a particle with non-negative self-binding energy. Because of the dual conformal field theory (CFT) formulation in the anti-de Sitter space the conformal dimension $\Delta (Q)$ of the lowest-dimension operator with charge Q under some global U(1) symmetry must be a convex function of Q. This property has been conjectured to hold for any (unitary) conformal field theory and generalized to larger global symmetry groups. Here we refine and further test the convex charge conjecture via semiclassical computations for fixed charge sectors of different theories in different dimensions. We analyze the convexity properties of the leading and next-to-leading order terms stemming from the semiclassical computation, de facto, extending previous tests beyond the leading perturbative contributions and to arbitrary charges. In particular, the leading contribution is sufficient to test convexity in the semiclassical computations. We also consider intriguing cases in which the models feature a transition from real to complex conformal dimensions either as a function of the charge or number of matter fields. As a relevant example of the first kind, we investigate the $O(N)$ model in $4+\epsilon$ dimensions. As an example of the second type we consider the $U(N)\times U(M)$ model in $4-\epsilon$ dimensions. Both models display a rich dynamics where, by changing the number of matter fields and/or charge, one can achieve dramatically different physical regimes. We discover that whenever a complex conformal dimension appears, the real part satisfies the convexity property.


title: Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding

abstract: Large-scale, pre-trained language models (LMs) have achieved human-level performance on a breadth of language understanding tasks. However, evaluations only based on end task performance shed little light on machines' true ability in language understanding and reasoning. In this paper, we highlight the importance of evaluating the underlying reasoning process in addition to end performance. Toward this goal, we introduce Tiered Reasoning for Intuitive Physics (TRIP), a novel commonsense reasoning dataset with dense annotations that enable multi-tiered evaluation of machines' reasoning process. Our empirical results show that while large LMs can achieve high end performance, they struggle to support their predictions with valid supporting evidence. The TRIP dataset and our baseline results will motivate verifiable evaluation of commonsense reasoning and facilitate future research toward developing better language understanding and reasoning models.


title: Quantum-dot single-electron transistor as thermoelectric quantum detectors at terahertz frequencies

abstract: Low dimensional nano-systems are promising candidates for manipulating, controlling and capturing photons with large sensitivities and low-noise. If quantum engineered to tailor the energy of the localized electrons across the desired frequency range, they can allow devising efficient quantum sensors across any frequency domain. Here, we exploit the rich few-electrons physics to develop millimeter-wave nanodetectors employing as sensing element an InAs/InAs0.3P0.7 quantum-dot nanowire, embedded in a single electron transistor. Once irradiated with light the deeply localized quantum element exhibits an extra electromotive force driven by the photothermoelectric effect, which is exploited to efficiently sense radiation at 0.6 THz with a noise equivalent power < 8 pWHz-1/2 and almost zero dark current. The achieved results open intriguing perspectives for quantum key distributions, quantum communications and quantum cryptography at terahertz frequencies.


title: We went to look for meaning and all we got were these lousy representations: aspects of meaning representation for computational semantics

abstract: In this paper we examine different meaning representations that are commonly used in different natural language applications today and discuss their limits, both in terms of the aspects of the natural language meaning they are modelling and in terms of the aspects of the application for which they are used.


title: Using $B^0_s\to D_s^\mp K^\pm$ Decays as a Portal to New Physics

abstract: The system of $B^0_s\to D_s^\mp K^\pm$ decays offers a theoretically clean determination of the angle $\gamma$ of the Unitarity Triangle. A corresponding LHCb analysis resulted in a surprisingly large result, which is in tension with other determinations and global analyses of the Unitarity Triangle. Paying special attention to discrete ambiguities, we confirm this picture and resolve a final ambiguity. Moreover, we extract the branching ratios of the underlying $\bar{B}^0_s\to D_s^+K^-$ and $\bar{B}^0_s\to D_s^- K^+$ modes. Combining them with information from semileptonic $B_{(s)}$ decays, we arrive at another puzzling situation, which we obtain also for other decays with similar dynamics. These patterns could be footprints of New Physics in the $b\to c \bar{u} s$ and $b \to u \bar{c} s$ processes which govern the dynamics of the $\bar{B}^0_s\to D_s^\mp K^\pm$ channels. Employing a model-independent parametrisation, we present a strategy to reveal such effects. Applying it to the present data, we obtain strongly correlated New-Physics contributions with potentially large CP-violating phases. We find that new contributions sizeably smaller than the Standard Model amplitudes could actually accommodate the current data. This strategy offers an exciting probe for new sources of CP violation at the future high-precision frontier of $B$ physics.


title: Development and Validation of a Scalable Fast Load Shedding Technique for Industrial Power Systems

abstract: The work aims to improve the existing fast load shedding algorithm for industrial power system to increase performance, reliability, and scalability for future expansions. The paper illustrates the development of a scalable algorithm to compute the shedding matrix, and the test performed on a model of the electric grid of an offshore platform. From this model it is possible to study the impact on the transients of various parameters, such as spinning reserve and delay time. Subsequently, the code is converted into Structured Text and implemented on an ABB PLC. The scalability of the load shedding algorithm is thus verified, confirming its performance with respect to the computation of the shedding matrix and the usefulness of the dynamic simulations during the design phase of the plant.


title: Failure of Fatou type theorems for solutions to PDE of $p$-Laplace type in domains with flat boundaries

abstract: Let $ \mathbb{R}^{n} $ denote Euclidean $ n $ space and given $k$ a positive integer let $ \Lambda_k \subset \mathbb{R}^{n} $, $ 1 \leq k < n - 1, n \geq 3, $ be a $k$-dimensional plane with $ 0 \in \Lambda_k.$ If $n-k < p <\infty$, we first study the Martin boundary problem for solutions to the $p$-Laplace equation (called $p$-harmonic functions) in $ \mathbb{R}^{n} \setminus \Lambda_k $ relative to $ \{0\}. $ We then use the results from our study to extend the work of Wolff on the failure of Fatou type theorems for $p$-harmonic functions in $ \mathbb{R}^{2}_+ $ to $p$-harmonic functions in $ \mathbb{R}^{n} \setminus \Lambda_k $ when $ n-k < p <\infty$. Finally, we discuss generalizations of our work to solutions of $ p $-Laplace type PDE (called $ \mathcal{A}$-harmonic functions).


title: Does Pretraining for Summarization Require Knowledge Transfer?

abstract: Pretraining techniques leveraging enormous datasets have driven recent advances in text summarization. While folk explanations suggest that knowledge transfer accounts for pretraining's benefits, little is known about why it works or what makes a pretraining task or dataset suitable. In this paper, we challenge the knowledge transfer story, showing that pretraining on documents consisting of character n-grams selected at random, we can nearly match the performance of models pretrained on real corpora. This work holds the promise of eliminating upstream corpora, which may alleviate some concerns over offensive language, bias, and copyright issues. To see whether the small residual benefit of using real data could be accounted for by the structure of the pretraining task, we design several tasks motivated by a qualitative study of summarization corpora. However, these tasks confer no appreciable benefit, leaving open the possibility of a small role for knowledge transfer.


title: Saliency Guided Experience Packing for Replay in Continual Learning

abstract: Artificial learning systems aspire to mimic human intelligence by continually learning from a stream of tasks without forgetting past knowledge. One way to enable such learning is to store past experiences in the form of input examples in episodic memory and replay them when learning new tasks. However, performance of such method suffers as the size of the memory becomes smaller. In this paper, we propose a new approach for experience replay, where we select the past experiences by looking at the saliency maps which provide visual explanations for the model's decision. Guided by these saliency maps, we pack the memory with only the parts or patches of the input images important for the model's prediction. While learning a new task, we replay these memory patches with appropriate zero-padding to remind the model about its past decisions. We evaluate our algorithm on CIFAR-100, miniImageNet and CUB datasets and report better performance than the state-of-the-art approaches. With qualitative and quantitative analyses we show that our method captures richer summaries of past experiences without any memory increase, and hence performs well with small episodic memory.


title: Toy models for hierarchy studies

abstract: We provide a simple computation in order to estimate the probability of a given hierarchy between two scales. In particular, we work in a model provided with a gauge symmetry, with two scalar doublets. We start from a scale-invariant classical Lagrangian, but by taking into account the Coleman-Weinberg mechanism, we obtain masses for the gauge bosons and the scalars. This approach typically provides a light (L) and a heavy (H) sector related to the two different vacuum expectation values of the two scalars. We compute the size of the hyper-volume of the parameter space of the model associated with an interval of mass ratios between these two sectors. We define the probability as proportional to this size and conclude that probabilities of very large hierarchies are not negligible in the type of models studied in this letter.


title: Dispersive analysis of glueball masses

abstract: We develop an inverse matrix method to solve for resonance masses from a dispersion relation obeyed by a correlation function. Given the operator product expansion (OPE) of a correlation function in the deep Euclidean region, we obtain the nonperturbative spectral density, which exhibits resonance structures naturally. The value of the gluon condensate in the OPE is fixed by producing the $\rho$ meson mass in the formalism, and then input into the dispersion relations for the scalar, pseudoscalar and tensor glueballs. It is shown that the low-energy limit of the correlation function for the scalar glueball, derived from the spectral density, discriminates the lattice estimate for the triple-gluon condensate from the single-instanton estimate. The spectral densities for the scalar and pseudoscalar glueballs reveal a double-peak structure: the peak located at lower mass implies that the $f_0(500)$ and $f_0(980)$ ($\eta$ ad $\eta'$) mesons contain small amount of gluonium components, and should be included into scalar (pseudoscalar) mixing frameworks. Another peak determines the scalar (pseudoscalar) glueball mass around 1.50 (1.75) GeV with a broad width about 200 MeV, suggesting that the $f_0(1370)$, $f_0(1500)$ and $f_0(1710)$ ($\eta(1760)$) mesons are the glue-rich states. We also predict the topological susceptability $\chi_t^{1/4}=75$-78 MeV, deduced from the correlation function for the pseudoscalar glueball at zero momentum. Our analysis gives no resonance solution for the tensor glueball, which may be attributed to the insufficient nonperturbative condensate information in the currently available OPE.