title: A New Formalism, Method and Open Issues for Zero-Shot Coordination

abstract: In many coordination problems, independently reasoning humans are able to discover mutually compatible policies. In contrast, independently trained self-play policies are often mutually incompatible. Zero-shot coordination (ZSC) has recently been proposed as a new frontier in multi-agent reinforcement learning to address this fundamental issue. Prior work approaches the ZSC problem by assuming players can agree on a shared learning algorithm but not on labels for actions and observations, and proposes other-play as an optimal solution. However, until now, this "label-free" problem has only been informally defined. We formalize this setting as the label-free coordination (LFC) problem by defining the label-free coordination game. We show that other-play is not an optimal solution to the LFC problem as it fails to consistently break ties between incompatible maximizers of the other-play objective. We introduce an extension of the algorithm, other-play with tie-breaking, and prove that it is optimal in the LFC problem and an equilibrium in the LFC game. Since arbitrary tie-breaking is precisely what the ZSC setting aims to prevent, we conclude that the LFC problem does not reflect the aims of ZSC. To address this, we introduce an alternative informal operationalization of ZSC as a starting point for future work.


title: Nawrotzki's Algorithm for the Countable Splitting Lemma, Constructively

abstract: We reprove the countable splitting lemma by adapting Nawrotzki's algorithm which produces a sequence that converges to a solution. Our algorithm combines Nawrotzki's approach with taking finite cuts. It is constructive in the sense that each term of the iteratively built approximating sequence as well as the error between the approximants and the solution is computable with finitely many algebraic operations.


title: Precise characterization of the prior predictive distribution of deep ReLU networks

abstract: Recent works on Bayesian neural networks (BNNs) have highlighted the need to better understand the implications of using Gaussian priors in combination with the compositional structure of the network architecture. Similar in spirit to the kind of analysis that has been developed to devise better initialization schemes for neural networks (cf. He- or Xavier initialization), we derive a precise characterization of the prior predictive distribution of finite-width ReLU networks with Gaussian weights. While theoretical results have been obtained for their heavy-tailedness, the full characterization of the prior predictive distribution (i.e. its density, CDF and moments), remained unknown prior to this work. Our analysis, based on the Meijer-G function, allows us to quantify the influence of architectural choices such as the width or depth of the network on the resulting shape of the prior predictive distribution. We also formally connect our results to previous work in the infinite width setting, demonstrating that the moments of the distribution converge to those of a normal log-normal mixture in the infinite depth limit. Finally, our results provide valuable guidance on prior design: for instance, controlling the predictive variance with depth- and width-informed priors on the weights of the network.


title: Learning Competitive Equilibria in Exchange Economies with Bandit Feedback

abstract: The sharing of scarce resources among multiple rational agents is one of the classical problems in economics. In exchange economies, which are used to model such situations, agents begin with an initial endowment of resources and exchange them in a way that is mutually beneficial until they reach a competitive equilibrium (CE). The allocations at a CE are Pareto efficient and fair. Consequently, they are used widely in designing mechanisms for fair division. However, computing CEs requires the knowledge of agent preferences which are unknown in several applications of interest. In this work, we explore a new online learning mechanism, which, on each round, allocates resources to the agents and collects stochastic feedback on their experience in using that allocation. Its goal is to learn the agent utilities via this feedback and imitate the allocations at a CE in the long run. We quantify CE behavior via two losses and propose a randomized algorithm which achieves sublinear loss under a parametric class of utilities. Empirically, we demonstrate the effectiveness of this mechanism through numerical simulations.


title: Inexact Loops in Robotics Problems

abstract: Loops are pervasive in robotics problems, appearing in mapping and localization, where one is interested in finding loop closure constraints to better approximate robot poses or other estimated quantities, as well as planning and prediction, where one is interested in the homotopy classes of the space through which a robot is moving. We generalize the standard topological definition of a loop to cases where a trajectory passes close to itself, but doesn't necessarily touch, giving a definition that is more practical for real robotics problems. This relaxation leads to new and useful properties of inexact loops, such as their ability to be partitioned into topologically connected sets closely matching the concept of a "loop closure", and the existence of simple and nonsimple loops. Building from these ideas, we introduce several ways to measure properties and quantities of inexact loops on a trajectory, such as the trajectory's "loop area" and "loop density", and use them to compare strategies for sampling representative inexact loops to build constraints in mapping and localization problems.


title: The Moon, a disk or a sphere?

abstract: In this paper, we present a physical modeling activity whose objective is to allow students to determine the differences between a disk and a sphere using pure scientific criteria. Thereunto, we reproduce the Sun-Earth-Moon system with low-cost materials and compare the illumination effects on the Moon considering two possible shapes for it (a sphere and a disk). The analysis is based on the shape of the Terminator line produced in each case as a function of the illumination angle. The results obtained are first discussed and then applied so that one can interpret the observed patterns in the illumination effects of other celestial bodies, such as Venus or even the Earth. Thereby, the activity can be very useful to unmask the unscientific idea of Flat Earth. The entire activity is easily replicable and it may be useful to promote a more realistic view of science and its methods.


title: Gate-controlled supercurrent in epitaxial Al/InAs nanowires

abstract: Gate-controlled supercurrent (GCS) in superconductor nanobridges has recently attracted attention as a means to create superconducting field effect transistors. Despite the clear advantage for applications with low power consumption and high switching speeds, the microscopic mechanism of the field effect is still under debate. In this work, we realize GCS for the first time in an epitaxial superconductor, which is created as a shell on an InAs nanowire. We show that the supercurrent in the epitaxial Al layer can be switched to the normal state by applying $\simeq\pm$ 23$\,$V on a bottom gate insulated from the nanowire by a crystalline hBN layer. Our extensive study on the temperature and magnetic field dependencies of GCS suggests that hot electron injection alone cannot explain our experimental findings.


title: Robust Representation Learning via Perceptual Similarity Metrics

abstract: A fundamental challenge in artificial intelligence is learning useful representations of data that yield good performance on a downstream task, without overfitting to spurious input features. Extracting such task-relevant predictive information is particularly difficult for real-world datasets. In this work, we propose Contrastive Input Morphing (CIM), a representation learning framework that learns input-space transformations of the data to mitigate the effect of irrelevant input features on downstream performance. Our method leverages a perceptual similarity metric via a triplet loss to ensure that the transformation preserves task-relevant information.Empirically, we demonstrate the efficacy of our approach on tasks which typically suffer from the presence of spurious correlations: classification with nuisance information, out-of-distribution generalization, and preservation of subgroup accuracies. We additionally show that CIM is complementary to other mutual information-based representation learning techniques, and demonstrate that it improves the performance of variational information bottleneck (VIB) when used together.


title: Piecewise-constant Neural ODEs

abstract: Neural networks are a popular tool for modeling sequential data but they generally do not treat time as a continuous variable. Neural ODEs represent an important exception: they parameterize the time derivative of a hidden state with a neural network and then integrate over arbitrary amounts of time. But these parameterizations, which have arbitrary curvature, can be hard to integrate and thus train and evaluate. In this paper, we propose making a piecewise-constant approximation to Neural ODEs to mitigate these issues. Our model can be integrated exactly via Euler integration and can generate autoregressive samples in 3-20 times fewer steps than comparable RNN and ODE-RNN models. We evaluate our model on several synthetic physics tasks and a planning task inspired by the game of billiards. We find that it matches the performance of baseline approaches while requiring less time to train and evaluate.


title: Design and production of the high voltage electrode grids and electron extraction region for the LZ dual-phase xenon time projection chamber

abstract: The dual-phase xenon time projection chamber (TPC) is a powerful tool for direct-detection experiments searching for WIMP dark matter, other dark matter models, and neutrinoless double-beta decay. Successful operation of such a TPC is critically dependent on the ability to hold high electric fields in the bulk liquid, across the liquid surface, and in the gas. Careful design and construction of the electrodes used to establish these fields is therefore required. We present the design and production of the LUX-ZEPLIN (LZ) experiment's high-voltage electrodes, a set of four woven mesh wire grids. Grid design drivers are discussed, with emphasis placed on design of the electron extraction region. We follow this with a description of the grid production process and a discussion of steps taken to validate the LZ grids prior to integration into the TPC.


title: Pay Attention with Focus: A Novel Learning Scheme for Classification of Whole Slide Images

abstract: Deep learning methods such as convolutional neural networks (CNNs) are difficult to directly utilize to analyze whole slide images (WSIs) due to the large image dimensions. We overcome this limitation by proposing a novel two-stage approach. First, we extract a set of representative patches (called mosaic) from a WSI. Each patch of a mosaic is encoded to a feature vector using a deep network. The feature extractor model is fine-tuned using hierarchical target labels of WSIs, i.e., anatomic site and primary diagnosis. In the second stage, a set of encoded patch-level features from a WSI is used to compute the primary diagnosis probability through the proposed Pay Attention with Focus scheme, an attention-weighted averaging of predicted probabilities for all patches of a mosaic modulated by a trainable focal factor. Experimental results show that the proposed model can be robust, and effective for the classification of WSIs.


title: Relaxing Local Robustness

abstract: Certifiable local robustness, which rigorously precludes small-norm adversarial examples, has received significant attention as a means of addressing security concerns in deep learning. However, for some classification problems, local robustness is not a natural objective, even in the presence of adversaries; for example, if an image contains two classes of subjects, the correct label for the image may be considered arbitrary between the two, and thus enforcing strict separation between them is unnecessary. In this work, we introduce two relaxed safety properties for classifiers that address this observation: (1) relaxed top-k robustness, which serves as the analogue of top-k accuracy; and (2) affinity robustness, which specifies which sets of labels must be separated by a robustness margin, and which can be $\epsilon$-close in $\ell_p$ space. We show how to construct models that can be efficiently certified against each relaxed robustness property, and trained with very little overhead relative to standard gradient descent. Finally, we demonstrate experimentally that these relaxed variants of robustness are well-suited to several significant classification problems, leading to lower rejection rates and higher certified accuracies than can be obtained when certifying "standard" local robustness.


title: Shifted symplectic reduction of derived critical loci

abstract: We prove that the derived critical locus of a $G$-invariant function $S:X\to\mathbb{A}^1$ carries a shifted moment map, and that its derived symplectic reduction is the derived critical locus of the induced function $S_{red}:X/G\to\mathbb{A}^1$ on the orbit stack. We also provide a relative version of this result, and show that derived symplectic reduction commutes with derived lagrangian intersections.


title: $^{159}$Dy electron-capture: a strong new candidate for neutrino mass determination

abstract: { The ground-state to ground-state electron-capture $Q$ value of $^{159}$Dy ($3/2^-$) has been measured directly utilizing the double Penning trap mass spectrometer JYFLTRAP. A value of 364.73(19)~keV was obtained from a measurement of the cyclotron frequency ratio of the decay parent $^{159}$Dy and the decay daughter $^{159}$Tb ions using the novel phase-imaging ion-cyclotron resonance technique. The $Q$ values for allowed Gamow-Teller transition to $5/2^-$ and the third-forbidden unique transition to $11/2^+$ state with excitation energies of 363.5449(14)~keV and 362.050(40)~keV in $^{159}$Tb were determined to be 1.18(19) keV and 2.68(19) keV, respectively. The high-precision $Q$ value of transition $3/2^-\to 5/2^-$ from this work, revealing itself as the lowest electron-capture $Q$ value, is utilized to unambiguously characterise all the possible lines that are present in its electron capture spectrum. { We performed atomic many-body calculations for both transitions to determine electron-capture probabilities from various atomic orbitals, and found an order of magnitude enhancement in the event rates near the end-point of energy spectrum in the transition to the $5/2^-$ nuclear excited state, which can become very interesting once the experimental challenges of identifying decays into excited states are overcome. The transition to the $11/2^+$ state is strongly suppressed and found unsuitable for measuring the neutrino mass. These results show that the electron capture in the $^{159}$Dy atom, going to the $5/2^-$ state of the $^{159}$Tb nucleus, %\textcolor{red} {is a new candidate which may open the way to determine the electron-neutrino mass in the sub-eV region by studying EC. Further experimental feasibility studies, including coincidence measurements with realistic detectors, will be of great interest.} }


title: Efficient and Less Centralized Federated Learning

abstract: With the rapid growth in mobile computing, massive amounts of data and computing resources are now located at the edge. To this end, Federated learning (FL) is becoming a widely adopted distributed machine learning (ML) paradigm, which aims to harness this expanding skewed data locally in order to develop rich and informative models. In centralized FL, a collection of devices collaboratively solve a ML task under the coordination of a central server. However, existing FL frameworks make an over-simplistic assumption about network connectivity and ignore the communication bandwidth of the different links in the network. In this paper, we present and study a novel FL algorithm, in which devices mostly collaborate with other devices in a pairwise manner. Our nonparametric approach is able to exploit network topology to reduce communication bottlenecks. We evaluate our approach on various FL benchmarks and demonstrate that our method achieves 10X better communication efficiency and around 8% increase in accuracy compared to the centralized approach.


title: Operon Dynamics with State Dependent Transcription and/or Translation Delays

abstract: Transcription and translation retrieve and operationalize gene encoded information in cells. These processes are not instantaneous and incur significant delays. In this paper we study Goodwin models of both inducible and repressible operons with state-dependent delays. The paper provides justification and derivation of the model, detailed analysis of the appropriate setting of the corresponding dynamical system, and extensive numerical analysis of its dynamics. Comparison with constant delay models shows significant differences in dynamics that include existence of stable periodic orbits in inducible systems and multistability in repressible systems. A combination of parameter space exploration, numerics, analysis of steady state linearization and bifurcation theory indicates the likely presence of Shilnikov-type homoclinic bifurcations in the repressible operon model.


title: Mirror3D: Depth Refinement for Mirror Surfaces

abstract: Despite recent progress in depth sensing and 3D reconstruction, mirror surfaces are a significant source of errors. To address this problem, we create the Mirror3D dataset: a 3D mirror plane dataset based on three RGBD datasets (Matterport3D, NYUv2 and ScanNet) containing 7,011 mirror instance masks and 3D planes. We then develop Mirror3DNet: a module that refines raw sensor depth or estimated depth to correct errors on mirror surfaces. Our key idea is to estimate the 3D mirror plane based on RGB input and surrounding depth context, and use this estimate to directly regress mirror surface depth. Our experiments show that Mirror3DNet significantly mitigates errors from a variety of input depth data, including raw sensor depth and depth estimation or completion methods.


title: Corruption-Robust Offline Reinforcement Learning

abstract: We study the adversarial robustness in offline reinforcement learning. Given a batch dataset consisting of tuples $(s, a, r, s')$, an adversary is allowed to arbitrarily modify $\epsilon$ fraction of the tuples. From the corrupted dataset the learner aims to robustly identify a near-optimal policy. We first show that a worst-case $\Omega(d\epsilon)$ optimality gap is unavoidable in linear MDP of dimension $d$, even if the adversary only corrupts the reward element in a tuple. This contrasts with dimension-free results in robust supervised learning and best-known lower-bound in the online RL setting with corruption. Next, we propose robust variants of the Least-Square Value Iteration (LSVI) algorithm utilizing robust supervised learning oracles, which achieve near-matching performances in cases both with and without full data coverage. The algorithm requires the knowledge of $\epsilon$ to design the pessimism bonus in the no-coverage case. Surprisingly, in this case, the knowledge of $\epsilon$ is necessary, as we show that being adaptive to unknown $\epsilon$ is impossible.This again contrasts with recent results on corruption-robust online RL and implies that robust offline RL is a strictly harder problem.


title: Optimal Counterfactual Explanations in Tree Ensembles

abstract: Counterfactual explanations are usually generated through heuristics that are sensitive to the search's initial conditions. The absence of guarantees of performance and robustness hinders trustworthiness. In this paper, we take a disciplined approach towards counterfactual explanations for tree ensembles. We advocate for a model-based search aiming at "optimal" explanations and propose efficient mixed-integer programming approaches. We show that isolation forests can be modeled within our framework to focus the search on plausible explanations with a low outlier score. We provide comprehensive coverage of additional constraints that model important objectives, heterogeneous data types, structural constraints on the feature space, along with resource and actionability restrictions. Our experimental analyses demonstrate that the proposed search approach requires a computational effort that is orders of magnitude smaller than previous mathematical programming algorithms. It scales up to large data sets and tree ensembles, where it provides, within seconds, systematic explanations grounded on well-defined models solved to optimality.


title: Thermal experiments for fractured rock characterization: theoretical analysis and inverse modeling

abstract: Field-scale properties of fractured rocks play crucial role in many subsurface applications, yet methodologies for identification of the statistical parameters of a discrete fracture network (DFN) are scarce. We present an inversion technique to infer two such parameters, fracture density and fractal dimension, from cross-borehole thermal experiments data. It is based on a particle-based heat-transfer model, whose evaluation is accelerated with a deep neural network (DNN) surrogate that is integrated into a grid search. The DNN is trained on a small number of heat-transfer model runs, and predicts the cumulative density function of the thermal field. The latter is used to compute fine posterior distributions of the (to-be-estimated) parameters. Our synthetic experiments reveal that fracture density is well constrained by data, while fractal dimension is harder to determine. Adding non-uniform prior information related to the DFN connectivity improves the inference of this parameter.


title: A Note on Confluence in Typed Probabilistic Lambda Calculi

abstract: On the topic of probabilistic rewriting, there are several works studying both termination and confluence of different systems. While working with a lambda calculus modelling quantum computation, we found a system with probabilistic rewriting rules and strongly normalizing terms. We examine the effect of small modifications in probabilistic rewriting, affine variables, and strategies on the overall confluence in this strongly normalizing probabilistic calculus.


title: Explicitly Solvable Systems of First-order Ordinary Differential Equations with Polynomial Right-hand Sides, and Their Periodic Variants

abstract: In this Letter we identify special systems of (an arbitrary number) N of first-order Ordinary Differential Equations with homogeneous polynomials of arbitrary degree M on their right-hand sides, which feature very simple explicit solutions; as well as variants of these systems--with right-hand sides no more homogeneous--which feature periodic solutions. A novelty of these findings is to consider special systems characterized by constraints involving both their parameters and their initial data.


title: On D2D Caching with Uncoded Cache Placement

abstract: We consider a cache-aided wireless device-to-device (D2D) network under the constraint of one-shot delivery, where the placement phase is orchestrated by a central server. We assume that the devices' caches are filled with uncoded data, and the whole file database at the server is made available in the collection of caches. Following this phase, the files requested by the users are serviced by inter-device multicast communication. For such a system setting, we provide the exact characterization of load-memory trade-off, by deriving both the minimum average and the minimum peak sum-loads of links between devices, for a given individual memory size at disposal of each user.


title: Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR

abstract: Simultaneous speech-to-text translation is widely useful in many scenarios. The conventional cascaded approach uses a pipeline of streaming ASR followed by simultaneous MT, but suffers from error propagation and extra latency. To alleviate these issues, recent efforts attempt to directly translate the source speech into target text simultaneously, but this is much harder due to the combination of two separate tasks. We instead propose a new paradigm with the advantages of both cascaded and end-to-end approaches. The key idea is to use two separate, but synchronized, decoders on streaming ASR and direct speech-to-text translation (ST), respectively, and the intermediate results of ASR guide the decoding policy of (but is not fed as input to) ST. During training time, we use multitask learning to jointly learn these two tasks with a shared encoder. En-to-De and En-to-Es experiments on the MuSTC dataset demonstrate that our proposed technique achieves substantially better translation quality at similar levels of latency.


title: CAR-Net: Unsupervised Co-Attention Guided Registration Network for Joint Registration and Structure Learning

abstract: Image registration is a fundamental building block for various applications in medical image analysis. To better explore the correlation between the fixed and moving images and improve registration performance, we propose a novel deep learning network, Co-Attention guided Registration Network (CAR-Net). CAR-Net employs a co-attention block to learn a new representation of the inputs, which drives the registration of the fixed and moving images. Experiments on UK Biobank cardiac cine-magnetic resonance image data demonstrate that CAR-Net obtains higher registration accuracy and smoother deformation fields than state-of-the-art unsupervised registration methods, while achieving comparable or better registration performance than corresponding weakly-supervised variants. In addition, our approach can provide critical structural information of the input fixed and moving images simultaneously in a completely unsupervised manner.


title: DEMETER: Efficient simultaneous curation of genome-scale reconstructions guided by experimental data and refined gene annotations

abstract: Motivation: Manual curation of genome-scale reconstructions is laborious, yet existing automated curation tools typically do not take species-specific experimental data and manually refined genome annotations into account. Results: We developed DEMETER, a COBRA Toolbox extension that enables the efficient simultaneous refinement of thousands of draft genome-scale reconstructions while ensuring adherence to the quality standards in the field, agreement with available experimental data, and refinement of pathways based on manually refined genome annotations. Availability: DEMETER and tutorials are available at https://github.com/opencobra/cobratoolbox.


title: Federated Learning with Buffered Asynchronous Aggregation

abstract: Scalability and privacy are two critical concerns for cross-device federated learning (FL) systems. In this work, we identify that synchronous FL - synchronized aggregation of client updates in FL - cannot scale efficiently beyond a few hundred clients training in parallel. It leads to diminishing returns in model performance and training speed, analogous to large-batch training. On the other hand, asynchronous aggregation of client updates in FL (i.e., asynchronous FL) alleviates the scalability issue. However, aggregating individual client updates is incompatible with Secure Aggregation, which could result in an undesirable level of privacy for the system. To address these concerns, we propose a novel buffered asynchronous aggregation method, FedBuff, that is agnostic to the choice of optimizer, and combines the best properties of synchronous and asynchronous FL. We empirically demonstrate that FedBuff is 3.3x more efficient than synchronous FL and up to 2.5x more efficient than asynchronous FL, while being compatible with privacy-preserving technologies such as Secure Aggregation and differential privacy. We provide theoretical convergence guarantees in a smooth non-convex setting. Finally, we show that under differentially private training, FedBuff can outperform FedAvgM at low privacy settings and achieve the same utility for higher privacy settings.


title: Quantum-resistance in blockchain networks

abstract: This paper describes the work carried out by the Inter-American Development Bank, the IDB Lab, LACChain, Cambridge Quantum Computing (CQC), and Tecnologico de Monterrey to identify and eliminate quantum threats in blockchain networks. The advent of quantum computing threatens internet protocols and blockchain networks because they utilize non-quantum resistant cryptographic algorithms. When quantum computers become robust enough to run Shor's algorithm on a large scale, the most used asymmetric algorithms, utilized for digital signatures and message encryption, such as RSA, (EC)DSA, and (EC)DH, will be no longer secure. Quantum computers will be able to break them within a short period of time. Similarly, Grover's algorithm concedes a quadratic advantage for mining blocks in certain consensus protocols such as proof of work. Today, there are hundreds of billions of dollars denominated in cryptocurrencies that rely on blockchain ledgers as well as the thousands of blockchain-based applications storing value in blockchain networks. Cryptocurrencies and blockchain-based applications require solutions that guarantee quantum resistance in order to preserve the integrity of data and assets in their public and immutable ledgers. We have designed and developed a layer-two solution to secure the exchange of information between blockchain nodes over the internet and introduced a second signature in transactions using post-quantum keys. Our versatile solution can be applied to any blockchain network. In our implementation, quantum entropy was provided via the IronBridge Platform from CQC and we used LACChain Besu as the blockchain network.


title: Conservative Integrators for Many-body Problems

abstract: Conservative symmetric second-order one-step schemes are derived for dynamical systems describing various many-body systems using the Discrete Multiplier Method. This includes conservative schemes for the $n$-species Lotka-Volterra system, the $n$-body problem with radially symmetric potential and the $n$-point vortex models in the plane and on the sphere. In particular, we recover Greenspan-Labudde's conservative schemes for the $n$-body problem. Numerical experiments are shown verifying the conservative property of the schemes and second-order accuracy.


title: Stability of similarity solutions of viscous thread pinch-off

abstract: In this paper we compute the linear stability of similarity solutions of the breakup of viscous liquid threads, in which the viscosity and inertia of the liquid are in balance with the surface tension. The stability of the similarity solution is determined using numerical continuation to find the dominant eigenvalues. Stability of the first two solutions (those with largest minimum radius) is considered. We find that the first similarity solution, which is the one seen in experiments and simulations, is linearly stable with a complex nontrivial eigenvalue, which could explain the phenomenon of break-up producing sequences of small satellite droplets of decreasing radius near a main pinch-off point. The second solution is seen to be linearly unstable. These linear stability results compare favorably to numerical simulations for the stable similarity solution, while a profile starting near the unstable similarity solution is shown to very rapidly leave the linear regime.


title: The number of singular points of quartic surfaces (char=2)

abstract: We show that the maximal number of singular points of a normal quartic surface $X \subset \mathbb{P}^3_K$ defined over an algebraically closed field $K$ of characteristic $2$ is at most $20$, and that if equality is attained, then the minimal resolution of $X$ is a supersingular K3 surface and the singular points are $20$ nodes. We produce examples with 14 nodes. In a sequel to this paper (in two parts, the second in collaboration with Matthias Sch\"utt) we show that the optimal bound is indeed 14, and that if equality is attained, then the minimal resolution of $X$ is a supersingular K3 surface and the singular points are $14$ nodes. We also obtain some smaller upper bounds under several geometric assumptions holding at one of the singular points $P$ (structure of tangent cone, separability/inseparability of the projection with centre $P$).


title: Detecting and analysing wavelength-scale optical gradients at an interface by their effects on the internal reflectance near the critical angle

abstract: Light's internal reflectivity near a critical angle is very sensitive to the angle of incidence and the optical properties of the external medium near the interface. Novel applications in biology and medicine of subcritical internal reflection are being pursued. In many practical situations the refractive index of the external medium may vary with respect to its bulk value due to different physical phenomena at surfaces. Thus, there is a pressing need to understand the effects of a refractive-index gradient at a surface for near-critical-angle reflection. In this work we investigate theoretically the reflectivity near the critical angle at an interface with glass assuming the external medium has a continuous depth-dependent refractive index. We present graphs of the internal reflectivity as a function of the angle of incidence, which exhibit the effects of a refractive-index gradient at the interface. We analyse the behaviour of the reflectivity curves before total internal reflection is achieved. Our results provide insight into how one can recognise the existence of a refractive-index gradient at the interface and shed light on the viability of characterising it.


title: The Action of GT-Shadows on Child's Drawings

abstract: GT-shadows are tantalizing objects that can be thought of as approximations of elements of the mysterious Grothendieck-Teichmueller group $\widehat{GT}$ introduced by V. Drinfeld in 1990. GT-shadows form a groupoid GTSh whose objects are finite index subgroups of the pure braid group PB_4, that are normal in B_4. The goal of this paper is to describe the action of GT-shadows on Grothendieck's child's drawings and show that this action agrees with that of $\widehat{GT}$. We discuss the hierarchy of orbits of child's drawings with respect to the actions of GTSh, $\widehat{GT}$, and the absolute Galois group G_Q of rationals. We prove that the monodromy group and the passport of a child's drawing are invariant with respect to the action of the subgroupoid of charming GT-shadows. We use the action of GT-shadows on child's drawings to prove that every Abelian child's drawing admits a Belyi pair defined over rationals. Finally, we describe selected examples of non-Abelian child's drawings.


title: Spatially Scalable Lossy Coded Caching

abstract: We apply the coded caching scheme proposed by Maddah-Ali and Niesen to a multipoint multicasting video paradigm. Partially caching the video files on the wireless devices provides an opportunity to decrease data traffic load in peak hours via sending multicast coded messages to users. In this paper, we propose a two-hop wireless network for video multicasting, where the common coded multicast message is transmitted through different single antenna Edge Nodes (ENs) to multiple antenna users. Each user can decide to decode any EN by using a zero forcing receiver. Motivated by Scalable Video Coding (SVC), we consider successive refinement source coding in order to provide a ``softer'' tradeoff between the number of decoded ENs and the source distortion at each user receiver. The resulting coding scheme can be seen as the concatenation of Maddah-Ali and Niesen coded caching for each source-coded layer, and multiple description coding. Using stochastic geometry, we investigate the tradeoff between delivery time and per-user average source distortion. The proposed system is spatially scalable in the sense that, for given users' and ENs' spatial density, the achieved distortion-delivery time performance is independent of the coverage area (for in the limit of large area).


title: RF surface resistance tuning of superconducting niobium via thermal diffusion of native oxide

abstract: Recently, Nb superconducting radio frequency cavities vacuum heat treated between 300-400 C for a few hours have exhibited very high quality factors (~5x10^10 at 2.0 K). New secondary ion mass spectrometry measurements of O, N and C show this enhancement in RF surface conductivity is primarily associated with interstitial O alloying via dissolution and diffusion of the native oxide. We use a theory of oxide decomposition and O diffusion to quantify previously unknown parameters crucial in modeling this process. RF measurements of a vacuum heat treated Nb superconducting radio frequency cavity confirm the minimized surface resistance (higher Q0) previously expected only from 800 C diffusive alloying with N.


title: Molecular-Sized Outward-Swinging Gate: Experiment and Theoretical Analysis of a Locally Nonchaotic Barrier

abstract: We investigate the concept of molecular-sized outward-swinging gate, which allows for entropy decrease in an isolated system. The theoretical analysis, the Monte Carlo simulation, and the direct solution of governing equations all suggest that under the condition of local nonchaoticity, the probability of particle crossing is asymmetric. It is demonstrated by an experiment on a nanoporous membrane one-sidedly surface-grafted with bendable organic chains. Remarkably, through the membrane, gas spontaneously and repeatedly flows from the low-pressure side to the high-pressure side. While this phenomenon seems counterintuitive, it is compatible with the principle of maximum entropy. The locally nonchaotic gate interrupts the probability distribution of the local microstates, and imposes additional constraints on the global microstates, so that entropy reaches a nonequilibrium maximum. Such a mechanism is fundamentally different from Maxwell's demon and Feynman's ratchet, and is consistent with microscopic reversibility. It implies that useful work may be produced in a cycle from a single thermal reservoir. A generalized form of the second law of thermodynamics is proposed.


title: 1st Place Solution for YouTubeVOS Challenge 2021:Video Instance Segmentation

abstract: Video Instance Segmentation (VIS) is a multi-task problem performing detection, segmentation, and tracking simultaneously. Extended from image set applications, video data additionally induces the temporal information, which, if handled appropriately, is very useful to identify and predict object motions. In this work, we design a unified model to mutually learn these tasks. Specifically, we propose two modules, named Temporally Correlated Instance Segmentation (TCIS) and Bidirectional Tracking (BiTrack), to take the benefit of the temporal correlation between the object's instance masks across adjacent frames. On the other hand, video data is often redundant due to the frame's overlap. Our analysis shows that this problem is particularly severe for the YoutubeVOS-VIS2021 data. Therefore, we propose a Multi-Source Data (MSD) training mechanism to compensate for the data deficiency. By combining these techniques with a bag of tricks, the network performance is significantly boosted compared to the baseline, and outperforms other methods by a considerable margin on the YoutubeVOS-VIS 2019 and 2021 datasets.


title: Large-Scale Unsupervised Object Discovery

abstract: Existing approaches to unsupervised object discovery (UOD) do not scale up to large datasets without approximations that compromise their performance. We propose a novel formulation of UOD as a ranking problem, amenable to the arsenal of distributed methods available for eigenvalue problems and link analysis. Through the use of self-supervised features, we also demonstrate the first effective fully unsupervised pipeline for UOD. Extensive experiments on COCO and OpenImages show that, in the single-object discovery setting where a single prominent object is sought in each image, the proposed LOD (Large-scale Object Discovery) approach is on par with, or better than the state of the art for medium-scale datasets (up to 120K images), and over 37% better than the only other algorithms capable of scaling up to 1.7M images. In the multi-object discovery setting where multiple objects are sought in each image, the proposed LOD is over 14% better in average precision (AP) than all other methods for datasets ranging from 20K to 1.7M images. Using self-supervised features, we also show that the proposed method obtains state-of-the-art UOD performance on OpenImages. Our code is publicly available at https://github.com/huyvvo/LOD.


title: Thakurta metric does not describe a cosmological black hole

abstract: Recently, the Thakurta metric has been adopted as a model of primordial black holes. We show that the spacetime described by this metric has neither black-hole event horizon nor black-hole trapping horizon and involves the violation of all the standard energy conditions as a solution of the Einstein equation. Therefore, this metric does not describe a cosmological black hole in the early universe. It is pointed out that a contradictory claim by the other group stems from an incorrect choice of sign.


title: Lessons learned from hyper-parameter tuning for microservice candidate identification

abstract: When optimizing software for the cloud, monolithic applications need to be partitioned into many smaller *microservices*. While many tools have been proposed for this task, we warn that the evaluation of those approaches has been incomplete; e.g. minimal prior exploration of hyperparameter optimization. Using a set of open source Java EE applications, we show here that (a) such optimization can significantly improve microservice partitioning; and that (b) an open issue for future work is how to find which optimizer works best for different problems. To facilitate that future work, see [https://github.com/yrahul3910/ase-tuned-mono2micro](https://github.com/yrahul3910/ase-tuned-mono2micro) for a reproduction package for this research.


title: The Role of Localizable Concurrence in Quantum Teleportation Protocols

abstract: Teleporting an unknown qubit state is a paradigmatic quantum information processing task revealing the advantage of quantum communication protocols over their classical counterpart. For a teleportation protocol using a Bell state as quantum channel, the resource has been identified to be the concurrence. However, for mixed multi-partite states the lack of computable entanglement measures has made the identification of the quantum resource responsible for this advantage more challenging. Here, by building on previous results showing that localizable concurrence is the necessary resource for controlled quantum teleportation, we show that any teleportation protocol using an arbitrary multi-partite state, that includes a Bell measurement, requires a non-vanishing localizable concurrence between two of its parties in order to perform better than the classical protocol. By first analyzing the GHZ channel and GHZ measurement teleportation protocol, in the presence of GHZ-symmetric-preserving noise, we compare different multi-partite entanglement measures with the fidelity of teleportation, and we find that the protocol performs better than the classical protocol when all multi-partite entanglement measures vanish, except for the localizable concurrence. Finally, we extend our proof to an arbitrary teleportation protocol with an arbitrary multi-partite entangled channel.


title: Disrupting Model Training with Adversarial Shortcuts

abstract: When data is publicly released for human consumption, it is unclear how to prevent its unauthorized usage for machine learning purposes. Successful model training may be preventable with carefully designed dataset modifications, and we present a proof-of-concept approach for the image classification setting. We propose methods based on the notion of adversarial shortcuts, which encourage models to rely on non-robust signals rather than semantic features, and our experiments demonstrate that these measures successfully prevent deep learning models from achieving high accuracy on real, unmodified data examples.


title: Metrics for 3D Object Pointing and Manipulation in Virtual Reality

abstract: Assessing the performance of human movements during teleoperation and virtual reality is a challenging problem, particularly in 3D space due to complex spatial settings. Despite the presence of a multitude of metrics, a compelling standardized 3D metric is yet missing, aggravating inter-study comparability between different studies. Hence, evaluating human performance in virtual environments is a long-standing research goal, and a performance metric that combines two or more metrics under one formulation remains largely unexplored, particularly in higher dimensions. The absence of such a metric is primarily attributed to the discrepancies between pointing and manipulation, the complex spatial variables in 3D, and the combination of translational and rotational movements altogether. In this work, four experiments were designed and conducted with progressively higher spatial complexity to study and compare existing metrics thoroughly. The research goal was to quantify the difficulty of these 3D tasks and model human performance sufficiently in full 3D peripersonal space. Consequently, a new model extension has been proposed and its applicability has been validated across all the experimental results, showing improved modelling and representation of human performance in combined movements of 3D object pointing and manipulation tasks than existing work. Lastly, the implications on 3D interaction, teleoperation and object task design in virtual reality are discussed.


title: Beyond Mass: Detecting Secondary Halo Properties with Galaxy-Galaxy Lensing

abstract: Secondary halo properties beyond mass, such as the mass accretion rate (MAR), concentration, and the half mass scale, are essential in understanding the formation of large-scale structure and dark matter halos. In this paper, we study the impact of secondary halo properties on the galaxy-galaxy lensing observable, $\Delta\Sigma$. We build an emulator trained on N-body simulations to model $\Delta\Sigma$ and quantify the impact of different secondary parameters on the $\Delta\Sigma$ profile. We focus on the impact of MAR on $\Delta\Sigma$. We show that a 3$\sigma$ detection of variations in MAR at fixed halo mass could be achieved with the Hyper Suprime Cam survey in combination with a proxy for MAR with scatter $\sigma_{\Gamma_\mathrm{dyn}|\mathrm{obs}}<1.5$. We show that the full radial profile of $\Delta\Sigma$ depends on secondary properties at fixed halo mass. Consequently, an emulator that can perform full shape fitting yields better than 2 times improvement upon the constraints on MAR than only using the outer part of the halo. Finally, we highlight that miscentering and MAR impact the radial profile of $\Delta\Sigma$ in a similar fashion, implying that miscentering and MAR need to be modeled jointly for unbiased estimates of both effects. We show that present-day lensing data sets have the statistical capability to place constraints on halo MAR. Our analysis opens up new possibilities for observationally measuring the assembly history of the dark matter halos that host galaxies and clusters.


title: Provable Adaptation across Multiway Domains via Representation Learning

abstract: This paper studies zero-shot domain adaptation where each domain is indexed on a multi-dimensional array, and we only have data from a small subset of domains. Our goal is to produce predictors that perform well on \emph{unseen} domains. We propose a model which consists of a domain-invariant latent representation layer and a domain-specific linear prediction layer with a low-rank tensor structure. Theoretically, we present explicit sample complexity bounds to characterize the prediction error on unseen domains in terms of the number of domains with training data and the number of data per domain. To our knowledge, this is the first finite-sample guarantee for zero-shot domain adaptation. In addition, we provide experiments on two-way MNIST and four-way fiber sensing datasets to demonstrate the effectiveness of our proposed model.


title: Polymorphic Lambda Calculus with Context-Free Session Types

abstract: Context-free session types provide a typing discipline for recursive structured communication protocols on bidirectional channels. They overcome the restriction of regular session type systems to tail recursive protocols. This extension enables us to implement serialisation and deserialisation of tree structures in a fully type-safe manner. We present the theory underlying the language FreeST 2, which features context-free session types in an extension of System F with linear types and a kind system to distinguish message types and channel types. The system presents some metatheoretical challenges, which we address, contractivity in the presence of polymorphism, a non-trivial equational theory on types, and decidability of type equivalence. We also establish standard results on type preservation, progress, and a characterisation of erroneous processes.


title: Inherently high valley polarizations of momentum-forbidden dark excitons in transition-metal dichalcogenide monolayers

abstract: High degree of valley polarization of optically active excitons in transition-metal dichalcogenide monolayers (TMD-MLs) is vital in valley-based photonic applications but known to be likely spoiled by the intrinsic electron-hole exchange interactions. In this study, we present a theoretical investigation of the valley and optical properties of finite-momentum dark excitons in WSe$_2$-MLs by solving the density-functional-theory(DFT)-based Bethe-Salpeter equation (BSE) under the guidance of symmetry analysis. %We reveal that, in general, finite-momentum excitons are actually well immune from the exchange-induced valley depolarization, except for those with specific exciton momenta coincident with the $3\sigma_v$ and $3C_2'$ symmetries in the $D_{3h}$ point group of TMD-MLs. We reveal that, unlike the bright exciton inevitably subjected to electron-hole exchange interaction, inter-valley finite-momentum dark excitons in WSe$_2$-MLs are well immune from the exchange-induced valley depolarization and inherently highly valley-polarized under the enforcement of the crystal symmetries. More importantly, the superior valley polarizations of the inter-valley dark excitons in WSe$_2$-MLs are shown almost fully transferable to the optical polarization in the phonon-assisted photo-luminescences because of the native suppression of exchange-induced depolarization in the second-order optical processes. The analysis of phonon-assisted photo-luminescences accounts for the recently observed brightness, high degree of optical polarization and long lifetime of the inter-valley dark exciton states in tungsten-based TMD-MLs.


title: Least Squares Optimal Density Compensation for the Gridding Non-uniform Discrete Fourier Transform

abstract: The Gridding algorithm has shown great utility for reconstructing images from non-uniformly spaced samples in the Fourier domain in several imaging modalities. Due to the non-uniform spacing, some correction for the variable density of the samples must be made. Existing methods for generating density compensation values are either sub-optimal or only consider a finite set of points (a set of measure 0) in the optimization. This manuscript presents the first density compensation algorithm for a general trajectory that takes into account the point spread function over a set of non-zero measure. We show that the images reconstructed with Gridding using the density compensation values of this method are of superior quality when compared to density compensation weights determined in other ways. Results are shown with a numerical phantom and with magnetic resonance images of the abdomen and the knee.


title: Multi-kV class $\beta$-Ga$_2$O$_3$ MESFETs with a Lateral Figure of Merit up to 355 MW/cm$^2$

abstract: We demonstrate over 3 kV gate-pad-connected field plated (GPFP) $\beta$-Ga$_2$O$_3$ lateral MESFETs with high lateral figure of merit (LFOM) using metalorganic vapor phase epitaxy (MOVPE) grown channel layers and regrown ohmic contact layers. Using an improved low-temperature MOVPE selective area epitaxy process, we show that a total contact resistance to the channel as low as 1.4 $\Omega$.mm can be achieved.The GPFP design adopted here using PECVD (plasma-enhanced chemical vapor deposition) deposited SiN$_x$ dielectric and SiN$_x$/SiO$_2$ wrap-around passivation exhibits up to ~14% improved R$_{ON}$, up to ~70% improved breakdown voltage (V$_{BR}$ = V$_{DS}$ - V$_{GS}$) resulting in up to $\sim$3$\times$ higher LFOM compared to non-FP $\beta$-Ga$_2$O$_3$ lateral MESFETs. The V$_{BR}$ (~2.5 kV) and LFOM (355 MW/cm$^2$) measured simultaneously in our GPFP $\beta$-Ga$_2$O$_3$ lateral MESFET (with L$_{GD}$ = 10 $\mu$m) is the highest value achieved in any depletion-mode $\beta$-Ga$_2$O$_3$ lateral device.


title: Equivariant Networks for Pixelized Spheres

abstract: Pixelizations of Platonic solids such as the cube and icosahedron have been widely used to represent spherical data, from climate records to Cosmic Microwave Background maps. Platonic solids have well-known global symmetries. Once we pixelize each face of the solid, each face also possesses its own local symmetries in the form of Euclidean isometries. One way to combine these symmetries is through a hierarchy. However, this approach does not adequately model the interplay between the two levels of symmetry transformations. We show how to model this interplay using ideas from group theory, identify the equivariant linear maps, and introduce equivariant padding that respects these symmetries. Deep networks that use these maps as their building blocks generalize gauge equivariant CNNs on pixelized spheres. These deep networks achieve state-of-the-art results on semantic segmentation for climate data and omnidirectional image processing. Code is available at https://git.io/JGiZA.


title: TDGIA:Effective Injection Attacks on Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have achieved promising performance in various real-world applications. However, recent studies have shown that GNNs are vulnerable to adversarial attacks. In this paper, we study a recently-introduced realistic attack scenario on graphs -- graph injection attack (GIA). In the GIA scenario, the adversary is not able to modify the existing link structure and node attributes of the input graph, instead the attack is performed by injecting adversarial nodes into it. We present an analysis on the topological vulnerability of GNNs under GIA setting, based on which we propose the Topological Defective Graph Injection Attack (TDGIA) for effective injection attacks. TDGIA first introduces the topological defective edge selection strategy to choose the original nodes for connecting with the injected ones. It then designs the smooth feature optimization objective to generate the features for the injected nodes. Extensive experiments on large-scale datasets show that TDGIA can consistently and significantly outperform various attack baselines in attacking dozens of defense GNN models. Notably, the performance drop on target GNNs resultant from TDGIA is more than double the damage brought by the best attack solution among hundreds of submissions on KDD-CUP 2020.


title: Rapid COVID-19 Risk Screening by Eye-region Manifestations

abstract: It is still nontrivial to develop a new fast COVID-19 screening method with the easier access and lower cost, due to the technical and cost limitations of the current testing methods in the medical resource-poor districts. On the other hand, there are more and more ocular manifestations that have been reported in the COVID-19 patients as growing clinical evidence[1]. This inspired this project. We have conducted the joint clinical research since January 2021 at the ShiJiaZhuang City, Heibei province, China, which approved by the ethics committee of The fifth hospital of ShiJiaZhuang of Hebei Medical University. We undertake several blind tests of COVID-19 patients by Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China. Meantime as an important part of the ongoing globally COVID-19 eye test program by AIMOMICS since February 2020, we propose a new fast screening method of analyzing the eye-region images, captured by common CCD and CMOS cameras. This could reliably make a rapid risk screening of COVID-19 with the sustainable stable high performance in different countries and races. Our model for COVID-19 rapid prescreening have the merits of the lower cost, fully self-performed, non-invasive, importantly real-time, and thus enables the continuous health surveillance. We further implement it as the open accessible APIs, and provide public service to the world. Our pilot experiments show that our model is ready to be usable to all kinds of surveillance scenarios, such as infrared temperature measurement device at airports and stations, or directly pushing to the target people groups smartphones as a packaged application.


title: An Integration and Operation Framework of Geothermal Heat Pumps in Distribution Networks

abstract: The application of the energy-efficient thermal and energy management mechanism in Geothermal Heat Pumps (GHPs) is indispensable to reduce the overall energy consumption and carbon emission across the building sector. Besides, in the Virtual Power Plant (VPP) system, the demand response of clustered GHP systems can improve the operating flexibility of the power grid. This paper presents an integration and operation framework of GHPs in the distribution network, applying a layered communication and optimization method to coordinate multiple clustered GHPs in a community. In the proposed hierarchical operation scheme, the operator of regional GHPs collects the thermal zone information and the disturbance prediction of buildings in a short time granularity, predicts the energy demand, and transmits the information to an aggregator. Using a novel linearized optimal power flow model, the aggregator coordinates and aggregates load resources of GHP systems in the distribution network. In this way, GHP systems with thermal and energy management mechanisms can be applied to achieve the demand response in the VPP and offer more energy flexibility to the community.


title: Learnable Hypergraph Laplacian for Hypergraph Learning

abstract: Hypergraph Convolutional Neural Networks (HGCNNs) have demonstrated their potential in modeling high-order relations preserved in graph-structured data. However, most existing convolution filters are localized and determined by the pre-defined initial hypergraph topology, neglecting to explore implicit and long-range relations in real-world data. In this paper, we propose the first learning-based method tailored for constructing adaptive hypergraph structure, termed HypERgrAph Laplacian aDaptor (HERALD), which serves as a generic plug-and-play module for improving the representational power of HGCNNs.Specifically, HERALD adaptively optimizes the adjacency relationship between vertices and hyperedges in an end-to-end manner and thus the task-aware hypergraph is learned. Furthermore, HERALD employs the self-attention mechanism to capture the non-local paired-nodes relation. Extensive experiments on various popular hypergraph datasets for node classification and graph classification tasks demonstrate that our approach obtains consistent and considerable performance enhancement, proving its effectiveness and generalization ability.


title: CARTL: Cooperative Adversarially-Robust Transfer Learning

abstract: Transfer learning eases the burden of training a well-performed model from scratch, especially when training data is scarce and computation power is limited. In deep learning, a typical strategy for transfer learning is to freeze the early layers of a pre-trained model and fine-tune the rest of its layers on the target domain. Previous work focuses on the accuracy of the transferred model but neglects the transfer of adversarial robustness. In this work, we first show that transfer learning improves the accuracy on the target domain but degrades the inherited robustness of the target model. To address such a problem, we propose a novel cooperative adversarially-robust transfer learning (CARTL) by pre-training the model via feature distance minimization and fine-tuning the pre-trained model with non-expansive fine-tuning for target domain tasks. Empirical results show that CARTL improves the inherited robustness by about 28% at most compared with the baseline with the same degree of accuracy. Furthermore, we study the relationship between the batch normalization (BN) layers and the robustness in the context of transfer learning, and we reveal that freezing BN layers can further boost the robustness transfer.


title: Spherical CR uniformization of the magic 3-manifold

abstract: We show the 3-manifold at infinity of the complex hyperbolic triangle group $\Delta_{3,\infty,\infty;\infty}$ is the three-cusped "magic" 3-manifold $6_1^3$. We also show the 3-manifold at infinity of the complex hyperbolic triangle group $\Delta_{3,4,\infty;\infty}$ is the two-cusped 3-manifold $m295$ in the Snappy Census, which is a 3-manifold obtained by Dehn filling on one cusp of $6_1^3$. In particular, hyperbolic 3-manifolds $6_1^3$ and $m295$ admit spherical CR uniformizations. These results support our conjecture that the 3-manifold at infinity of the complex hyperbolic triangle group $\Delta_{3,n,m;\infty}$ is the one-cusped hyperbolic 3-manifold from the "magic" $6_1^3$ via Dehn fillings with filling slopes $(n-2)$ and $(m-2)$ on the first two cusps of it.


title: Spatial Bayesian GLM on the cortical surface produces reliable task activations in individuals and groups

abstract: The general linear model (GLM) is a widely popular and convenient tool for estimating the functional brain response and identifying areas of significant activation during a task or stimulus. However, the classical GLM is based on a massive univariate approach that does not explicitly leverage the similarity of activation patterns among neighboring brain locations. As a result, it tends to produce noisy estimates and be underpowered to detect significant activations, particularly in individual subjects and small groups. A recent alternative, a cortical surface-based spatial Bayesian GLM, leverages spatial dependencies among neighboring cortical vertices to produce more accurate estimates and areas of functional activation. The spatial Bayesian GLM can be applied to individual and group-level analysis. In this study, we assess the reliability and power of individual and group-average measures of task activation produced via the surface-based spatial Bayesian GLM. We analyze motor task data from 45 subjects in the Human Connectome Project (HCP) and HCP Retest datasets. We also extend the model to multi-run analysis and employ subject-specific cortical surfaces rather than surfaces inflated to a sphere for more accurate distance-based modeling. Results show that the surface-based spatial Bayesian GLM produces highly reliable activations in individual subjects and is powerful enough to detect trait-like functional topologies. Additionally, spatial Bayesian modeling enhances reliability of group-level analysis even in moderately sized samples (n=45). The power of the spatial Bayesian GLM to detect activations above a scientifically meaningful effect size is nearly invariant to sample size, exhibiting high power even in small samples (n=10). The spatial Bayesian GLM is computationally efficient in individuals and groups and is convenient to implement with the open-source BayesfMRI R package.


title: Rectifiability of the Singular Set of Harmonic Maps into Buildings

abstract: We prove that the singular set of an energy-minimizing map from Euclidean space into an $F$-connected complex is $(m-2)$-rectifiable. This strengthens the regularity result of Gromov and Schoen.


title: Cosmology of a polynomial model for de Sitter gauge theory sourced by a fluid

abstract: In the de Sitter gauge theory (DGT), the fundamental variables are the de Sitter (dS) connection and the gravitational Higgs/Goldstone field $\xi^A$. Previously, a model for DGT was analyzed, which generalizes the MacDowell--Mansouri gravity to have a variable cosmological constant $\Lambda=3/l^2$, where $l$ is related to $\xi^A$ by $\xi^A\xi_A=l^2$. It was shown that the model sourced by a perfect fluid does not support a radiation epoch and the accelerated expansion of the parity invariant universe. In this work, I consider a similar model, namely, the Stelle--West gravity, and couple it to a modified perfect fluid, such that the total Lagrangian 4-form is polynomial in the gravitational variables. The Lagrangian of the modified fluid has a nontrivial variational derivative with respect to $l$, and as a result, the problems encountered in the previous work no longer appear. Moreover, to explore the elegance of the general theory, as well as to write down the basic framework, I perform the Lagrange--Noether analysis for DGT sourced by a matter field, yielding the field equations and the identities with respect to the symmetries of the system. The resulted formula are dS covariant and do not rely on the existence of the metric field.


title: Structure-Regularized Attention for Deformable Object Representation

abstract: Capturing contextual dependencies has proven useful to improve the representational power of deep neural networks. Recent approaches that focus on modeling global context, such as self-attention and non-local operation, achieve this goal by enabling unconstrained pairwise interactions between elements. In this work, we consider learning representations for deformable objects which can benefit from context exploitation by modeling the structural dependencies that the data intrinsically possesses. To this end, we provide a novel structure-regularized attention mechanism, which formalizes feature interaction as structural factorization through the use of a pair of light-weight operations. The instantiated building blocks can be directly incorporated into modern convolutional neural networks, to boost the representational power in an efficient manner. Comprehensive studies on multiple tasks and empirical comparisons with modern attention mechanisms demonstrate the gains brought by our method in terms of both performance and model complexity. We further investigate its effect on feature representations, showing that our trained models can capture diversified representations characterizing object parts without resorting to extra supervision.


title: Study of sampling methods in sentiment analysis of imbalanced data

abstract: This work investigates the application of sampling methods for sentiment analysis on two different highly imbalanced datasets. One dataset contains online user reviews from the cooking platform Epicurious and the other contains comments given to the Planned Parenthood organization. In both these datasets, the classes of interest are rare. Word n-grams were used as features from these datasets. A feature selection technique based on information gain is first applied to reduce the number of features to a manageable space. A number of different sampling methods were then applied to mitigate the class imbalance problem which are then analyzed.


title: A Study of the New Zealand Mathematics Curriculum

abstract: Given the profound and uncritiqued changes that have been implemented in Aotearoa New Zealand education since the 1990s, this paper provides a critical commentary on the characterising features of the New Zealand mathematics' curriculum in the context of the first stage of a study. The emphasis is on the importance of research design that begins with an explicit, evidence-based hypothesis. To that end, we describe evidence that informs and identifies the study's hypothesised problem and causes. The study itself will show whether or not the hypothesis is justified; that is, is the absence of standardised prescribed content in New Zealand mathematics' curriculum the reason for the country's declining mathematics rankings? The study aims to increase understanding in the field of mathematics education by exploring the effects on New Zealand year 7 public school teachers' mathematics curriculum selection and design practices, teaching practices, and subsequently student achievement.


title: Hawking-Page Phase Transition of the four-dimensional de-Sitter Spacetime with non-linear source

abstract: The interplay between a dS black hole and cosmological horizons introduces distinctive thermodynamic behavior in a dS spacetime (for example the well-known upper bounds of mass and entropy in Class. Quant. Grav. 37 (2020) 5). Based on this point, we present the Hawking-Page (HP) phase transition of the four-dimensional dS spacetime with non-linear charge correction when the effective pressure is fixed, and analyze the effects of different effective pressures and non-linear charge corrections on HP phase transition. The evolution of this dS spacetime undergoing the HP phase transition is also investigated. We find that the existent curve of HP phase transition is a closed one with two different branches. That means there exist the upper bounds of the HP temperature and HP pressure, which is completely distinguished with that in AdS spacetime. And with the decreasing of the distance between two horizons, the dS spacetime at the coexistent curve of HP phase transition is going along with different branches. Furthermore we also explore the influence of charge and non-linear charge correction on the coexistent curve.


title: Semi-supervised Active Regression

abstract: Labelled data often comes at a high cost as it may require recruiting human labelers or running costly experiments. At the same time, in many practical scenarios, one already has access to a partially labelled, potentially biased dataset that can help with the learning task at hand. Motivated by such settings, we formally initiate a study of $semi-supervised$ $active$ $learning$ through the frame of linear regression. In this setting, the learner has access to a dataset $X \in \mathbb{R}^{(n_1+n_2) \times d}$ which is composed of $n_1$ unlabelled examples that an algorithm can actively query, and $n_2$ examples labelled a-priori. Concretely, denoting the true labels by $Y \in \mathbb{R}^{n_1 + n_2}$, the learner's objective is to find $\widehat{\beta} \in \mathbb{R}^d$ such that, \begin{equation} \| X \widehat{\beta} - Y \|_2^2 \le (1 + \epsilon) \min_{\beta \in \mathbb{R}^d} \| X \beta - Y \|_2^2 \end{equation} while making as few additional label queries as possible. In order to bound the label queries, we introduce an instance dependent parameter called the reduced rank, denoted by $R_X$, and propose an efficient algorithm with query complexity $O(R_X/\epsilon)$. This result directly implies improved upper bounds for two important special cases: (i) active ridge regression, and (ii) active kernel ridge regression, where the reduced-rank equates to the statistical dimension, $sd_\lambda$ and effective dimension, $d_\lambda$ of the problem respectively, where $\lambda \ge 0$ denotes the regularization parameter. For active ridge regression we also prove a matching lower bound of $O(sd_\lambda / \epsilon)$ on the query complexity of any algorithm. This subsumes prior work that only considered the unregularized case, i.e., $\lambda = 0$.


title: Examining Passenger Vehicle Miles Traveled and Carbon Emissions in the Boston Metropolitan Area

abstract: With spatial analytic, econometric, and visualization tools, this book chapter investigates greenhouse gas emissions for the on-road passenger vehicle transport sector in the Boston metropolitan area in 2014. It compares greenhouse gas emission estimations from both the production-based and consumption-based perspectives with two large-scale administrative datasets: the vehicle odometer readings from individual vehicle annual inspection, and the road inventory data containing road segment level geospatial and traffic information. Based on spatial econometric models that examine socioeconomic and built environment factors contributing to the vehicle miles traveled at the census tract level, it offers insights to help cities reduce VMT and carbon footprint for passenger vehicle travel. Finally, it recommends a pathway for cities and towns in the Boston metropolitan area to curb VMT and mitigate carbon emissions to achieve climate goals of carbon neutrality.


title: iThing: Designing Next-Generation Things with Battery Health Self-Monitoring Capabilities for Sustainable IoT in Smart Cities

abstract: An accurate and reliable technique for predicting Remaining Useful Life (RUL) for battery cells proves helpful in battery-operated IoT devices, especially in remotely operated sensor nodes. Data-driven methods have proved to be the most effective methods until now. These IoT devices have low computational capabilities to save costs, but Data-Driven battery health techniques often require a comparatively large amount of computational power to predict SOH and RUL due to most methods being feature-heavy. This issue calls for ways to predict RUL with the least amount of calculations and memory. This paper proposes an effective and novel peak extraction method to reduce computation and memory needs and provide accurate prediction methods using the least number of features while performing all calculations on-board. The model can self-sustain, requires minimal external interference, and hence operate remotely much longer. Experimental results prove the accuracy and reliability of this method. The Absolute Error (AE), Relative error (RE), and Root Mean Square Error (RMSE) are calculated to compare effectiveness. The training of the GPR model takes less than 2 seconds, and the correlation between SOH from peak extraction and RUL is 0.97.


title: Periodic Infinite Frieze Patterns of Type $\Lambda_{p_1,\ldots,p_n}$ and Dissections on Annuli

abstract: Finite frieze patterns with entries in $\mathbb{Z}[\lambda_{p_1},\ldots,\lambda_{p_s}]$ where $\{p_1,\ldots,p_s\} \subseteq \mathbb{Z}_{\geq 3}$ and $\lambda_p = 2 \cos(\pi/p)$ were shown to have a connection to dissected polygons by Holm and Jorgensen. We extend their work by studying the connection between infinite frieze patterns with such entries and dissections of annuli and once-punctured discs. We give an algorithm to determine whether a frieze pattern with entries in $\mathbb{Z}[\lambda_{p_1},\ldots,\lambda_{p_s}]$, finite or infinite, comes from a dissected surface. We introduce quotient dissections as a realization for some frieze patterns unrealizable by an ordinary dissection. We also introduce two combinatorial interpretations for entries of frieze patterns from dissected surfaces. These interpretations are a generalization of matchings introduced by Broline, Crowe, and Isaacs for finite frieze patterns over $\mathbb{Z}$.


title: Markov Decision Processes with Long-Term Average Constraints

abstract: We consider the problem of constrained Markov Decision Process (CMDP) where an agent interacts with a unichain Markov Decision Process. At every interaction, the agent obtains a reward. Further, there are $K$ cost functions. The agent aims to maximize the long-term average reward while simultaneously keeping the $K$ long-term average costs lower than a certain threshold. In this paper, we propose CMDP-PSRL, a posterior sampling based algorithm using which the agent can learn optimal policies to interact with the CMDP. Further, for MDP with $S$ states, $A$ actions, and diameter $D$, we prove that following CMDP-PSRL algorithm, the agent can bound the regret of not accumulating rewards from optimal policy by $\Tilde{O}(poly(DSA)\sqrt{T})$. Further, we show that the violations for any of the $K$ constraints is also bounded by $\Tilde{O}(poly(DSA)\sqrt{T})$. To the best of our knowledge, this is the first work which obtains a $\Tilde{O}(\sqrt{T})$ regret bounds for ergodic MDPs with long-term average constraints.


title: Verification of a Fully Implicit Particle-in-Cell Method for the $v_\parallel$ Formalism of Electromagnetic Gyrokinetics in the XGC Code

abstract: A fully implicit particle-in-cell method for handling the $v_\parallel$-formalism of electromagnetic gyrokinetics has been implemented in XGC. By choosing the $v_\parallel$-formalism, we avoid introducing the non-physical skin terms in Amp\`{e}re's law, which are responsible for the well-known ``cancellation problem" in the $p_\parallel$-formalism. The $v_\parallel$-formalism, however, is known to suffer from a numerical instability when explicit time integration schemes are used due to the appearance of a time derivative in the particle equations of motion from the inductive component of the electric field. Here, using the conventional $\delta f$ scheme, we demonstrate that our implicitly discretized algorithm can provide numerically stable simulation results with accurate dispersive properties. We verify the algorithm using a test case for shear Alfv\'{e}n wave propagation in addition to a case demonstrating the ITG-KBM transition. The ITG-KBM transition case is compared to results obtained from other $\delta f$ gyrokinetic codes/schemes, whose verification has already been archived in the literature.


title: Solving PDEs on Unknown Manifolds with Machine Learning

abstract: This paper proposes a mesh-free computational framework and machine learning theory for solving elliptic PDEs on unknown manifolds, identified with point clouds, based on diffusion maps (DM) and deep learning. The PDE solver is formulated as a supervised learning task to solve a least-squares regression problem that imposes an algebraic equation approximating a PDE (and boundary conditions if applicable). This algebraic equation involves a graph-Laplacian type matrix obtained via DM asymptotic expansion, which is a consistent estimator of second-order elliptic differential operators. The resulting numerical method is to solve a highly non-convex empirical risk minimization problem subjected to a solution from a hypothesis space of neural networks (NNs). In a well-posed elliptic PDE setting, when the hypothesis space consists of neural networks with either infinite width or depth, we show that the global minimizer of the empirical loss function is a consistent solution in the limit of large training data. When the hypothesis space is a two-layer neural network, we show that for a sufficiently large width, gradient descent can identify a global minimizer of the empirical loss function. Supporting numerical examples demonstrate the convergence of the solutions, ranging from simple manifolds with low and high co-dimensions, to rough surfaces with and without boundaries. We also show that the proposed NN solver can robustly generalize the PDE solution on new data points with generalization errors that are almost identical to the training errors, superseding a Nystrom-based interpolation method.


title: Assessing Multilingual Fairness in Pre-trained Multimodal Representations

abstract: Recently pre-trained multimodal models, such as CLIP, have shown exceptional capabilities towards connecting images and natural language. The textual representations in English can be desirably transferred to multilingualism and support downstream multimodal tasks for different languages. Nevertheless, the principle of multilingual fairness is rarely scrutinized: do multilingual multimodal models treat languages equally? Are their performances biased towards particular languages? To answer these questions, we view language as the fairness recipient and introduce two new fairness notions, multilingual individual fairness and multilingual group fairness, for pre-trained multimodal models. Multilingual individual fairness requires that text snippets expressing similar semantics in different languages connect similarly to images, while multilingual group fairness requires equalized predictive performance across languages. We characterize the extent to which pre-trained multilingual vision-and-language representations are individually fair across languages. However, extensive experiments demonstrate that multilingual representations do not satisfy group fairness: (1) there is a severe multilingual accuracy disparity issue; (2) the errors exhibit biases across languages conditioning the group of people in the images, including race, gender and age.


title: Multistream ValidNet: Improving 6D Object Pose Estimation by Automatic Multistream Validation

abstract: This work presents a novel approach to improve the results of pose estimation by detecting and distinguishing between the occurrence of True and False Positive results. It achieves this by training a binary classifier on the output of an arbitrary pose estimation algorithm, and returns a binary label indicating the validity of the result. We demonstrate that our approach improves upon a state-of-the-art pose estimation result on the Sil\'eane dataset, outperforming a variation of the alternative CullNet method by 4.15% in average class accuracy and 0.73% in overall accuracy at validation. Applying our method can also improve the pose estimation average precision results of Op-Net by 6.06% on average.


title: Adversarial Robustness via Fisher-Rao Regularization

abstract: Adversarial robustness has become a topic of growing interest in machine learning since it was observed that neural networks tend to be brittle. We propose an information-geometric formulation of adversarial defense and introduce FIRE, a new Fisher-Rao regularization for the categorical cross-entropy loss, which is based on the geodesic distance between the softmax outputs corresponding to natural and perturbed input features. Based on the information-geometric properties of the class of softmax distributions, we derive an explicit characterization of the Fisher-Rao Distance (FRD) for the binary and multiclass cases, and draw some interesting properties as well as connections with standard regularization metrics. Furthermore, for a simple linear and Gaussian model, we show that all Pareto-optimal points in the accuracy-robustness region can be reached by FIRE while other state-of-the-art methods fail. Empirically, we evaluate the performance of various classifiers trained with the proposed loss on standard datasets, showing up to a simultaneous 1\% of improvement in terms of clean and robust performances while reducing the training time by 20\% over the best-performing methods.


title: Systematic KMTNet Planetary Anomaly Search, Paper II: Six New $q<2\times 10^{-4}$ Mass-ratio Planets

abstract: We apply the automated AnomalyFinder algorithm of Paper I (Zang et al. 2021b) to 2018-2019 light curves from the $\simeq 13\,{\rm deg}^2$ covered by the six KMTNet prime fields, with cadences $\Gamma \geq 2\,{\rm hr}^{-1}$. We find a total of 11 planets with mass ratios $q<2\times 10^{-4}$, including six newly discovered planets, one planet that was reported in Paper I, and recovery of four previously discovered planets. One of the new planets, OGLE-2018-BLG-0977Lb, is in a planetary-caustic event, while the other five (OGLE-2018-BLG-0506Lb, OGLE-2018-BLG-0516Lb, OGLE-2019-BLG-1492Lb, KMT-2019-BLG-0253, and KMT-2019-BLG-0953) are revealed by a "dip" in the light curve as the source crosses the host-planet axis on the opposite side of the planet. These subtle signals were missed in previous by-eye searches. The planet-host separations (scaled to the Einstein radius), $s$, and planet-host mass ratios, $q$, are, respectively, $(s,q\times 10^5) = (0.88, 4.1)$, $(0.96\pm 0.10, 8.3)$, $(0.94\pm 0.07, 13)$, $(0.97\pm 0.07, 18)$, $(0.97\pm0.04,4.1)$, and $(0.74,18)$, where the "$\pm$" indicates a discrete degeneracy. The 11 planets are spread out over the range $-5<\log q < -3.7$. Together with the two planets previously reported with $q\sim 10^{-5}$ from the 2018-2019 non-prime KMT fields, this result suggests that planets toward the bottom of this mass-ratio range may be more common than previously believed.


title: Stiffening of matter in quark-hadron continuity

abstract: We discuss stiffening of matter in quark-hadron continuity. We introduce a model that relates quark wave functions in a baryon and the occupation probability of states for baryons and quarks in dense matter. In a dilute regime, the confined quarks contribute to the energy density through the masses of baryons, but do not directly contribute to the pressure; hence, the equations of state are very soft. This dilute regime continues until the low momentum states for quarks get saturated; this may happen even before baryons fully overlap, possibly at density slightly above the nuclear saturation density. After the saturation the pressure grows rapidly while changes in energy density are modest, producing a peak in the speed of sound. If we use baryonic descriptions for quark distributions near the Fermi surface, we reach a description similar to the quarkyonic matter model of McLerran and Reddy. With a simple adjustment of quark interactions to get the nucleon mass, our model becomes consistent with the constraints from 1.4-solar mass neutron stars, but the high density part is too soft to account for two-solar mass neutron stars. We delineate the relation between the saturation effects and short range interactions of quarks, suggesting interactions that leave low density equations of state unchanged but stiffen the high density part.


title: BRAIN2DEPTH: Lightweight CNN Model for Classification of Cognitive States from EEG Recordings

abstract: Several Convolutional Deep Learning models have been proposed to classify the cognitive states utilizing several neuro-imaging domains. These models have achieved significant results, but they are heavily designed with millions of parameters, which increases train and test time, making the model complex and less suitable for real-time analysis. This paper proposes a simple, lightweight CNN model to classify cognitive states from Electroencephalograph (EEG) recordings. We develop a novel pipeline to learn distinct cognitive representation consisting of two stages. The first stage is to generate the 2D spectral images from neural time series signals in a particular frequency band. Images are generated to preserve the relationship between the neighboring electrodes and the spectral property of the cognitive events. The second is to develop a time-efficient, computationally less loaded, and high-performing model. We design a network containing 4 blocks and major components include standard and depth-wise convolution for increasing the performance and followed by separable convolution to decrease the number of parameters which maintains the tradeoff between time and performance. We experiment on open access EEG meditation dataset comprising expert, nonexpert meditative, and control states. We compare performance with six commonly used machine learning classifiers and four state of the art deep learning models. We attain comparable performance utilizing less than 4\% of the parameters of other models. This model can be employed in a real-time computation environment such as neurofeedback.


title: Neural Combinatory Constituency Parsing

abstract: We propose two fast neural combinatory models for constituency parsing: binary and multi-branching. Our models decompose the bottom-up parsing process into 1) classification of tags, labels, and binary orientations or chunks and 2) vector composition based on the computed orientations or chunks. These models have theoretical sub-quadratic complexity and empirical linear complexity. The binary model achieves an F1 score of 92.54 on Penn Treebank, speeding at 1327.2 sents/sec. Both the models with XLNet provide near state-of-the-art accuracies for English. Syntactic branching tendency and headedness of a language are observed during the training and inference processes for Penn Treebank, Chinese Treebank, and Keyaki Treebank (Japanese).


title: ASASSN-14ms:the Most Energetic Known Explosion of a Type Ibn Supernova and its Physical Origin

abstract: ASASSN-14ms may represent the most luminous Type Ibn supernova (SN~Ibn) ever detected, with an absolute U-band magnitude brighter than -22.0 mag and a total bolometric luminosity >1.0x10^{44} erg/s near maximum light. The early-time spectra of this SN are characterized by a blue continuum on which are superimposed narrow P~Cygni profile lines of He I, suggesting the presence of slowly moving (~1000 km/s), He-rich circumstellar material (CSM). At 1--2 months after maximum brightness, the He I line profiles become only slightly broader, with blueshifted velocities of 2000--3000 km/s, consistent with the CSM shell being continuously accelerated by the SN light and ejecta. Like most SNe~Ibn, the light curves of ASASSN-14ms show rapid post-peak evolution, dropping by ~7 mag in the V band over three months. Such a rapid post-peak decline and high luminosity can be explained with interaction between SN ejecta and helium-rich CSM of 0.9~M_{\odot} at a distance of~10^{15} cm. The CSM around ASASSN-14ms is estimated to originate from a pre-explosion event with a mass-loss rate of 6.7~M_\odot /yr (assuming a velocity of ~1000 km/s), which is consistent with abundant He-rich material violently ejected during the late Wolf-Rayet (WN9-11 or Opfe) stage. After examining the light curves for a sample of SNe~Ibn, we find that the more luminous ones tend to have slower post-peak decline rates, reflecting that the observed differences may arise primarily from discrepancies in the CSM distribution around the massive progenitors.


title: Doubly Non-Central Beta Matrix Factorization for DNA Methylation Data

abstract: We present a new non-negative matrix factorization model for $(0,1)$ bounded-support data based on the doubly non-central beta (DNCB) distribution, a generalization of the beta distribution. The expressiveness of the DNCB distribution is particularly useful for modeling DNA methylation datasets, which are typically highly dispersed and multi-modal; however, the model structure is sufficiently general that it can be adapted to many other domains where latent representations of $(0,1)$ bounded-support data are of interest. Although the DNCB distribution lacks a closed-form conjugate prior, several augmentations let us derive an efficient posterior inference algorithm composed entirely of analytic updates. Our model improves out-of-sample predictive performance on both real and synthetic DNA methylation datasets over state-of-the-art methods in bioinformatics. In addition, our model yields meaningful latent representations that accord with existing biological knowledge.


title: Delay Analysis of Base Station Flow Table in SDN-enabled Radio Access Networks

abstract: Future generation wireless networks are designed with extremely low delay requirements which makes even small contributed delays important. On the other hand, software defined networking (SDN) has been introduced as a key enabler of future wireless and cellular networks in order to make them more flexible. In SDN, a central controller manages all network equipments by setting the match-action pairs in flow tables of the devices. However, these flow tables have limited capacity and thus are not capable of storing the rules of all the users. In this paper, we consider an SDN-enabled base station (SD-BS) in a cell equipped with a limited capacity flow table. We analyze the expected delay incurred in processing of the incoming packets to the SD-BS and present a mathematical expression for it in terms of density of the users and cell area.


title: Riesz and pre-Riesz monoids

abstract: Call a directed partially ordered cancellative divisibility monoid $M$ a Riesz monoid if for all $x,y_{1},y_{2}\geq 0$ in $M,$ $x\leq y_{1}+y_{2}\Rightarrow x=x_{1}+x_{2}$ where $0\leq x_{i}\leq y_{i}$. We explore the necessary and sufficient conditions under which a Riesz monoid $% M $ with $M^{+}=\{x\geq 0|x\in M\}=M$ generates a Riesz group and indicate some applications. We call a directed p.o. monoid $M$ $\Pi $-pre-Riesz if $% M^{+}=M$ and for all $x_{1},x_{2},...,x_{n}\in M$, $% glb(x_{1},x_{2},...,x_{n})=0$ or there is $r\in \Pi $ such that $0<r\leq x_{1},x_{2},...,x_{n},$ for some subset $\Pi $ of $M.$ We explore examples of $\Pi $-pre-Riesz monoids of $\star $-ideals of different types. We show for instance that if $M$ is the monoid of nonzero (integral) ideals of a Noetherian domain $D$ and $\Pi $ the set of invertible ideals, $M$ is $\Pi $ -pre-Riesz if and only $D$ is a Dedekind domain. We also study factorization in pre-Riesz monoids of a certain type and link it with factorization theory of ideals in an integral domain.


title: Reverse-engineer the Distributional Structure of Infant Egocentric Views for Training Generalizable Image Classifiers

abstract: We analyze egocentric views of attended objects from infants. This paper shows 1) empirical evidence that children's egocentric views have more diverse distributions compared to adults' views, 2) we can computationally simulate the infants' distribution, and 3) the distribution is beneficial for training more generalized image classifiers not only for infant egocentric vision but for third-person computer vision.


title: SKIing on Simplices: Kernel Interpolation on the Permutohedral Lattice for Scalable Gaussian Processes

abstract: State-of-the-art methods for scalable Gaussian processes use iterative algorithms, requiring fast matrix vector multiplies (MVMs) with the covariance kernel. The Structured Kernel Interpolation (SKI) framework accelerates these MVMs by performing efficient MVMs on a grid and interpolating back to the original space. In this work, we develop a connection between SKI and the permutohedral lattice used for high-dimensional fast bilateral filtering. Using a sparse simplicial grid instead of a dense rectangular one, we can perform GP inference exponentially faster in the dimension than SKI. Our approach, Simplex-GP, enables scaling SKI to high dimensions, while maintaining strong predictive performance. We additionally provide a CUDA implementation of Simplex-GP, which enables significant GPU acceleration of MVM based inference.


title: Gravitational lensing by an extended mass distribution

abstract: We continue our investigation of the optical properties of the solar gravitational lens (SGL). We treat the Sun as an extended axisymmetric body and model its gravitational field using zonal harmonics. We consider a point source that is positioned at a large but finite distance from the Sun and, using our new angular eikonal method, we established the electro-magnetic (EM) field on the image plane in the focal region behind the SGL and derive the SGL's impulse response in the form of its point-spread function (PSF). The expression that we derive describes the extended Sun in all regions of interest, including the regions of strong and weak interference and the region of geometric optics. The result is in the form of a single integral with respect to the azimuthal angle of the impact parameter, covering all lensing regimes of the SGL. The same expression can be used to describe gravitational lensing by a compact axisymmetric mass distribution, characterized by small deviations from spherical symmetry. It is valid in all lensing regimes. We also derive results that describe the intensity of light observed by an imaging telescope in the focal region. We present results of numerical simulations showing the view by a telescope that moves in the image plane toward the optical axis. We consider imaging of both point and extended sources. We show that while point sources yield a number of distinct images consistent with the caustics due to zonal harmonics of a particular order (e.g., Einstein cross), extended sources always result in the formation of an Einstein ring. These results represent the most comprehensive wave-theoretical treatment of gravitational lensing in the weak gravitational field of a compact axisymmetric gravitating object.


title: Explaining the Deep Natural Language Processing by Mining Textual Interpretable Features

abstract: Despite the high accuracy offered by state-of-the-art deep natural-language models (e.g. LSTM, BERT), their application in real-life settings is still widely limited, as they behave like a black-box to the end-user. Hence, explainability is rapidly becoming a fundamental requirement of future-generation data-driven systems based on deep-learning approaches. Several attempts to fulfill the existing gap between accuracy and interpretability have been done. However, robust and specialized xAI (Explainable Artificial Intelligence) solutions tailored to deep natural-language models are still missing. We propose a new framework, named T-EBAnO, which provides innovative prediction-local and class-based model-global explanation strategies tailored to black-box deep natural-language models. Given a deep NLP model and the textual input data, T-EBAnO provides an objective, human-readable, domain-specific assessment of the reasons behind the automatic decision-making process. Specifically, the framework extracts sets of interpretable features mining the inner knowledge of the model. Then, it quantifies the influence of each feature during the prediction process by exploiting the novel normalized Perturbation Influence Relation index at the local level and the novel Global Absolute Influence and Global Relative Influence indexes at the global level. The effectiveness and the quality of the local and global explanations obtained with T-EBAnO are proved on (i) a sentiment analysis task performed by a fine-tuned BERT model, and (ii) a toxic comment classification task performed by an LSTM model.