title: Conventional Half-Heusler Alloys Advance State-of-the-Art Thermoelectric Properties

abstract: Half-Heusler (HH) phases have garnered much attention as thermally stable and non-toxic thermoelectric materials for power conversion. The most studied alloys to date utilize Hf, Zr, and Ti as the base components. These alloys can achieve a moderate dimensionless figure of merit, ZT, near 1. Recent studies have advanced the thermoelectric performance of HH alloys by employing nanostructures and novel compositions to achieve larger ZT, reaching as high as 1.5. Herein, we report that traditional alloying techniques applied to the conventional HfZr-based half-Heusler alloys can also lead to exceptional ZT. Specifically, we present the well-studied p-type Hf0.3Zr0.7CoSn0.3Sb0.7, previously reported to have a ZT~0.8, resonantly doped with less than 1 at. % metallic Al on the Sn/Sb site, touting a remarkable ZT near 1.5 at 980 K. This is achieved through a significant increase in power factor, by ~65%, and a notable but smaller decrease in thermal conductivity, by ~13%, at high temperatures. These favorable thermoelectric properties are discussed in terms of a local anomaly in the density of states near the Fermi energy designed to enhance the Seebeck coefficient, as revealed by first-principles calculations, as well as the emergence of a highly heterogeneous grain structure that can scatter phonons across different length scales, effectively suppressing the thermal conductivity. Consequently, the effective mass is significantly enhanced from ~ 7 to 10me within a single parabolic band model, consistent with the result from first-principles calculations. The discovery of high ZT in a commonly studied half-Heusler alloy through a conventional and non-complex approach opens a new path for further discoveries in similar types of alloys. Furthermore, it is reasonable to believe that the study will reinvigorate effort in exploring high thermoelectric performance in conventional alloy systems.


title: Pointly-Supervised Panoptic Segmentation

abstract: In this paper, we propose a new approach to applying point-level annotations for weakly-supervised panoptic segmentation. Instead of the dense pixel-level labels used by fully supervised methods, point-level labels only provide a single point for each target as supervision, significantly reducing the annotation burden. We formulate the problem in an end-to-end framework by simultaneously generating panoptic pseudo-masks from point-level labels and learning from them. To tackle the core challenge, i.e., panoptic pseudo-mask generation, we propose a principled approach to parsing pixels by minimizing pixel-to-point traversing costs, which model semantic similarity, low-level texture cues, and high-level manifold knowledge to discriminate panoptic targets. We conduct experiments on the Pascal VOC and the MS COCO datasets to demonstrate the approach's effectiveness and show state-of-the-art performance in the weakly-supervised panoptic segmentation problem. Codes are available at https://github.com/BraveGroup/PSPS.git.


title: Engineered Kondo screening and nonzero Berry phase in SrTiO3/LaTiO3/SrTiO3 heterostructures

abstract: Controlling the interplay between localized spins and itinerant electrons at the oxide interfaces can lead to exotic magnetic states. Here we devise SrTiO3/LaTiO3/SrTiO3 heterostructures with varied thickness of the LaTiO3 layer (n monolayers) to investigate the magnetic interactions in the two-dimensional electron gas system. The heterostructures exhibit significant Kondo effect when the LaTiO3 layer is rather thin (n = 2, 10), manifesting the strong interaction between the itinerant electrons and the localized magnetic moments at the interfaces, while the Kondo effect is greatly inhibited when n = 20. Notably, distinct Shubnikov-de Haas oscillations are observed and a nonzero Berry phase of {\pi} is extracted when the LaTiO3 layer is rather thin (n = 2, 10), which is absent in the heterostructure with thicker LaTiO3 layer (n = 20). The observed phenomena are consistently interpreted as a result of sub-band splitting and symmetry breaking due to the interplay between the interfacial Rashba spin-orbit coupling and the magnetic orderings in the heterostructures. Our findings provide a route for exploring and manipulating nontrivial electronic band structures at complex oxide interfaces.


title: KnowGL: Knowledge Generation and Linking from Text

abstract: We propose KnowGL, a tool that allows converting text into structured relational data represented as a set of ABox assertions compliant with the TBox of a given Knowledge Graph (KG), such as Wikidata. We address this problem as a sequence generation task by leveraging pre-trained sequence-to-sequence language models, e.g. BART. Given a sentence, we fine-tune such models to detect pairs of entity mentions and jointly generate a set of facts consisting of the full set of semantic annotations for a KG, such as entity labels, entity types, and their relationships. To showcase the capabilities of our tool, we build a web application consisting of a set of UI widgets that help users to navigate through the semantic data extracted from a given input text. We make the KnowGL model available at https://huggingface.co/ibm/knowgl-large.


title: First-order friendliness

abstract: In this note we study a counterpart in predicate logic of the notion of 'logical friendliness', introduced into propositional logic in Makinson (2007). The result is a new consequence relation for predicate languages using first-order models. Although compactness and interpolation fail dramatically, other properties are preserved from the propositional case.


title: I Prefer not to Say: Protecting User Consent in Models with Optional Personal Data

abstract: We examine machine learning models in a setup where individuals have the choice to share optional personal information with a decision-making system, as seen in modern insurance pricing models. Some users consent to their data being used whereas others object and keep their data undisclosed. In this work, we show that the decision not to share data can be considered as information in itself that should be protected to respect users' privacy. This observation raises the overlooked problem of how to ensure that users who protect their personal data do not suffer any disadvantages as a result. To address this problem, we formalize protection requirements for models which only use the information for which active user consent was obtained. This excludes implicit information contained in the decision to share data or not. We offer the first solution to this problem by proposing the notion of Protected User Consent (PUC), which we prove to be loss-optimal under our protection requirement. We observe that privacy and performance are not fundamentally at odds with each other and that it is possible for a decision maker to benefit from additional data while respecting users' consent. To learn PUC-compliant models, we devise a model-agnostic data augmentation strategy with finite sample convergence guarantees. Finally, we analyze the implications of PUC on challenging real datasets, tasks, and models.


title: General framework for E(3)-equivariant neural network representation of density functional theory Hamiltonian

abstract: Combination of deep learning and ab initio calculation has shown great promise in revolutionizing future scientific research, but how to design neural network models incorporating a priori knowledge and symmetry requirements is a key challenging subject. Here we propose an E(3)-equivariant deep-learning framework to represent density functional theory (DFT) Hamiltonian as a function of material structure, which can naturally preserve the Euclidean symmetry even in the presence of spin-orbit coupling. Our DeepH-E3 method enables very efficient electronic-structure calculation at ab initio accuracy by learning from DFT data of small-sized structures, making routine study of large-scale supercells ($> 10^4$ atoms) feasible. Remarkably, the method can reach sub-meV prediction accuracy at high training efficiency, showing state-of-the-art performance in our experiments. The work is not only of general significance to deep-learning method development, but also creates new opportunities for materials research, such as building Moir\'e-twisted material database.


title: HiddenGems: Efficient safety boundary detection with active learning

abstract: Evaluating safety performance in a resource-efficient way is crucial for the development of autonomous systems. Simulation of parameterized scenarios is a popular testing strategy but parameter sweeps can be prohibitively expensive. To address this, we propose HiddenGems: a sample-efficient method for discovering the boundary between compliant and non-compliant behavior via active learning. Given a parameterized scenario, one or more compliance metrics, and a simulation oracle, HiddenGems maps the compliant and non-compliant domains of the scenario. The methodology enables critical test case identification, comparative analysis of different versions of the system under test, as well as verification of design objectives. We evaluate HiddenGems on a scenario with a jaywalker crossing in front of an autonomous vehicle and obtain compliance boundary estimates for collision, lane keep, and acceleration metrics individually and in combination, with 6 times fewer simulations than a parameter sweep. We also show how HiddenGems can be used to detect and rectify a failure mode for an unprotected turn with 86% fewer simulations.


title: Thermodynamics of the spin square

abstract: Small spin systems at the interface between analytical studies and experimental application have been intensively studied in recent decades. The spin ring consisting of four spins with uniform antiferromagnetic Heisenberg interaction is an example of a completely integrable system, in the double sense: quantum mechanical and classical. However, this does not automatically imply that the thermodynamic quantities of the classical system can also be calculated explicitly. In this work, we derive analytical expressions for the density of states, the partition function, specific heat, entropy, and susceptibility. These theoretical results are confirmed by numerical tests. This allows us to compare the quantum mechanical quantities for increasing spin quantum numbers $s$ with their classical counterparts in the classical limit $s\to \infty$. As expected, a good agreement is obtained, except for the low temperature region. However, this region shrinks with increasing $s$, so that the classical state variables emerge as envelopes of the quantum mechanical ones.


title: Mitigating Health Data Poverty: Generative Approaches versus Resampling for Time-series Clinical Data

abstract: Several approaches have been developed to mitigate algorithmic bias stemming from health data poverty, where minority groups are underrepresented in training datasets. Augmenting the minority class using resampling (such as SMOTE) is a widely used approach due to the simplicity of the algorithms. However, these algorithms decrease data variability and may introduce correlations between samples, giving rise to the use of generative approaches based on GAN. Generation of high-dimensional, time-series, authentic data that provides a wide distribution coverage of the real data, remains a challenging task for both resampling and GAN-based approaches. In this work we propose CA-GAN architecture that addresses some of the shortcomings of the current approaches, where we provide a detailed comparison with both SMOTE and WGAN-GP*, using a high-dimensional, time-series, real dataset of 3343 hypotensive Caucasian and Black patients. We show that our approach is better at both generating authentic data of the minority class and remaining within the original distribution of the real data.


title: The two-dimensional Coulomb gas: fluctuations through a spectral gap

abstract: We study a class of radially symmetric Coulomb gas ensembles at inverse temperature $\beta=2$, for which the droplet consists of a number of concentric annuli, having at least one bounded ``gap'' $G$, i.e., a connected component of the complement of the droplet, which disconnects the droplet. Let $n$ be the total number of particles. Among other things, we deduce fine asymptotics as $n \to \infty$ for the edge density and the correlation kernel near the gap, as well as for the cumulant generating function of fluctuations of smooth linear statistics. We typically find an oscillatory behaviour in the distribution of particles which fall near the edge of the gap. These oscillations are given explicitly in terms of a discrete Gaussian distribution, weighted Szeg\H{o} kernels, and the Jacobi theta function, which depend on the parameter $n$.


title: Gluing small black holes into initial data sets

abstract: We prove a strong localized gluing result for the general relativistic constraint equations (with or without cosmological constant) in $n\geq 3$ spatial dimensions. We glue an $\epsilon$-rescaling of an asymptotically flat data set $(\hat\gamma,\hat k)$ into the neighborhood of a point $\mathfrak{p}\in X$ inside of another initial data set $(X,\gamma,k)$, under a local genericity condition (non-existence of KIDs) near $\mathfrak{p}$. As the scaling parameter $\epsilon$ tends to $0$, the rescalings $\frac{x}{\epsilon}$ of normal coordinates $x$ on $X$ around $\mathfrak{p}$ become asymptotically flat coordinates on the asymptotically flat data set; outside of any neighborhood of $\mathfrak{p}$ on the other hand, the glued initial data converge back to $(\gamma,k)$. The initial data we construct enjoy polyhomogeneous regularity jointly in $\epsilon$ and the (rescaled) spatial coordinates. Applying our construction to unit mass black hole data sets $(X,\gamma,k)$ and appropriate boosted Kerr initial data sets $(\hat\gamma,\hat k)$ produces initial data which conjecturally evolve into the extreme mass ratio inspiral of a unit mass and a mass $\epsilon$ black hole. The proof combines a variant of the gluing method introduced by Corvino and Schoen with geometric singular analysis techniques originating in Melrose's work. On a technical level, we present a fully geometric microlocal treatment of the solvability theory for the linearized constraints map.


title: Virial theorem in clusters of galaxies with MOND

abstract: A specific modification of Newtonian dynamics known as MOND has been shown to reproduce the dynamics of most astrophysical systems at different scales without invoking non-baryonic dark matter (DM). There is, however, a long-standing unsolved problem when MOND is applied to rich clusters of galaxies in the form of a deficit (by a factor around two) of predicted dynamical mass derived from the virial theorem with respect to observations. In this article we approach the virial theorem using the velocity dispersion of cluster members along the line of sight rather than using the cluster temperature from X-ray data and hydrostatic equilibrium. Analytical calculations of the virial theorem in clusters for Newtonian gravity+DM and MOND are developed, applying pressure (surface) corrections for non-closed systems. Recent calibrations of DM profiles, baryonic ratio and baryonic ($\beta $ model or others) profiles are used, while allowing free parameters to range within the observational constraints. It is shown that solutions exist for MOND in clusters that give similar results to Newton+DM -- particularly in the case of an isothermal $\beta $ model for $\beta =0.55-0.70$ and core radii $r_c$ between 0.1 and 0.3 times $r_{500}$ (in agreement with the known data). The disagreements found in previous studies seem to be due to the lack of pressure corrections (based on inappropriate hydrostatic equilibrium assumptions) and/or inappropriate parameters for the baryonic matter profiles.


title: Disk counting statistics near hard edges of random normal matrices: the multi-component regime

abstract: We consider a two-dimensional point process whose points are separated into two disjoint components by a hard wall, and study the multivariate moment generating function of the corresponding disk counting statistics. We investigate the ``hard edge regime" where all disk boundaries are a distance of order $\frac{1}{n}$ away from the hard wall, where $n$ is the number of points. We prove that as $n \to + \infty$, the asymptotics of the moment generating function are of the form \begin{align*} & \exp \bigg(C_{1}n + C_{2}\ln n + C_{3} + \mathcal{F}_{n} + \frac{C_{4}}{\sqrt{n}} + \mathcal{O}(n^{-\frac{3}{5}})\bigg), \end{align*} and we determine the constants $C_{1},\dots,C_{4}$ explicitly. The oscillatory term $\mathcal{F}_{n}$ is of order $1$ and is given in terms of the Jacobi theta function. Our theorems allow us to derive various precise results on the disk counting function. For example, we prove that the asymptotic fluctuations of the number of points in one component are of order $1$ and are given by an oscillatory discrete Gaussian. Furthermore, the variance of this random variable enjoys asymptotics described by the Weierstrass $\wp$-function.


title: Modes trimming and clustering in a weakly perturbed high-Q whispering gallery microresonator

abstract: In general, a high-Q microresonator can accommodate abundant whispering gallery modes (WGMs) with the mode number increasing with the dimensional sizes of the microresonator. Removing the unnecessary modes while reorganizing the remaining modes is of vital importance, which, however, has been proved challenging and usually results in a tradeoff with the Q of the microresonator. Here, we reveal an effective and controllable mode trimming and clustering mechanism underlying the generation of polygon and star modes in weakly perturbed tapered fiber-coupled lithium niobate whispering gallery microresonators. Experimentally, various polygon and star modes are observed in sequence within a single microresonator by tuning the excitation wavelength or varying the coupling position between a tapered fiber and the circular microresonator, which can be well reproduced with our theoretical model. The finding offers a ubiquitous solution for a broad range of applications requiring elaborate selection and organization of the high-Q WGMs.


title: Learning to Reuse Distractors to support Multiple Choice Question Generation in Education

abstract: Multiple choice questions (MCQs) are widely used in digital learning systems, as they allow for automating the assessment process. However, due to the increased digital literacy of students and the advent of social media platforms, MCQ tests are widely shared online, and teachers are continuously challenged to create new questions, which is an expensive and time-consuming task. A particularly sensitive aspect of MCQ creation is to devise relevant distractors, i.e., wrong answers that are not easily identifiable as being wrong. This paper studies how a large existing set of manually created answers and distractors for questions over a variety of domains, subjects, and languages can be leveraged to help teachers in creating new MCQs, by the smart reuse of existing distractors. We built several data-driven models based on context-aware question and distractor representations, and compared them with static feature-based models. The proposed models are evaluated with automated metrics and in a realistic user test with teachers. Both automatic and human evaluations indicate that context-aware models consistently outperform a static feature-based approach. For our best-performing context-aware model, on average 3 distractors out of the 10 shown to teachers were rated as high-quality distractors. We create a performance benchmark, and make it public, to enable comparison between different approaches and to introduce a more standardized evaluation of the task. The benchmark contains a test of 298 educational questions covering multiple subjects & languages and a 77k multilingual pool of distractor vocabulary for future research.


title: Exploring the impact of weather on Metro demand forecasting using machine learning method

abstract: Urban rail transit provides significant comprehensive benefits such as large traffic volume and high speed, serving as one of the most important components of urban traffic construction management and congestion solution. Using real passenger flow data of an Asian subway system from April to June of 2018, this work analyzes the space-time distribution of the passenger flow using short-term traffic flow prediction. Stations are divided into four types for passenger flow forecasting, and meteorological records are collected for the same period. Then, machine learning methods with different inputs are applied and multivariate regression is performed to evaluate the improvement effect of each weather element on passenger flow forecasting of representative metro stations on hourly basis. Our results show that by inputting weather variables the precision of prediction on weekends enhanced while the performance on weekdays only improved marginally, while the contribution of different elements of weather differ. Also, different categories of stations are affected differently by weather. This study provides a possible method to further improve other prediction models, and attests to the promise of data-driven analytics for optimization of short-term scheduling in transit management.


title: The Debate Over Understanding in AI's Large Language Models

abstract: We survey a current, heated debate in the AI research community on whether large pre-trained language models can be said to "understand" language -- and the physical and social situations language encodes -- in any important sense. We describe arguments that have been made for and against such understanding, and key questions for the broader sciences of intelligence that have arisen in light of these arguments. We contend that a new science of intelligence can be developed that will provide insight into distinct modes of understanding, their strengths and limitations, and the challenge of integrating diverse forms of cognition.


title: Satyendra Nath Bose: Quantum statistics to Bose-Einstein condensation

abstract: Satyendra Nath Bose is one of the great Indian scientists. His remarkable work on the black body radiation or derivation of Planck's law led to quantum statistics, in particular, the statistics of photon. Albert Einstein applied Bose's idea to a gas made of atoms and predicted a new state of matter now called Bose-Einstein condensate. It took 70 years to observe the predicted condensation phenomenon in the laboratory. With a brief introduction to the formative period of Professor Bose, this research survey begins with the founding works on quantum statistics and, subsequently, provides a brief account of the series of events terminating in the experimental realization of Bose-Einstein condensation. We also provide two simple examples to visualize the role of synthetic spin-orbit coupling in a quasi-one-dimensional condensate with attractive atom-atom interaction.


title: Faster Projection-Free Augmented Lagrangian Methods via Weak Proximal Oracle

abstract: This paper considers a convex composite optimization problem with affine constraints, which includes problems that take the form of minimizing a smooth convex objective function over the intersection of (simple) convex sets, or regularized with multiple (simple) functions. Motivated by high-dimensional applications in which exact projection/proximal computations are not tractable, we propose a \textit{projection-free} augmented Lagrangian-based method, in which primal updates are carried out using a \textit{weak proximal oracle} (WPO). In an earlier work, WPO was shown to be more powerful than the standard \textit{linear minimization oracle} (LMO) that underlies conditional gradient-based methods (aka Frank-Wolfe methods). Moreover, WPO is computationally tractable for many high-dimensional problems of interest, including those motivated by recovery of low-rank matrices and tensors, and optimization over polytopes which admit efficient LMOs. The main result of this paper shows that under a certain curvature assumption (which is weaker than strong convexity), our WPO-based algorithm achieves an ergodic rate of convergence of $O(1/T)$ for both the objective residual and feasibility gap. This result, to the best of our knowledge, improves upon the $O(1/\sqrt{T})$ rate for existing LMO-based projection-free methods for this class of problems. Empirical experiments on a low-rank and sparse covariance matrix estimation task and the Max Cut semidefinite relaxation demonstrate that of our method can outperform state-of-the-art LMO-based Lagrangian-based methods.


title: Sarnak's spectral gap question

abstract: We answer in the affirmative a question of Sarnak's from 2007, confirming that the Patterson-Sullivan base eigenfunction is the unique square-integrable eigenfunction of the hyperbolic Laplacian invariant under the group of symmetries of the Apollonian packing. Thus the latter has a maximal spectral gap. We prove further restrictions on the spectrum of the Laplacian on a wide class of manifolds coming from Kleinian sphere packings.


title: Islands and Icebergs may contribute nothing to the Page curve

abstract: We study the entanglement entropy of a subsystem in contact with symmetrical bath where the complete system lives on the boundary of AdS3 spacetime. The system-A is taken to be in the middle of the bath system-B and the full system is taken to be some fixed localized region of the boundary 2-dimensional CFT. We generally assume that the d.o.f.s in the total system remain fixed when we vary the size of the bath which is to be guided by the conservation laws. It is found that the island and the subleading (icebergs) contributions are inseparable, and in totality they contribute nothing to the Page-curve of the radiation. As such they contribute only to the unphysical branch of the entropy. The entropy formula of the radiation may simply be written as minimum of {S[A],S[B]} including for the black holes.


title: Cellular Automata: Temporal Stochasticity and Computability

abstract: In this dissertation, we study temporally stochasticity in cellular automata and the behavior of such cellular automata. The work also explores the computational ability of such cellular automaton that illustrates the computability of solving the affinity classification problem. In addition to that, a cellular automaton, defined over Cayley tree, is shown as the classical searching problem solver. The proposed temporally stochastic cellular automata deals with two elementary cellular automata rules, say $f$ and $g$. The $f$ is the default rule, however, $g$ is temporally applied to the overall system with some probability $\tau$ which acts as a noise in the system. After exploring the dynamics of temporally stochastic cellular automata (TSCAs), we study the dynamical behavior of these temporally stochastic cellular automata (TSCAs) to identify the TSCAs that converge to a fixed point from any seed. We apply each of the convergent TSCAs to some standard datasets and observe the effectiveness of each TSCA as a pattern classifier. It is observed that the proposed TSCA-based classifier shows competitive performance in comparison with existing classifier algorithms. We use temporally stochastic cellular automata to solve a new problem in the field of cellular automata, named as, affinity classification problem which is a generalization of the density classification problem . We show that this model can be used in several applications, like modeling self-healing systems. Finally, we introduce a new model of computing unit developed around cellular automata to reduce the workload of the Central Processing Unit (CPU) of a machine to compute. Each cell of the computing unit acts as a tiny processing element with attached memory. Such a CA is implemented on the Cayley Tree to realize efficient solutions for diverse computational problems.


title: Numerical investigations of the bulk-surface wave pinning model

abstract: The bulk-surface wave pinning model is a reaction-diffusion system for studying cell polarisation. It is constituted by a surface reaction-diffusion equation, coupled to a bulk diffusion equation with a non-linear boundary condition. Cell polarisation arises as the surface component develops specific patterns. Since proteins diffuse much faster in the cell interior than on the membrane, in the literature, the bulk component is often assumed to be spatially homogeneous. {\re Therefore, the model can be reduced to a single surface equation}. However, {\re in real applications} a spatially non-uniform bulk component might be an important player to take into account. In this paper, we study, through numerical computations, the role of the bulk component and, more specifically, how different bulk diffusion rates might affect the polarisation response. We find that the bulk component is indeed a key factor in {\re determining the surface polarisation response}. Moreover, for certain geometries, it is the spatial heterogeneity of the bulk component that triggers the polarisation response, which might not be possible in a reduced model. Understanding how polarisation depends on bulk diffusivity might be crucial when studying models of migrating cells, which are naturally subject to domain deformation.


title: Is the Quantum State Real in the Hilbert Space Formulation?

abstract: The persistent debate about the reality of a quantum state has recently come under limelight because of its importance to quantum information and the quantum computing community. Almost all of the deliberations are taking place using the elegant and powerful but abstract Hilbert space formalism of quantum mechanics developed with seminal contributions from John von Neumann. Since it is rather difficult to get a direct perception of the events in an abstract vector space, it is hard to trace the progress of a phenomenon. Among the multitude of recent attempts to show the reality of the quantum state in Hilbert space, the Pusey-Barrett-Rudolph theory gets most recognition for their proof. But some of its assumptions have been criticized, which are still not considered to be entirely loophole free. A straightforward proof of the reality of the wave packet function of a single particle has been presented earlier based on the currently recognized fundamental reality of the universal quantum fields. Quantum states like the atomic energy levels comprising the wave packets have been shown to be just as real. Here we show that an unambiguous proof of reality of the quantum states gleaned from the reality of quantum fields can also provide an explicit substantiation of the reality of quantum states in Hilbert space.


title: Could GUP Act as a Model for the ER=EPR Conjecture?

abstract: Einstein, Podolsky, and Rosen (EPR) proposed, via a thought experiment, that the uncertainty principle might not provide a complete description of reality. We propose that the linear generalized uncertainty principle (GUP) may resolve the EPR paradox by demonstrating vanishing uncertainty at the minimal measurable length. This may shed light on the completeness of quantum mechanics which leads us to propose an equivalency between the linear GUP and the Bekenstein bound, a bound that prescribes the maximum amount of information needed to completely describe a physical system up to quantum level. This equivalency is verified through explaining the Hydrogen's atom/nuclei radii as well as the value of the cosmological constant. In a recent published study, we verified that the Einstein-Rosen (ER) bridge originates from the minimal length or GUP. Considering these findings together, we propose that linear GUP could function as a model for the ER=EPR conjecture.


title: $\tilde{o}$rder-norm continuous operators and $\tilde{o}$rder weakly compact operators

abstract: Let $E$ be a sublattice of a vector lattice $F$. A continuous operator $T$ from the vector lattice $E$ into a normed vector space $X$ is said to be $\tilde{o}$rder-norm continuous whenever $x_\alpha\xrightarrow{Fo}0$ implies $Tx_\alpha\xrightarrow{\Vert.\Vert}0$ for each $(x_\alpha)_\alpha\subseteq E$. Our mean from the convergence $ x_\alpha\stackrel{Fo} {\longrightarrow} x $ is that there exists another net $ \left(y_\alpha\right) $ in $F $ with the same index set satisfying $ y_\alpha\downarrow 0 $ in $F$ and $ \vert x_\alpha - x \vert \leq y_\alpha $ for all indexes $ \alpha $. In this paper, we will study some properties of this new class of operators and its relationships with some known classifications of operators. We also define the new class of operators that named $\tilde{o}$rder weakly compact operators. A continuous operator $T: E \rightarrow X $ is said to be $\tilde{o}$rder weakly compact, if $ T(A) $ in $X$ is a relatively weakly compact set for each $Fo$-bounded $A\subseteq E$. In this manuscript, we study some properties of this class of operators and its relationships with $\tilde{o}$rder-norm continuous operators.


title: Double and Quadruple Flat Bands tuned by Alternative magnetic Fluxes in Twisted Bilayer Graphene

abstract: Twisted bilayer graphene (TBG) can host the moir\'{e} energy flat bands with two-fold degeneracy serving as a fruitful playground for strong correlations and topological phases. However, the number of degeneracy is not limited to two. Introducing a spatially alternative magnetic field, we report that the induced magnetic phase becomes an additional controllable parameter and leads to an undiscovered generation of four-fold degenerate flat bands. This emergence stems from the band inversion at $\Gamma$ point near the Fermi level with a variation of both twisted angle and magnetic phase. We present the conditions for the emergence of multi-fold degenerate flat bands, which are associated with the eigenvalue degeneracy of a Birman-Schwinger operator. Using holomorphic functions, which explain the origin of the double flat bands in the conventional TBG, we can generate analytical wave functions in the magnetic TBG to show absolute flatness with four-fold degeneracy. Moreover, we identify an orbital-related intervalley coherent state as the many-body ground state at charge neutrality. In contrast, the conventional TBG has only two moir\'{e} energy flat bands, and the highly degenerate flat bands with additional orbital channels in this magnetic platform might bring richer correlation physics.


title: Cozie Apple: An iOS mobile and smartwatch application for environmental quality satisfaction and physiological data collection

abstract: Collecting feedback from people in indoor and outdoor environments is traditionally challenging and complex in a reliable, longitudinal, and non-intrusive way. This paper introduces Cozie Apple, an open-source mobile and smartwatch application for iOS devices. This platform allows people to complete a watch-based micro-survey and provide real-time feedback about environmental conditions via their Apple Watch. It leverages the inbuilt sensors of a smartwatch to collect physiological (e.g., heart rate, activity) and environmental (sound level) data. This paper outlines data collected from 48 research participants who used the platform to report perceptions of urban-scale environmental comfort (noise and thermal) and contextual factors such as who they were with and what activity they were doing. The results of 2,400 micro-surveys across various urban settings are illustrated in this paper showing the variability of noise-related distractions, thermal comfort, and associated context. The results show people experience at least a little noise distraction 58% of the time, with people talking being the most common reason (46%). This effort is novel due to its focus on spatial and temporal scalability and collection of noise, distraction, and associated contextual information. These data set the stage for larger deployments, deeper analysis, and more helpful prediction models toward better understanding the occupants' needs and perceptions. These innovations could result in real-time control signals to building systems or nudges for people to change their behavior.


title: Boosting the Cycle Counting Power of Graph Neural Networks with I$^2$-GNNs

abstract: Message Passing Neural Networks (MPNNs) are a widely used class of Graph Neural Networks (GNNs). The limited representational power of MPNNs inspires the study of provably powerful GNN architectures. However, knowing one model is more powerful than another gives little insight about what functions they can or cannot express. It is still unclear whether these models are able to approximate specific functions such as counting certain graph substructures, which is essential for applications in biology, chemistry and social network analysis. Motivated by this, we propose to study the counting power of Subgraph MPNNs, a recent and popular class of powerful GNN models that extract rooted subgraphs for each node, assign the root node a unique identifier and encode the root node's representation within its rooted subgraph. Specifically, we prove that Subgraph MPNNs fail to count more-than-4-cycles at node level, implying that node representations cannot correctly encode the surrounding substructures like ring systems with more than four atoms. To overcome this limitation, we propose I$^2$-GNNs to extend Subgraph MPNNs by assigning different identifiers for the root node and its neighbors in each subgraph. I$^2$-GNNs' discriminative power is shown to be strictly stronger than Subgraph MPNNs and partially stronger than the 3-WL test. More importantly, I$^2$-GNNs are proven capable of counting all 3, 4, 5 and 6-cycles, covering common substructures like benzene rings in organic chemistry, while still keeping linear complexity. To the best of our knowledge, it is the first linear-time GNN model that can count 6-cycles with theoretical guarantees. We validate its counting power in cycle counting tasks and demonstrate its competitive performance in molecular prediction benchmarks.


title: Meta-learning Pathologies from Radiology Reports using Variance Aware Prototypical Networks

abstract: Large pretrained Transformer-based language models like BERT and GPT have changed the landscape of Natural Language Processing (NLP). However, fine tuning such models still requires a large number of training examples for each target task, thus annotating multiple datasets and training these models on various downstream tasks becomes time consuming and expensive. In this work, we propose a simple extension of the Prototypical Networks for few-shot text classification. Our main idea is to replace the class prototypes by Gaussians and introduce a regularization term that encourages the examples to be clustered near the appropriate class centroids. Experimental results show that our method outperforms various strong baselines on 13 public and 4 internal datasets. Furthermore, we use the class distributions as a tool for detecting potential out-of-distribution (OOD) data points during deployment.


title: Bohr, objectivity, and "our experience": \`A propos Mermin's note on the quantum measurement problem

abstract: In a recent note David Mermin attributed the idea that wave function collapse is a physical process to a misunderstanding of probability and the role it plays in quantum mechanics. There are, however, further misconceptions at play, some of which are shared by Mermin himself and more generally by QBists. The main objective of the present comment on his note is to explain why I disagree with his reading of a well-known passage by Niels Bohr, in particular the ambiguity of the first-person plural he perceives in Bohr's reference to "our description of nature" and "our experience."


title: Unit sphere fibrations in Euclidean space

abstract: We show that if an open set in $\mathbb{R}^d$ can be fibered by unit $n$-spheres, then $d \geq 2n+1$, and if $d = 2n+1$, then the spheres must be pairwise linked, and $n \in \left\{ 0, 1, 3, 7 \right\}$. For these values of $n$, we construct unit $n$-sphere fibrations in $\mathbb{R}^{2n+1}$.


title: Hindering Adversarial Attacks with Implicit Neural Representations

abstract: We introduce the Lossy Implicit Network Activation Coding (LINAC) defence, an input transformation which successfully hinders several common adversarial attacks on CIFAR-$10$ classifiers for perturbations up to $\epsilon = 8/255$ in $L_\infty$ norm and $\epsilon = 0.5$ in $L_2$ norm. Implicit neural representations are used to approximately encode pixel colour intensities in $2\text{D}$ images such that classifiers trained on transformed data appear to have robustness to small perturbations without adversarial training or large drops in performance. The seed of the random number generator used to initialise and train the implicit neural representation turns out to be necessary information for stronger generic attacks, suggesting its role as a private key. We devise a Parametric Bypass Approximation (PBA) attack strategy for key-based defences, which successfully invalidates an existing method in this category. Interestingly, our LINAC defence also hinders some transfer and adaptive attacks, including our novel PBA strategy. Our results emphasise the importance of a broad range of customised attacks despite apparent robustness according to standard evaluations. LINAC source code and parameters of defended classifier evaluated throughout this submission are available: https://github.com/deepmind/linac


title: Optimization for Amortized Inverse Problems

abstract: Incorporating a deep generative model as the prior distribution in inverse problems has established substantial success in reconstructing images from corrupted observations. Notwithstanding, the existing optimization approaches use gradient descent largely without adapting to the non-convex nature of the problem and can be sensitive to initial values, impeding further performance improvement. In this paper, we propose an efficient amortized optimization scheme for inverse problems with a deep generative prior. Specifically, the optimization task with high degrees of difficulty is decomposed into optimizing a sequence of much easier ones. We provide a theoretical guarantee of the proposed algorithm and empirically validate it on different inverse problems. As a result, our approach outperforms baseline methods qualitatively and quantitatively by a large margin.


title: Abductive Action Inference

abstract: Abductive reasoning aims to make the most likely inference for a given set of incomplete observations. In this paper, we introduce a novel research task known as "abductive action inference" which addresses the question of which actions were executed by a human to reach a specific state shown in a single snapshot. The research explores three key abductive inference problems: action set prediction, action sequence prediction, and abductive action verification. To tackle these challenging tasks, we investigate various models, including established ones such as Transformers, Graph Neural Networks, CLIP, BLIP, GPT3, end-to-end trained Slow-Fast, Resnet50-3D, and ViT models. Furthermore, the paper introduces several innovative models tailored for abductive action inference, including a relational graph neural network, a relational bilinear pooling model, a relational rule-based inference model, a relational GPT-3 prompt method, and a relational Transformer model. Notably, the newly proposed object-relational bilinear graph encoder-decoder (BiGED) model emerges as the most effective among all methods evaluated, demonstrating good proficiency in handling the intricacies of the Action Genome dataset. The contributions of this research offer significant progress toward comprehending the implications of human actions and making highly plausible inferences concerning the outcomes of these actions.


title: This joke is [MASK]: Recognizing Humor and Offense with Prompting

abstract: Humor is a magnetic component in everyday human interactions and communications. Computationally modeling humor enables NLP systems to entertain and engage with users. We investigate the effectiveness of prompting, a new transfer learning paradigm for NLP, for humor recognition. We show that prompting performs similarly to finetuning when numerous annotations are available, but gives stellar performance in low-resource humor recognition. The relationship between humor and offense is also inspected by applying influence functions to prompting; we show that models could rely on offense to determine humor during transfer.


title: Electrostatic multipole contributions to the binding energy of electrons

abstract: The interaction of an electron with a local static charge distribution (e.g., an atom or molecule) is dominated at large distances by the radial 1/r Coulomb potential. The second order effect comes from the non-central electric dipole contribution cos(theta)/r^2. Moreover, the third order effect is due to the electric quadrupole potential, [3*cos^2(theta)-1]/2*r^3. We use the tridiagonal representation approach to give a reasonably accurate account for the combined effects of all these contributions to the binding energy of the electron but with an effective quadrupole interaction. As an application, we obtain the bound states of a valence electron in an atom with both electric dipole and quadrupole moments.


title: RIS-assisted Integrated Sensing and Communications: A Subspace Rotation Approach

abstract: In this paper, we propose a novel joint active and passive beamforming approach for integrated sensing and communication (ISAC) transmission with assistance of reconfigurable intelligent surfaces (RISs) to simultaneously detect a target and communicate with a communication user. We first show that the sensing and communication (S&C) performance can be jointly improved due to the capability of the RISs to control the ISAC channel. In particular, we show that RISs can favourably enhance both the channel gain and the coupling degree of S&C channels by modifying the underlying subspaces. In light of this, we develop a heuristic algorithm that expands and rotates the S&C subspaces that is able to attain significantly improved ISAC performance. To verify the effectiveness of the subspace rotation scheme, we further provide a benchmark scheme which maximizes the signal-to-noise ratio (SNR) at the sensing receiver while guaranteeing the SNR at the communication user. Finally, numerical simulations are provided to validate the proposed approaches.


title: Attention Based Relation Network for Facial Action Units Recognition

abstract: Facial action unit (AU) recognition is essential to facial expression analysis. Since there are highly positive or negative correlations between AUs, some existing AU recognition works have focused on modeling AU relations. However, previous relationship-based approaches typically embed predefined rules into their models and ignore the impact of various AU relations in different crowds. In this paper, we propose a novel Attention Based Relation Network (ABRNet) for AU recognition, which can automatically capture AU relations without unnecessary or even disturbing predefined rules. ABRNet uses several relation learning layers to automatically capture different AU relations. The learned AU relation features are then fed into a self-attention fusion module, which aims to refine individual AU features with attention weights to enhance the feature robustness. Furthermore, we propose an AU relation dropout strategy and AU relation loss (AUR-Loss) to better model AU relations, which can further improve AU recognition. Extensive experiments show that our approach achieves state-of-the-art performance on the DISFA and DISFA+ datasets.


title: Input-Output Relation and Performance of RIS-Aided OTFS with Fractional Delay-Doppler

abstract: Reconfigurable intelligent surfaces (RIS) and orthogonal time-frequency space (OTFS) modulation have gained attention in recent wireless research. RIS technology aids communication by reflecting the incident electromagnetic waves towards the receiver, and OTFS modulation is effective in high-Doppler channels. This paper presents an early investigation of RIS-aided OTFS in high-Doppler channels. We derive the end-to-end delay-Doppler (DD) domain input-output relation of a RIS-aided OTFS system, considering rectangular pulses and fractional delay-Doppler values. We also consider a Zak receiver for RIS-aided OTFS that converts the received time-domain signal to DD domain in one step using Zak transform, and derive its end-to-end input-output relation. Our simulation results show that $i)$ RIS-aided OTFS performs better than OTFS without RIS, $ii)$ Zak receiver performs better than a two-step receiver, and $iii)$ RIS-aided OTFS achieves superior performance compared to RIS-aided OFDM.


title: OSS Mentor A framework for improving developers contributions via deep reinforcement learning

abstract: In open source project governance, there has been a lot of concern about how to measure developers' contributions. However, extremely sparse work has focused on enabling developers to improve their contributions, while it is significant and valuable. In this paper, we introduce a deep reinforcement learning framework named Open Source Software(OSS) Mentor, which can be trained from empirical knowledge and then adaptively help developers improve their contributions. Extensive experiments demonstrate that OSS Mentor significantly outperforms excellent experimental results. Moreover, it is the first time that the presented framework explores deep reinforcement learning techniques to manage open source software, which enables us to design a more robust framework to improve developers' contributions.


title: A new class of exactly-solvable potentials by means of the hypergeometric equation

abstract: We obtained a new class of exactly-solvable potentials by means of the hypergeometric equation for Schrodinger equation, which different from the exactly-solvable potentials introduced by Bose and Natanzon. Using the new class of solvable potentials, we can obtain the corresponding complex PT-invariant potentials. This method can also apply to the other Fuchs equations.


title: SphNet: A Spherical Network for Semantic Pointcloud Segmentation

abstract: Semantic segmentation for robotic systems can enable a wide range of applications, from self-driving cars and augmented reality systems to domestic robots. We argue that a spherical representation is a natural one for egocentric pointclouds. Thus, in this work, we present a novel framework exploiting such a representation of LiDAR pointclouds for the task of semantic segmentation. Our approach is based on a spherical convolutional neural network that can seamlessly handle observations from various sensor systems (e.g., different LiDAR systems) and provides an accurate segmentation of the environment. We operate in two distinct stages: First, we encode the projected input pointclouds to spherical features. Second, we decode and back-project the spherical features to achieve an accurate semantic segmentation of the pointcloud. We evaluate our method with respect to state-of-the-art projection-based semantic segmentation approaches using well-known public datasets. We demonstrate that the spherical representation enables us to provide more accurate segmentation and to have a better generalization to sensors with different field-of-view and number of beams than what was seen during training.


title: Appell-Lauricella hypergeometric functions over finite fields and algebraic varieties

abstract: We prove finite field analogues of integral representations of Appell- Lauricella hypergeometric functions in many variables. We consider certain hypersurfaces having a group action and compute the numbers of rational points associated with characters of the group, which will be expressed in terms of Appell-Lauricella functions over finite fields.


title: Minutiae-Guided Fingerprint Embeddings via Vision Transformers

abstract: Minutiae matching has long dominated the field of fingerprint recognition. However, deep networks can be used to extract fixed-length embeddings from fingerprints. To date, the few studies that have explored the use of CNN architectures to extract such embeddings have shown extreme promise. Inspired by these early works, we propose the first use of a Vision Transformer (ViT) to learn a discriminative fixed-length fingerprint embedding. We further demonstrate that by guiding the ViT to focus in on local, minutiae related features, we can boost the recognition performance. Finally, we show that by fusing embeddings learned by CNNs and ViTs we can reach near parity with a commercial state-of-the-art (SOTA) matcher. In particular, we obtain a TAR=94.23% @ FAR=0.1% on the NIST SD 302 public-domain dataset, compared to a SOTA commercial matcher which obtains TAR=96.71% @ FAR=0.1%. Additionally, our fixed-length embeddings can be matched orders of magnitude faster than the commercial system (2.5 million matches/second compared to 50K matches/second). We make our code and models publicly available to encourage further research on this topic: https://github.com/tba.


title: On the Role of $^{40}$K in the Origin of Terrestrial Life

abstract: The abundance and biological role of potassium suggest that its unstable nuclide was present in all stages of terrestrial biogenesis. With its enhanced isotopic ratio in the Archean eon, $^{40}$K may have contributed to the special, perhaps unique, biogenetic conditions that were present in the primitive Earth. Compared to the U and Th radionuclides, $^{40}$K has a less disruptive radiochemical impact, which may drive a moderate, but persistent evolution of the structural and functional properties of proto-biological molecules. In the main $\beta$-decay route of $^{40}$K, the radiation dose generated by an Archean solution with potassium ions can be larger than the present background radiation on Earth by one to two orders of magnitude. Estimates of the rates of organic molecules indirectly affected by $\beta$ decays are provided for two schematic models of the propagation of secondary events in the solvent of prebiotic solutions. The left-handed $\beta^-$ particles emitted by $^{40}$K are the best candidates to trigger an enantiomeric excess of L-type amino acids via weak nuclear forces in the primitive Earth. The concentration-dependent radiation dose of $^{40}$K fits well in dry--wet scenarios of life's origins and should be considered in realistic simulations of prebiotic chemical pathways.


title: Report on the energy consumption of the IOTA 2.0 prototype network (GoShimmer 0.8.3) under different testing scenarios

abstract: The high energy consumption of proof of work-based distributed ledgers has become an important environmental concern. Bitcoin, for example, consumes as much energy in a year as a developed country. Alternative consensus mechanisms, such as proof of stake, have been shown to use drastically less energy than proof of work-based DLTs. For example, the IOTA DLT, built upon a directed acyclic graph (DAG) architecture, uses an alternative consensus mechanism that requires significantly less energy than other DLTs. Because the (DLT) space is constantly and rapidly evolving, the question of how much energy DLTs actually consume demands to be continuously studied and answered. Previous research into the energy consumption of the IOTA network has shown that an optimization in the overall protocol correlates to an optimization in energy consumption. The planned IOTA 2.0 update, built upon the GoShimmer research prototype, promises to further optimize the protocol by removing the network's centralized Coordinator. This report presents the results of measuring the energy consumption of a private GoShimmer network while comparing these findings to previous research into the current mainnet, which is called Chrysalis. The main findings of this report are that the IOTA 2.0 research prototype shows both improvements and increase in the energy consumption metrics compared to the Chrysalis network. Additionally, this report defines a model to estimate the total annual energy consumption of an IOTA network. This model should be significant for future research as it enables a way to estimate the total cost of running the IOTA network as well as its carbon emissions. Moreover, having an annual power consumption metric allows for better objective comparisons to different DLTs.


title: The LHCspin project

abstract: The goal of LHCspin is to develop, in the next few years, innovative solutions and cutting-edge technologies to access spin physics in polarised fixed-target collisions at high energy, exploring the unique kinematic regime offered by LHC and exploiting new final states by means of the LHCb detector.


title: Ramsey numbers of large even cycles and fans

abstract: For graphs $F$ and $H$, the Ramsey number $R(F, H)$ is the smallest positive integer $N$ such that any red/blue edge coloring of $K_N$ contains either a red $F$ or a blue $H$. Let $C_n$ be a cycle of length $n$ and $F_n$ be a fan consisting of $n$ triangles all sharing a common vertex. In this paper, we prove that for all sufficiently large $n$, \[ R(C_{2\lfloor an\rfloor}, F_n)= \left\{ \begin{array}{ll} (2+2a+o(1))n & \textrm{if $1/2\leq a< 1$,}\\ (4a+o(1))n & \textrm{if $ a\geq 1$.} \end{array} \right. \]


title: Unsupervised domain-adaptive person re-identification with multi-camera constraints

abstract: Person re-identification is a key technology for analyzing video-based human behavior; however, its application is still challenging in practical situations due to the performance degradation for domains different from those in the training data. Here, we propose an environment-constrained adaptive network for reducing the domain gap. This network refines pseudo-labels estimated via a self-training scheme by imposing multi-camera constraints. The proposed method incorporates person-pair information without person identity labels obtained from the environment into the model training. In addition, we develop a method that appropriately selects a person from the pair that contributes to the performance improvement. We evaluate the performance of the network using public and private datasets and confirm the performance surpasses state-of-the-art methods in domains with overlapping camera views. To the best of our knowledge, this is the first study on domain-adaptive learning with multi-camera constraints that can be obtained in real environments.


title: Active focal-plane coronagraphy with liquid-crystal spatial-light modulators: Broadband contrast performance in the visible

abstract: The technological progress in spatial-light modulators (SLM) technology has made it possible to use those devices as programmable active focal-plane phase coronagraphic masks, opening the door to novel versatile and adaptive high-contrast imaging observation strategies. However, the scalar nature of the SLM-induced phase response is a potential hurdle when applying the approach to wideband light, as is typical in astronomical imaging. For the first time, we present laboratory results with broadband light (up to ~12pc bandwidth) for two commercially-available SLM devices used as active focal-plane phase masks in the visible regime (640 nm). It is shown that under ideal or realistic telescope aperture conditions, the contrast performance is negligibly affected in this bandwidth regime, reaching sufficient level for ground-based high-contrast imaging, which is typically dominated by atmospheric residuals.


title: The Hilbert symbol in the Hodge standard conjecture

abstract: We study the Hodge standard conjecture for varieties over finite fields admitting a CM lifting, such as abelian varieties or products of K3 surfaces. For those varieties we show that the signature predicted by the conjecture holds true modulo $4$. This amounts to determining the discriminant and the Hilbert symbol of the intersection product. The first is obtained by $\ell$-adic arguments whereas the second needs a careful computation in $p$-adic Hodge theory.


title: The one-station bike repositioning problem

abstract: In bike sharing systems the quality of the service to the users strongly depends on the strategy adopted to reposition the bikes. The bike repositioning problem is in general very complex as it involves different interrelated decisions: the routing of the repositioning vehicles, the scheduling of their visits to the stations, the number of bikes to load or unload for each station and for each vehicle that visits the station. In this paper we study the problem of optimally loading/unloading vehicles that visit the same station at given time instants of a finite time horizon. The goal is to minimize the total lost demand of bikes and free stands in the station. We model the problem as a mixed integer linear programming problem and present an optimal algorithm that runs in linear time in the size of the time horizon.


title: Dynamic Practical Byzantine Fault Tolerance and Its Blockchain System: A Large-Scale Markov Modeling

abstract: In a practical Byzantine fault tolerance (PBFT) blockchain network, the voting nodes may always leave the network while some new nodes can also enter the network, thus the number of voting nodes is constantly changing. Such a new PBFT with dynamic nodes is called a dynamic PBFT. Clearly, the dynamic PBFT can more strongly support the decentralization and distributed structure of blockchain. However, analyzing dynamic PBFT blockchain systems will become more interesting and challenging. In this paper, we propose a large-scale Markov modeling technique to analyze the dynamic PBFT voting processes and its dynamic PBFT blockchain system. To this end, we set up a large-scale Markov process (and further a multi-dimensional Quasi-Birth-and-Death (QBD) process) and provide performance analysis for both the dynamic PBFT voting processes and the dynamic PBFT blockchain system. In particular, we obtain an effective computational method for the throughput of the complicated dynamic PBFT blockchain system. Finally, we use numerical examples to check the validity of our theoretical results and indicate how some key system parameters influence the performance measures of the dynamic PBFT voting processes and of the dynamic PBFT blockchain system. Therefore, by using the theory of multi-dimensional QBD processes and the RG-factorization technique, we hope that the methodology and results developed in this paper shed light on the study of dynamic PBFT blockchain systems such that a series of promising research can be developed potentially.


title: Rare decays at LHCb

abstract: Flavour-changing neutral-current processes, such as $b\to s \ell^+\ell^-$, are forbidden at tree level in the Standard Model and hence might receive comparatively large corrections from new particles. This document highlights recent measurements from LHCb on $b\to s \ell^+\ell^-$ and purely-leptonic decays, including tests of lepton flavour universality and searches for lepton flavour violation.


title: Parametric PDF for Goodness of Fit

abstract: The goodness of fit methods for classification problems relies traditionally on confusion matrices. This paper aims to enrich these methods with a risk evaluation and stability analysis tools. For this purpose, we present a parametric PDF framework.


title: Non-binary Two-Deletion Correcting Codes and Burst-Deletion Correcting Codes

abstract: In this paper, we construct systematic $q$-ary two-deletion correcting codes and burst-deletion correcting codes, where $q\geq 2$ is an even integer. For two-deletion codes, our construction has redundancy $5\log n+O(\log q\log\log n)$ and has encoding complexity near-linear in $n$, where $n$ is the length of the message sequences. For burst-deletion codes, we first present a construction of binary codes with redundancy $\log n+9\log\log n+\gamma_t+o(\log\log n)$ bits $(\gamma_t$ is a constant that depends only on $t)$ and capable of correcting a burst of at most $t$ deletions, which improves the Lenz-Polyanskii Construction (ISIT 2020). Then we give a construction of $q$-ary codes with redundancy $\log n+(8\log q+9)\log\log n+o(\log q\log\log n)+\gamma_t$ bits and capable of correcting a burst of at most $t$ deletions.


title: MEW-UNet: Multi-axis representation learning in frequency domain for medical image segmentation

abstract: Recently, Visual Transformer (ViT) has been widely used in various fields of computer vision due to applying self-attention mechanism in the spatial domain to modeling global knowledge. Especially in medical image segmentation (MIS), many works are devoted to combining ViT and CNN, and even some works directly utilize pure ViT-based models. However, recent works improved models in the aspect of spatial domain while ignoring the importance of frequency domain information. Therefore, we propose Multi-axis External Weights UNet (MEW-UNet) for MIS based on the U-shape architecture by replacing self-attention in ViT with our Multi-axis External Weights block. Specifically, our block performs a Fourier transform on the three axes of the input feature and assigns the external weight in the frequency domain, which is generated by our Weights Generator. Then, an inverse Fourier transform is performed to change the features back to the spatial domain. We evaluate our model on four datasets and achieve state-of-the-art performances. In particular, on the Synapse dataset, our method outperforms MT-UNet by 10.15mm in terms of HD95. Code is available at https://github.com/JCruan519/MEW-UNet.


title: Performance of Quantum Preprocessing under Phase Noise

abstract: Optical fiber transmission systems form the backbone of today's communication networks and will be of high importance for future networks as well. Among the prominent noise effects in optical fiber is phase noise, which is induced by the Kerr effect. This effect limits the data transmission capacity of these networks and incurs high processing load on the receiver. At the same time, quantum information processing techniques offer more efficient solutions but are believed to be inefficient in terms of size, power consumption and resistance to noise. Here we investigate the concept of an all-optical joint detection receiver. We show how it contributes to enabling higher baud-rates for optical transmission systems when used as a pre-processor, even under high levels of noise induced by the Kerr effect.


title: Interplay between the magnetic structures and the surface states in MnBi$_{2}$Te$_{4}$ from first-principles studies

abstract: The antiferromagnetic (AFM) topological insulator MnBi$_{2}$Te$_{4}$ was believed to have a topological surface state (TSS) with large band gap due to the ferromagnetic (FM) order on the surface, and be able to host the long-sought axion states. However, recent angle-resolved photoemission spectroscopy (ARPES) experiments indicate that the TSS is gapless, contradicting the theoretical predictions. Meanwhile, several experiments have suggested that there is robust out-of-plane FM order on the surface of MnBi$_{2}$Te$_{4}$. To understand these seemingly contradictory results, we carry out comprehensive first-principles calculations to investigate the interplay between the surface magnetism and the TSS. Our calculations provide direct evidence that in a wide range of parameters, the (nearly) gapless TSS can coexist with the surface FM order, therefore solving the paradox of the surface magnetism and the gapless TSS. We further show that proximity effects can be a promising route to open the gap in the TSS of MnBi$_{2}$Te$_{4}$. Our research deepens the understanding of the relationship between surface magnetism and TSS.


title: Runaway Transition in Irreversible Polymer Condensation with Cyclisation

abstract: The process of polymer condensation, i.e. the formation of bonds between reactive end-groups, is ubiquitous in both industry and biology. Here we study generic systems undergoing polymer condensation in competition with cyclisation. Using a generalised Smoluchowski theory, molecular dynamics simulations and experiments using DNA and T4 ligase, we find that this system displays a transition, from a regime with finite-length chains at infinite time and dominated by rings to one dominated by linear polymers that grow in time. Finally, we show that fluids prepared close to the transition may have profoundly different compositions and rheology at large condensation times.


title: Are All Spurious Features in Natural Language Alike? An Analysis through a Causal Lens

abstract: The term `spurious correlations' has been used in NLP to informally denote any undesirable feature-label correlations. However, a correlation can be undesirable because (i) the feature is irrelevant to the label (e.g. punctuation in a review), or (ii) the feature's effect on the label depends on the context (e.g. negation words in a review), which is ubiquitous in language tasks. In case (i), we want the model to be invariant to the feature, which is neither necessary nor sufficient for prediction. But in case (ii), even an ideal model (e.g. humans) must rely on the feature, since it is necessary (but not sufficient) for prediction. Therefore, a more fine-grained treatment of spurious features is needed to specify the desired model behavior. We formalize this distinction using a causal model and probabilities of necessity and sufficiency, which delineates the causal relations between a feature and a label. We then show that this distinction helps explain results of existing debiasing methods on different spurious features, and demystifies surprising results such as the encoding of spurious features in model representations after debiasing.


title: Gradient-based Weight Density Balancing for Robust Dynamic Sparse Training

abstract: Training a sparse neural network from scratch requires optimizing connections at the same time as the weights themselves. Typically, the weights are redistributed after a predefined number of weight updates, removing a fraction of the parameters of each layer and inserting them at different locations in the same layers. The density of each layer is determined using heuristics, often purely based on the size of the parameter tensor. While the connections per layer are optimized multiple times during training, the density of each layer remains constant. This leaves great unrealized potential, especially in scenarios with a high sparsity of 90% and more. We propose Global Gradient-based Redistribution, a technique which distributes weights across all layers - adding more weights to the layers that need them most. Our evaluation shows that our approach is less prone to unbalanced weight distribution at initialization than previous work and that it is able to find better performing sparse subnetworks at very high sparsity levels.


title: Modelling Residential Supply Tasks Based on Digital Orthophotography Using Machine Learning

abstract: In order to achieve the climate targets, electrification of individual mobility is essential. However, grid integration of electrical vehicles poses challenges for the electrical distribution network due to high charging power and simultaneity. To investigate these challenges in research studies, the network-referenced supply task needs to be modeled. Previous research work utilizes data that is not always complete or sufficiently granular in space. This is why this paper presents a methodology which allows a holistic determination of residential supply tasks based on orthophotos. To do this, buildings are first identified from orthophotos, then residential building types are classified, and finally the electricity demand of each building is determined. In an exemplary case study, we validate the presented methodology and compare the results with another supply task methodology. The results show that the electricity demand deviates from the results of a reference method by an average 9%. Deviations result mainly from the parameterization of the selected residential building types. Thus, the presented methodology is able to model supply tasks similarly as other methods but more granular.


title: Stationary solutions of semilinear Schr\"odinger equations with trapping potentials in supercritical dimensions

abstract: Nonlinear Schr\"odinger equations are usually investigated with the use of the variational methods that are limited to energy-subcritical dimensions. Here we present the approach based on the shooting method that can give the proof of existence of the ground states in critical and supercritical cases. We formulate the assumptions on the system that are sufficient for this method to work. As examples, we consider Schr\"odinger-Newton and Gross-Pitaevskii equations with harmonic potentials.


title: Design of Discrete-time Matrix All-Pass Filters Using Subspace Nevanlinna Pick Interpolation

abstract: Unitary matrix-valued functions of frequency are matrix all-pass systems, since they preserve the norm of the input vector signals. Typically, such systems are represented and analyzed using their unitary-matrix valued frequency domain characteristics, although obtaining rational realizations for matrix all-pass systems enables compact representations and efficient implementations. However, an approach to obtain matrix all-pass filters that satisfy phase constraints at certain frequencies was hitherto unknown. In this paper, we present an interpolation strategy to obtain a rational matrix-valued transfer function from frequency domain constraints for discrete-time matrix all-pass systems. Using an extension of the Subspace Nevanlinna Pick Interpolation Problem (SNIP), we design a construction for discrete-time matrix all-pass systems that satisfy the desired phase characteristics. An innovation that enables this is the extension of the SNIP to the boundary case to obtain efficient time-domain implementations of matrix all-pass filters as matrix linear constant coefficient difference equations, facilitated by a rational (realizable) matrix transfer function. We also show that the derivative of matrix phase constraints, related to the group delay at the interpolating points, can be optimized to control the all-pass transfer matrices at the unspecified frequencies. Simulations show that the proposed technique for unitary matrix filter design performs as well as traditional DFT based interpolation approaches, including Geodesic interpolation and the popular Givens rotation based matrix parameterization.


title: Shortest Edit Path Crossover: A Theory-driven Solution to the Permutation Problem in Evolutionary Neural Architecture Search

abstract: Population-based search has recently emerged as a possible alternative to Reinforcement Learning (RL) for black-box neural architecture search (NAS). It performs well in practice even though it is not theoretically well understood. In particular, whereas traditional population-based search methods such as evolutionary algorithms (EAs) draw much power from crossover operations, it is difficult to take advantage of them in NAS. The main obstacle is believed to be the permutation problem: The mapping between genotype and phenotype in traditional graph representations is many-to-one, leading to a disruptive effect of standard crossover. This paper presents the first theoretical analysis of the behaviors of mutation, crossover and RL in black-box NAS, and proposes a new crossover operator based on the shortest edit path (SEP) in graph space. The SEP crossover is shown theoretically to overcome the permutation problem, and as a result, have a better expected improvement compared to mutation, standard crossover and RL. Further, it empirically outperform these other methods on state-of-the-art NAS benchmarks. The SEP crossover therefore allows taking full advantage of population-based search in NAS, and the underlying theory can serve as a foundation for deeper understanding of black-box NAS methods in general.


title: Three innovations of next-generation antibiotics: evolvability, specificity, and non-immunogenicity

abstract: Antimicrobial resistance is a silent pandemic that is being exacerbated by the uncontrolled use of antibiotics. Since the discovery of penicillin, we have been largely dependent on microbe-derived small molecules to treat bacterial infections. However, the golden era of antibiotics is coming to an end as the emergence and spread of antimicrobial resistance against these antibacterial compounds is outpacing the discovery and development of new antibiotics. The current antibiotic market suffers from various shortcomings, including the absence of profitability and investment. However, the most important underlying issue of traditional antibiotics arises from the inherent properties of these small molecules being mostly broad-spectrum and non-programmable. As the scientific knowledge of microbes progresses, the scientific community is starting to explore entirely novel approaches to tackling antimicrobial resistance. One of the most prominent approaches is to develop next-generation antibiotics. In this review, we discuss three innovations of next-generation antibiotics compared to traditional antibiotics as specificity, evolvability, and non-immunogenicity. We present a number of potential antimicrobial agents, including bacteriophage-based therapy, CRISPR-Cas-based antimicrobials, and microbiome-derived antimicrobial compounds. These alternative antimicrobial agents possess innovative properties that may overcome the inherent shortcomings of traditional antibiotics, and some of these next-generation antibiotics are not merely far-fetched ideas but are currently in clinical development. We further discuss some related issues and challenges such as infection diagnostics and regulatory frameworks that still need to be addressed to bring these next-generation antibiotics to the antibiotic market as viable products to combat antimicrobial resistance using a diversified set of strategies.


title: A White-Box Adversarial Attack Against a Digital Twin

abstract: Recent research has shown that Machine Learning/Deep Learning (ML/DL) models are particularly vulnerable to adversarial perturbations, which are small changes made to the input data in order to fool a machine learning classifier. The Digital Twin, which is typically described as consisting of a physical entity, a virtual counterpart, and the data connections in between, is increasingly being investigated as a means of improving the performance of physical entities by leveraging computational techniques, which are enabled by the virtual counterpart. This paper explores the susceptibility of Digital Twin (DT), a virtual model designed to accurately reflect a physical object using ML/DL classifiers that operate as Cyber Physical Systems (CPS), to adversarial attacks. As a proof of concept, we first formulate a DT of a vehicular system using a deep neural network architecture and then utilize it to launch an adversarial attack. We attack the DT model by perturbing the input to the trained model and show how easily the model can be broken with white-box attacks.


title: The Curious Case of Benign Memorization

abstract: Despite the empirical advances of deep learning across a variety of learning tasks, our theoretical understanding of its success is still very restricted. One of the key challenges is the overparametrized nature of modern models, enabling complete overfitting of the data even if the labels are randomized, i.e. networks can completely \textit{memorize} all given patterns. While such a memorization capacity seems worrisome, in this work we show that under training protocols that include \textit{data augmentation}, neural networks learn to memorize entirely random labels in a benign way, i.e. they learn embeddings that lead to highly non-trivial performance under nearest neighbour probing. We demonstrate that deep models have the surprising ability to separate noise from signal by distributing the task of memorization and feature learning to different layers. As a result, only the very last layers are used for memorization, while preceding layers encode performant features which remain largely unaffected by the label noise. We explore the intricate role of the augmentations used for training and identify a memorization-generalization trade-off in terms of their diversity, marking a clear distinction to all previous works. Finally, we give a first explanation for the emergence of benign memorization by showing that \textit{malign} memorization under data augmentation is infeasible due to the insufficient capacity of the model for the increased sample size. As a consequence, the network is forced to leverage the correlated nature of the augmentations and as a result learns meaningful features. To complete the picture, a better theory of feature learning in deep neural networks is required to fully understand the origins of this phenomenon.


title: A parametrized quasi-normal mode framework for non-Schwarzschild metrics

abstract: In this work we comment in more detail on what happens to the parametrized framework first presented by Cardoso et al. when there are departures from the Schwarzschild background metric, as well as possible deviations in the "dynamics". We treat possible deviations in the background metric with additional coefficients with respect to the original works. The advantages of this reformulation are clear when applied to a parameter estimation problem, since the coefficients are always real, and many of them do not depend on the overtone number and angular momentum of the frequency, thus eventually reducing the total amount of parameters to be inferred.


title: Improving Group Lasso for high-dimensional categorical data

abstract: Sparse modelling or model selection with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known efficient algorithm for selection continuous or categorical variables, but all estimates related to a selected factor usually differ. Therefore, a fitted model may not be sparse, which makes the model interpretation difficult. To obtain a sparse solution of the Group Lasso we propose the following two-step procedure: first, we reduce data dimensionality using the Group Lasso; then to choose the final model we use an information criterion on a small family of models prepared by clustering levels of individual factors. We investigate selection correctness of the algorithm in a sparse high-dimensional scenario. We also test our method on synthetic as well as real datasets and show that it performs better than the state of the art algorithms with respect to the prediction accuracy or model dimension.


title: A Hybrid Microscopic Model for Multimodal Traffic with Empirical Observations from Aerial Footage

abstract: Microscopic traffic flow models can be distinguished in lane-based or lane-free depending on the degree of lane-discipline. This distinction holds true only if motorcycles are neglected in lane-based traffic. In cities, as opposed to highways, this is an oversimplification and it would be more accurate to speak of hybrid situations, where lane discipline can be made mode-dependent. Empirical evidence shows that cars follow the lanes as defined by the infrastructure, while motorcycles do not necessarily adhere to predefined norms and may participate in self-organized formation of virtual lanes. This phenomenon is the result of complex interactions between different traffic participants competing for limited space. In order to better understand the dynamics of modal interaction microscopically, we first analyze empirical data from detailed trajectories obtained by the pNEUMA experiment and observe patterns of mixed traffic. Then, we propose a hybrid model for multimodal vehicular traffic. The hybrid model is inspired by the pedestrian flow literature, featuring collision-free and anticipatory properties, and we demonstrate that it is able to reproduce empirical observations from aerial footage.


title: On norm inequalities related to the geometric mean

abstract: Let $A_i$ and $B_i$ be positive definite matrices for all $i=1,\cdots,m.$ It is shown that $$\left|\left|\sum_{i=1}^m(A_i^2\sharp B_i^2)^r\right|\right|_1\leq\left|\left|\left(\left(\sum_{i=1}^mA_i\right)^{\frac{pr}{_2}}\left(\sum_{i=1}^mB_i\right)^{pr}\left(\sum_{i=1}^mA_i\right)^{\frac{rp}{_2}}\right)^{\frac{1}{p}}\right|\right|_1,$$for all $p>0$ and for all $r\geq1.$ We conjecture this inequality is also true for all unitarily invariant norms. We give an affirmative answer to the case of $m=2,$ $p\geq1$, $r\geq1$ and for all unitarily invariant norms. In other words, it is shown that $$\left|\left|\left|\left(A^{^2}\sharp B^{^2}\right)^{r}+\left(C^{^2}\sharp D^{^2}\right)^{r}\right|\right|\right|\leq \left|\left|\left|\left(\left(A+C\right)^{^\frac{rp}{_2}}\left(B+D\right)^{{rp}}\left(A+C\right)^{^\frac{rp}{_2}}\right)^{\frac{1}{_p}}\right|\right|\right|,$$for all unitarly invariant norms, for all $p\geq1$ and for all $r\geq1$, where $A,B,C,D$ are positive definite matrices. This gives an affirmative answer to the conjecture posed by Dinh, Ahsani and Tam in the case of $m=2$. The preceding inequalities directly lead to a recent result of Audenaert \cite{ANIFP}.


title: Liouville Type Theorem about $p$-harmonic 1 form, $p$-harmonic map and harmonic $ q $ form

abstract: In this paper, we will use the normalized intetral Ricci curvature to investigate Liouville type property of $ p $ harmonic function on Riemannian manifold. secondly, we will use the BiRic curvature to obtian Liuville theorem for $ p $ harmonic function or $ p $ harmonic 1 form. Lastly, we we will use the BiRic curvature to obtian Liouville theorem forharmonic $ q(q\geq 2)$ form.


title: Tidal Deformability of Neutron Stars in Scalar-Tensor Theories of Gravity

abstract: Gravitational waves from compact binary coalescences are valuable for testing theories of gravity in the strong field regime. By measuring neutron star tidal deformability using gravitational waves from binary neutron stars, stringent constraints were placed on the equation of state of matter at extreme densities. Tidal Love numbers in alternative theories of gravity may differ significantly from their general relativistic counterparts. Understanding exactly how the tidal Love numbers change will enable scientists to untangle physics beyond general relativity from the uncertainty in the equation of state measurement. In this work, we explicitly calculate the fully relativistic $l \geq 2$ tidal love numbers for neutron stars in scalar-tensor theories of gravitation. We use several realistic equations of state to explore how the mass, radius, and tidal deformability relations differ from those of general relativity. We find that tidal Love numbers and tidal deformabilities can differ significantly from those in general relativity in certain regimes. The electric tidal deformability can differ by $\sim 200\%$, and the magnetic tidal deformability differs by $\sim 300 \%$. These deviations occur at large compactnesses ($C = M/r \gtrsim 0.2$) and vary slightly depending on the equation of state. This difference suggests that using the tidal Love numbers from general relativity could lead to significant errors in tests of general relativity using the gravitational waves from binary neutron star and neutron-star--black-hole mergers.


title: SWIFT: Rapid Decentralized Federated Learning via Wait-Free Model Communication

abstract: The decentralized Federated Learning (FL) setting avoids the role of a potentially unreliable or untrustworthy central host by utilizing groups of clients to collaboratively train a model via localized training and model/gradient sharing. Most existing decentralized FL algorithms require synchronization of client models where the speed of synchronization depends upon the slowest client. In this work, we propose SWIFT: a novel wait-free decentralized FL algorithm that allows clients to conduct training at their own speed. Theoretically, we prove that SWIFT matches the gold-standard iteration convergence rate $\mathcal{O}(1/\sqrt{T})$ of parallel stochastic gradient descent for convex and non-convex smooth optimization (total iterations $T$). Furthermore, we provide theoretical results for IID and non-IID settings without any bounded-delay assumption for slow clients which is required by other asynchronous decentralized FL algorithms. Although SWIFT achieves the same iteration convergence rate with respect to $T$ as other state-of-the-art (SOTA) parallel stochastic algorithms, it converges faster with respect to run-time due to its wait-free structure. Our experimental results demonstrate that SWIFT's run-time is reduced due to a large reduction in communication time per epoch, which falls by an order of magnitude compared to synchronous counterparts. Furthermore, SWIFT produces loss levels for image classification, over IID and non-IID data settings, upwards of 50% faster than existing SOTA algorithms.


title: Search for the chiral magnetic wave using anisotropic flow of identified particles at RHIC

abstract: The chiral magnetic wave (CMW) has been theorized to propagate in the deconfined nuclear medium formed in high-energy heavy-ion collisions, and to cause a difference in elliptic flow ($v_{2}$) between negatively and positively charged hadrons. Experimental data consistent with the CMW have been reported by the STAR Collaboration at the Relativistic Heavy Ion Collider (RHIC), based on the charge asymmetry dependence of the pion $v_{2}$ from Au+Au collisions at $\sqrt{s_{\rm NN}}$ = 27 to 200 GeV. In this comprehensive study, we present the STAR measurements of elliptic flow and triangular flow of charged pions, along with the $v_{2}$ of charged kaons and protons, as a function of charge asymmetry in Au+Au collisions at $\sqrt{s_{\rm NN}}$ = 27, 39, 62.4 and 200 GeV. The slope parameters extracted from the linear dependence of the $v_2$ difference on charge asymmetry for different particle species are reported and compared in different centrality intervals. In addition, the slopes of $v_{2}$ for charged pions in small systems, \textit{i.e.}, $p$+Au and $d$+Au at $\sqrt{s_{\rm NN}}$ = 200 GeV, are also presented and compared with those in large systems, \textit{i.e.}, Au+Au at $\sqrt{s_{\rm NN}}$ = 200 GeV and U+U at 193 GeV. Our results provide new insights for the possible existence of the CMW, and further constrain the background contributions in heavy-ion collisions at RHIC energies.


title: Metal-silicate partitioning of W and Mo and the role of carbon in controlling their abundances in the Bulk Silicate Earth

abstract: The liquid metal-liquid silicate partitioning of molybdenum and tungsten during core formation must be well-constrained in order to understand the evolution of Earth and other planetary bodies, in particular because the Hf-W isotopic system is used to date early planetary evolution. We combine 48 new high pressure and temperature experimental results with a comprehensive database of previous experiments to re-examine the systematics of Mo and W partitioning. W partitioning is particularly sensitive to silicate and metallic melt compositions and becomes more siderophile with increasing temperature. We show that W has a 6+ oxidation state in silicate melts over the full experimental fO2 range of $\Delta$IW -1.5 to -3.5. Mo has a 4+ oxidation state and its partitioning is less sensitive to silicate melt composition, but also depends on metallic melt composition. DMo stays approximately constant with increasing depth in Earth. Both W and Mo become more siderophile with increasing C content of the metal, so we fit epsilon interaction parameters. W and Mo along with C are incorporated into a combined N-body accretion and core-mantle differentiation model. We show that W and Mo require the early accreting Earth to be sulfur-depleted and carbon-enriched so that W and Mo are efficiently partitioned into Earth's core and do not accumulate in the mantle. If this is the case, the produced Earth-like planets possess mantle compositions matching the BSE for all simulated elements. However, there are two distinct groups of estimates of the bulk mantle's C abundance in the literature: low (100 ppm), and high (800 ppm), and all models are consistent with the higher estimated carbon abundance. The low BSE C abundance would be achievable when the effects of the segregation of dispersed metal droplets produced in deep magma oceans by the disproportionation of Fe2+ to Fe3+ plus metallic Fe is considered.


title: The limits of rechargeable spin battery

abstract: We discuss how the ideal rechargeable energy accumulator can be made, and what are the limits for solid state energy storage. We show that in theory the spin batteries based on heavy fermions can surpass the chemical ones by energy capacitance. The absence of chemical reactions in spin batteries makes them more stable, also they don't need to be heated in cold conditions. We study how carriers statistics and density of states affect energy capacity of the battery. Also, we discuss hypothetical spin batteries based on neutron stars.


title: UNIFY: a Unified Policy Designing Framework for Solving Constrained Optimization Problems with Machine Learning

abstract: The interplay between Machine Learning (ML) and Constrained Optimization (CO) has recently been the subject of increasing interest, leading to a new and prolific research area covering (e.g.) Decision Focused Learning and Constrained Reinforcement Learning. Such approaches strive to tackle complex decision problems under uncertainty over multiple stages, involving both explicit (cost function, constraints) and implicit knowledge (from data), and possibly subject to execution time restrictions. While a good degree of success has been achieved, the existing methods still have limitations in terms of both applicability and effectiveness. For problems in this class, we propose UNIFY, a unified framework to design a solution policy for complex decision-making problems. Our approach relies on a clever decomposition of the policy in two stages, namely an unconstrained ML model and a CO problem, to take advantage of the strength of each approach while compensating for its weaknesses. With a little design effort, UNIFY can generalize several existing approaches, thus extending their applicability. We demonstrate the method effectiveness on two practical problems, namely an Energy Management System and the Set Multi-cover with stochastic coverage requirements. Finally, we highlight some current challenges of our method and future research directions that can benefit from the cross-fertilization of the two fields.


title: A Comparative Study on Deep-Learning Methods for Dense Image Matching of Multi-angle and Multi-date Remote Sensing Stereo Images

abstract: Deep learning (DL) stereo matching methods gained great attention in remote sensing satellite datasets. However, most of these existing studies conclude assessments based only on a few/single stereo images lacking a systematic evaluation on how robust DL methods are on satellite stereo images with varying radiometric and geometric configurations. This paper provides an evaluation of four DL stereo matching methods through hundreds of multi-date multi-site satellite stereo pairs with varying geometric configurations, against the traditional well-practiced Census-SGM (Semi-global matching), to comprehensively understand their accuracy, robustness, generalization capabilities, and their practical potential. The DL methods include a learning-based cost metric through convolutional neural networks (MC-CNN) followed by SGM, and three end-to-end (E2E) learning models using Geometry and Context Network (GCNet), Pyramid Stereo Matching Network (PSMNet), and LEAStereo. Our experiments show that E2E algorithms can achieve upper limits of geometric accuracies, while may not generalize well for unseen data. The learning-based cost metric and Census-SGM are rather robust and can consistently achieve acceptable results. All DL algorithms are robust to geometric configurations of stereo pairs and are less sensitive in comparison to the Census-SGM, while learning-based cost metrics can generalize on satellite images when trained on different datasets (airborne or ground-view).


title: Whitening Convergence Rate of Coupling-based Normalizing Flows

abstract: Coupling-based normalizing flows (e.g. RealNVP) are a popular family of normalizing flow architectures that work surprisingly well in practice. This calls for theoretical understanding. Existing work shows that such flows weakly converge to arbitrary data distributions. However, they make no statement about the stricter convergence criterion used in practice, the maximum likelihood loss. For the first time, we make a quantitative statement about this kind of convergence: We prove that all coupling-based normalizing flows perform whitening of the data distribution (i.e. diagonalize the covariance matrix) and derive corresponding convergence bounds that show a linear convergence rate in the depth of the flow. Numerical experiments demonstrate the implications of our theory and point at open questions.


title: Generalised Fisher Information Approach to Defective Fokker-Planck Equations

abstract: The goal of this work is to introduce and investigate a generalised Fisher Information in the setting of linear Fokker-Planck equations. This functional, which depends on two functions instead of one, exhibits the same decay behaviour as the standard Fisher information, and allows us to investigate different parts of the Fokker-Planck solution via an appropriate decomposition. Focusing almost exclusively on Fokker-Planck equations with constant drift and diffusion matrices, we will use a modification of the well established Bakry-Emery method with this newly defined functional to conclude the sharp long time behaviour of relative entropies of solutions to such equations when the diffusion matrix is positive definite and the drift matrix is defective. This novel approach is different to previous techniques, such as those presented in the authors' previous work, which relied heavily on spectral theory.


title: Theory of Charge Regulation of Colloidal Particles in Electrolyte Solutions

abstract: We present a theory that enables us to calculate the effective surface charge of colloidal particles and to efficiently obtain titration curves for different salt concentrations. The theory accounts for the shift of pH of solution due to the presence of 1:1 electrolyte. It also accounts self-consistently for the electrostatic potential produced by the deprotonated surface groups. To examine the accuracy of the theory we have performed extensive reactive Monte Carlo simulations, which show excellent agreement between theory and simulations without any adjustable parameters.