title: Inverting elastic dislocations using the Weakly-enforced Slip Method

abstract: Earthquakes cause lasting changes in static equilibrium, resulting in global deformation fields that can be observed. Consequently, deformation measurements such as those provided by satellite based InSAR monitoring can be used to infer an earthquake's faulting mechanism. This inverse problem requires a numerical forward model that is both accurate and fast, as typical inverse procedures require many evaluations. The Weakly-enforced Slip Method (WSM) was developed to meet these needs, but it was not before applied in an inverse problem setting. Consequently, it was unknown what effect particular properties of the WSM, notably its inherent continuity, have on the inversion process. Here we show that the WSM is able to accurately recover slip distributions in a Bayesian-inference setting, provided that data points in the vicinity of the fault are removed. In a representative scenario, an element size of 2 km was found to be sufficiently fine to generate a posterior probability distribution that is close to the theoretical optimum. For rupturing faults a masking zone of 20 km sufficed to avoid numerical disturbances that would otherwise be induced by the discretization error. These results demonstrate that the WSM is a viable forward method for earthquake inversion problems. While our synthesized scenario is basic for reasons of validation, our results are expected to generalize to the wider gamut of scenarios that finite element methods are able to capture. This has the potential to bring modeling flexibility to a field that if often forced to impose model restrictions in a concession to computability.


title: Universal approximation and model compression for radial neural networks

abstract: We introduce a class of fully-connected neural networks whose activation functions, rather than being pointwise, rescale feature vectors by a function depending only on their norm. We call such networks radial neural networks, extending previous work on rotation equivariant networks that considers rescaling activations in less generality. We prove universal approximation theorems for radial neural networks, including in the more difficult cases of bounded widths and unbounded domains. Our proof techniques are novel, distinct from those in the pointwise case. Additionally, radial neural networks exhibit a rich group of orthogonal change-of-basis symmetries on the vector space of trainable parameters. Factoring out these symmetries leads to a practical lossless model compression algorithm. Optimization of the compressed model by gradient descent is equivalent to projected gradient descent for the full model.


title: Implementation of RPL in OMNeT++

abstract: The growth and evolution of Internet of Things (IoT) is now of paramount importance for next-generation networks, including the upcoming 6G. In particular, there is a set of constrained IoT nodes that comprise the Low-Power and Lossy Networks (LLNs), which have very particular requirements. The current standard for routing in those networks is RPL, which was defined less than a decade ago and still needs improvements in terms of scalability or integration with other networks. Many researchers currently need an implementation of RPL to evaluate their works and, for that reason, among others, we implemented it in the OMNeT++ simulator. The results of this implementation show that is an easy way to check prototypes in their very initial develop phases, and its code is publicly available for the research community.


title: The polynomial closure is not topological

abstract: We characterize the polynomial closure of a pseudo-convergent sequence in a valuation domain $V$ of arbitrary rank, and then we use this result to show that the polynomial closure is never topological when $V$ has rank at least $2$.


title: Prediction of high-Tc superconductivity in ternary lanthanum borohydrides

abstract: The study of superconductivity in compressed hydrides is of great interest due to measurements of high critical temperatures (Tc) in the vicinity of room temperature, beginning with the observations of LaH10 at 170-190 GPa. However, the pressures required for synthesis of these high Tc superconducting hydrides currently remain extremely high. Here we show the investigation of crystal structures and superconductivity in the La-B-H system under pressure with particle-swarm intelligence structure searches methods in combination with first-principles calculations. Structures with six stoichiometries, LaBH, LaBH3, LaBH4, LaBH6, LaBH7 and LaBH8, were predicted to become stable under pressure. Remarkably, the hydrogen atoms in LaBH8 were found to bond with B atoms in a manner that is similar to that in H3S. Lattice dynamics calculations indicate that LaBH7 and LaBH8 become dynamically stable at pressures as low as 109.2 and 48.3 GPa, respectively. Moreover, the two phases were predicted to be superconducting with a critical temperature (Tc) of 93 K and 156 K at 110 GPa and 55 GPa, respectively. Our results provide guidance for future experiments targeting new hydride superconductors with both low synthesis pressures and high Tc.


title: On the Hardness of Compressing Weights

abstract: We investigate computational problems involving large weights through the lens of kernelization, which is a framework of polynomial-time preprocessing aimed at compressing the instance size. Our main focus is the weighted Clique problem, where we are given an edge-weighted graph and the goal is to detect a clique of total weight equal to a prescribed value. We show that the weighted variant, parameterized by the number of vertices $n$, is significantly harder than the unweighted problem by presenting an $O(n^{3 - \varepsilon})$ lower bound on the size of the kernel, under the assumption that NP $\not \subseteq$ coNP/poly. This lower bound is essentially tight: we show that we can reduce the problem to the case with weights bounded by $2^{O(n)}$, which yields a randomized kernel of $O(n^3)$ bits. We generalize these results to the weighted $d$-Uniform Hyperclique problem, Subset Sum, and weighted variants of Boolean Constraint Satisfaction Problems (CSPs). We also study weighted minimization problems and show that weight compression is easier when we only want to preserve the collection of optimal solutions. Namely, we show that for node-weighted Vertex Cover on bipartite graphs it is possible to maintain the set of optimal solutions using integer weights from the range $[1, n]$, but if we want to maintain the ordering of the weights of all inclusion-minimal solutions, then weights as large as $2^{\Omega(n)}$ are necessary.


title: A Theory of the Distortion-Perception Tradeoff in Wasserstein Space

abstract: The lower the distortion of an estimator, the more the distribution of its outputs generally deviates from the distribution of the signals it attempts to estimate. This phenomenon, known as the perception-distortion tradeoff, has captured significant attention in image restoration, where it implies that fidelity to ground truth images comes at the expense of perceptual quality (deviation from statistics of natural images). However, despite the increasing popularity of performing comparisons on the perception-distortion plane, there remains an important open question: what is the minimal distortion that can be achieved under a given perception constraint? In this paper, we derive a closed form expression for this distortion-perception (DP) function for the mean squared-error (MSE) distortion and the Wasserstein-2 perception index. We prove that the DP function is always quadratic, regardless of the underlying distribution. This stems from the fact that estimators on the DP curve form a geodesic in Wasserstein space. In the Gaussian setting, we further provide a closed form expression for such estimators. For general distributions, we show how these estimators can be constructed from the estimators at the two extremes of the tradeoff: The global MSE minimizer, and a minimizer of the MSE under a perfect perceptual quality constraint. The latter can be obtained as a stochastic transformation of the former.


title: Critical intermittency in random interval maps

abstract: Critical intermittency stands for a type of intermittent dynamics in iterated function systems, caused by an interplay of a superstable fixed point and a repelling fixed point. We consider critical intermittency for iterated function systems of interval maps and demonstrate the existence of a phase transition when varying probabilities, where the absolutely continuous stationary measure changes between finite and infinite. We discuss further properties of this stationary measure and show that its density is not in $L^q$ for any $q > 1$. This provides a theory of critical intermittency alongside the theory for the well studied Manneville-Pomeau maps, where the intermittency is caused by a neutral fixed point.


title: Coarse-to-fine Semantic Localization with HD Map for Autonomous Driving in Structural Scenes

abstract: Robust and accurate localization is an essential component for robotic navigation and autonomous driving. The use of cameras for localization with high definition map (HD Map) provides an affordable localization sensor set. Existing methods suffer from pose estimation failure due to error prone data association or initialization with accurate initial pose requirement. In this paper, we propose a cost-effective vehicle localization system with HD map for autonomous driving that uses cameras as primary sensors. To this end, we formulate vision-based localization as a data association problem that maps visual semantics to landmarks in HD map. Specifically, system initialization is finished in a coarse to fine manner by combining coarse GPS (Global Positioning System) measurement and fine pose searching. In tracking stage, vehicle pose is refined by implicitly aligning the semantic segmentation result between image and landmarks in HD maps with photometric consistency. Finally, vehicle pose is computed by pose graph optimization in a sliding window fashion. We evaluate our method on two datasets and demonstrate that the proposed approach yields promising localization results in different driving scenarios. Additionally, our approach is suitable for both monocular camera and multi-cameras that provides flexibility and improves robustness for the localization system.


title: Understanding Physics: 'What?', 'Why?', and 'How?'

abstract: I want to combine two hitherto largely independent research projects, scientific understanding and mechanistic explanations. Understanding is not only achieved by answering why-questions, that is, by providing scientific explanations, but also by answering what-questions, that is, by providing what I call scientific descriptions. Based on this distinction, I develop three forms of understanding: understanding-what, understanding-why, and understanding-how. I argue that understanding-how is a particularly deep form of understanding, because it is based on mechanistic explanations, which answer why something happens in virtue of what it is made of. I apply the three forms of understanding to two case studies: first, to the historical development of thermodynamics and, second, to the differences between the Clausius and the Boltzmann entropy in explaining thermodynamic processes.


title: Radiation and Scattering of EM Waves in Large Plasmas Around Objects in Hypersonic Flight

abstract: Hypersonic flight regime is conventionally defined for Mach larger than 5; in these conditions, the flying object becomes enveloped in a plasma. This plasma is densest in thin surface layers, but in typical situations of interest it impacts electromagnetic wave propagation in an electrically large volume. We address this problem with a hybrid approach. We employ Equivalence Theorem to separate the inhomogeneous plasma region from the surrounding free space via an equivalent (Huygens) surface, and the Eikonal approximation to Maxwell equations in the large inhomogeneous region for obtaining equivalent currents on the separating surface. Then, we obtain the scattered field via (exact) free space radiation of these surface equivalent currents. The method is extensively tested against reference results and then applied to a real-life re-entry vehicle with full 3D plasma computed via Computational Fluid Dynamic (CFD) simulations. We address both scattering (RCS) from the entire vehicle and radiation from the on-board antennas. From our results, significant radio link path losses can be associated with plasma spatial variations (gradients) and collisional losses, to an extent that matches well the usually perceived blackout in crossing layers in cutoff. Furthermore, we find good agreement with existing literature concerning significant alterations of the radar response (RCS) due to the plasma envelope.


title: Co-existence of short- and long-range magnetic order in LaCo$_2$P$_2$

abstract: The ferromagnetic (FM) nature of the metallic LaCo$_2$P$_2$ was investigated with the positive muon spin rotation, relaxation and resonance ($\mu^+$SR) technique. Transverse and zero field $\mu^+$SR measurements revealed that the compound enters a long range FM ground state at $T_{\rm C}=130.91(65)$~K, consistent with previous studies. Based on the reported FM structure, the internal magnetic field was computed at the muon sites, which were predicted with first principles calculations. The computed result agree well with the experimental data. Moreover, although LaCo$_2$P$_2$ is a paramagnet at higher temperatures $T>160$~K, it enters a short range ordered (SRO) magnetic phase for $T_{\rm C}<T\leq160$~K. Measurements below the vicinity of $T_{\rm C}$ revealed that the SRO phase co-exists with the long range FM order at temperatures $124\leq T\leq T_{\rm C}$. Such co-existence is an intrinsic property and stems from competition between the 2D and 3D interactions/fluctuations.


title: Rethinking Positional Encoding

abstract: It is well noted that coordinate based MLPs benefit -- in terms of preserving high-frequency information -- through the encoding of coordinate positions as an array of Fourier features. Hitherto, the rationale for the effectiveness of these positional encodings has been solely studied through a Fourier lens. In this paper, we strive to broaden this understanding by showing that alternative non-Fourier embedding functions can indeed be used for positional encoding. Moreover, we show that their performance is entirely determined by a trade-off between the stable rank of the embedded matrix and the distance preservation between embedded coordinates. We further establish that the now ubiquitous Fourier feature mapping of position is a special case that fulfills these conditions. Consequently, we present a more general theory to analyze positional encoding in terms of shifted basis functions. To this end, we develop the necessary theoretical formulae and empirically verify that our theoretical claims hold in practice. Codes available at https://github.com/osiriszjq/Rethinking-positional-encoding.


title: Instability of the charged massive scalar field on the Kerr-Newman black hole spacetime

abstract: We investigate the quasibound states of charged massive scalar fields in the Kerr-Newman black hole spacetime by using a new approach recently developed, which uses the polynomial conditions of the Heun functions. We calculate the resonant frequencies related to the spectrum of quasibound states, as well as its corresponding angular and radial wave eigenfunctions. We also analyze the instability of the system. These results are particularized to the cases of Schwarzschild and Kerr black holes. Additionally, we compare our analytical results with the numerical ones known in the literature. Finally, we apply the obtained results to compute the characteristic times of growth and decay of bosonic particles around a supermassive black hole situated at the center of the M87 galaxy.


title: Enormous nuclear surface diffuseness in the exotic Ne and Mg isotopes

abstract: The density profile of exotic nuclei can be a rich source of information on the nuclear surface. In particular, the nuclear surface diffuseness parameter is correlated with the occupation probability of nucleons indistinct nuclear orbits, especially those with low angular momenta. The aim of this paper is to investigate the relationship between the nuclear surface diffuseness and spectroscopic information of neutron rich Ne and Mg isotopes both at the cusp and inside the island of inversion. We use the microscopic antisymmetrized molecular dynamics model to calculate these densities and other spectroscopic information. A two-parameter Fermi density distribution is then used to define the diffuseness parameter. To relate them with observables, the nucleon-nucleus elastic scattering differential cross section is calculated with the demand that they reproduce the first peak position and its magnitude. A marked increase in the occupation of neutrons in the pf-orbit is noted in Ne and Mg isotopes from N=19 onwards. We observed that the nuclear diffuseness is strongly correlated with the nuclear deformation, in the island of inversion, and gradually increases with the occupation of neutrons in the 1p3/2 orbit. This result is also confirmed by a single-particle estimate of the valence neutron density distribution. An exception is noted for 35-37Mg, where the filling up of the holes in the sd-shell partially compensates the increase in diffuseness due to filling up of the 1p3/2 orbit. Information on nuclear density profile of neutron rich medium mass nuclei can be reliably extracted by studying the first diffraction peak of the nucleon-nucleus elastic scattering differential cross section. The enormous surface diffuseness of Ne and Mg isotopes, in the island of inversion, could be attributed to the increasing neutron occupation of the 1p3/2 orbit.


title: On quantum deformations of $AdS_3 \times S^3 \times T^4$ and mirror duality

abstract: We consider various integrable two-parameter deformations of the $AdS_3 \times S^3 \times T^4$ superstring with quantum group symmetry. Working on the string worldsheet in light-cone gauge and to quadratic order in fermions, we obtain their common massive tree-level two-body S matrix, which matches the expansion of the conjectured exact $q$-deformed S matrix. We then analyze the behavior of the exact S matrix under mirror transformation -- a double Wick rotation on the worldsheet -- and find that it satisfies a mirror duality relation analogous to the distinguished $q$-deformed $AdS_5 \times S^5$ S matrix in the one parameter deformation limit. Finally, we show that the fermionic $q$-deformed $AdS_5 \times S^5$ S matrix also satisfies such a relation.


title: Prioritized training on points that are learnable, worth learning, and not yet learned (workshop version)

abstract: We introduce Goldilocks Selection, a technique for faster model training which selects a sequence of training points that are "just right". We propose an information-theoretic acquisition function -- the reducible validation loss -- and compute it with a small proxy model -- GoldiProx -- to efficiently choose training points that maximize information about a validation set. We show that the "hard" (e.g. high loss) points usually selected in the optimization literature are typically noisy, while the "easy" (e.g. low noise) samples often prioritized for curriculum learning confer less information. Further, points with uncertain labels, typically targeted by active learning, tend to be less relevant to the task. In contrast, Goldilocks Selection chooses points that are "just right" and empirically outperforms the above approaches. Moreover, the selected sequence can transfer to other architectures; practitioners can share and reuse it without the need to recreate it.


title: Relational Quantum Mechanics and the PBR Theorem: A Peaceful Coexistence

abstract: According to Relational Quantum Mechanics (RQM) the wave function $\psi$ is considered neither a concrete physical item evolving in spacetime, nor an object representing the absolute state of a certain quantum system. In this interpretative framework, $\psi$ is defined as a computational device encoding observers' information; hence, RQM offers a somewhat epistemic view of the wave function. This perspective seems to be at odds with the PBR theorem, a formal result excluding that wave functions represent knowledge of an underlying reality described by some ontic state. In this paper we argue that RQM is not affected by the conclusions of PBR's argument; consequently, the alleged inconsistency can be dissolved. To do that, we will thoroughly discuss the very foundations of the PBR theorem, i.e. Harrigan and Spekkens' categorization of ontological models, showing that their implicit assumptions about the nature of the ontic state are incompatible with the main tenets of RQM. Then, we will ask whether it is possible to derive a relational PBR-type result, answering in the negative. This conclusion shows some limitations of this theorem not yet discussed in the literature.


title: On a tracial version of Haemers bound

abstract: We extend upper bounds on the quantum independence number and the quantum Shannon capacity of graphs to their counterparts in the commuting operator model. We introduce a von Neumann algebraic generalization of the fractional Haemers bound (over $\mathbb{C}$) and prove that the generalization upper bounds the commuting quantum independence number. We call our bound the tracial Haemers bound, and we prove that it is multiplicative with respect to the strong product. In particular, this makes it an upper bound on the Shannon capacity. The tracial Haemers bound is incomparable with the Lov\'asz theta function, another well-known upper bound on the Shannon capacity. We show that separating the tracial and fractional Haemers bounds would refute Connes' embedding conjecture. Along the way, we prove that the tracial rank and tracial Haemers bound are elements of the (commuting quantum) asymptotic spectrum of graphs (Zuiddam, Combinatorica, 2019). We also show that the inertia bound (an upper bound on the quantum independence number) upper bounds the commuting quantum independence number.


title: Confidence-based Out-of-Distribution Detection: A Comparative Study and Analysis

abstract: Image classification models deployed in the real world may receive inputs outside the intended data distribution. For critical applications such as clinical decision making, it is important that a model can detect such out-of-distribution (OOD) inputs and express its uncertainty. In this work, we assess the capability of various state-of-the-art approaches for confidence-based OOD detection through a comparative study and in-depth analysis. First, we leverage a computer vision benchmark to reproduce and compare multiple OOD detection methods. We then evaluate their capabilities on the challenging task of disease classification using chest X-rays. Our study shows that high performance in a computer vision task does not directly translate to accuracy in a medical imaging task. We analyse factors that affect performance of the methods between the two tasks. Our results provide useful insights for developing the next generation of OOD detection methods.


title: Self-training with noisy student model and semi-supervised loss function for dcase 2021 challenge task 4

abstract: This report proposes a polyphonic sound event detection (SED) method for the DCASE 2021 Challenge Task 4. The proposed SED model consists of two stages: a mean-teacher model for providing target labels regarding weakly labeled or unlabeled data and a self-training-based noisy student model for predicting strong labels for sound events. The mean-teacher model, which is based on the residual convolutional recurrent neural network (RCRNN) for the teacher and student model, is first trained using all the training data from a weakly labeled dataset, an unlabeled dataset, and a strongly labeled synthetic dataset. Then, the trained mean-teacher model predicts the strong label to each of the weakly labeled and unlabeled datasets, which is brought to the noisy student model in the second stage of the proposed SED model. Here, the structure of the noisy student model is identical to the RCRNN-based student model of the mean-teacher model in the first stage. Then, it is self-trained by adding feature noises, such as time-frequency shift, mixup, SpecAugment, and dropout-based model noise. In addition, a semi-supervised loss function is applied to train the noisy student model, which acts as label noise injection. The performance of the proposed SED model is evaluated on the validation set of the DCASE 2021 Challenge Task 4, and then, several ensemble models that combine five-fold validation models with different hyperparameters of the semi-supervised loss function are finally selected as our final models.


title: Practical I/O-Efficient Multiway Separators

abstract: We revisit the fundamental problem of I/O-efficiently computing $r$-way separators on planar graphs. An $r$-way separator divides a planar graph with $N$ vertices into $O(r)$ regions of size $O(N/r)$ and $O(\sqrt {Nr})$ boundary vertices in total, where boundary vertices are vertices that are adjacent to more than one region. Such separators are used in I/O-efficient solutions to many fundamental problems on planar graphs such as breadth-first search, finding single-source shortest paths, topological sorting, and finding strongly connected components. Our main result is an I/O-efficient sampling-based algorithm that, given a Koebe-embedding of a graph with $N$ vertices and a parameter $r$, computes an $r$-way separator for the graph under certain assumptions on the size of internal memory. Computing a Koebe-embedding of a planar graph is difficult in practice and no known I/O-efficient algorithm currently exists. Therefore, we show how our algorithm can be generalized and applied directly to Delaunay triangulations without relying on a Koebe-embedding. This adaptation can produce many boundary vertices in the worst-case, however, to our knowledge our result is the first to be implemented in practice due to the many non-trivial and complex techniques used in previous results. Furthermore, we show that our algorithm performs well on real-world data and that the number of boundary vertices is small in practice. Motivated by applications in geometric information systems, we show how our algorithm for Delaunay triangulations can be applied to compute the flow accumulation over a terrain, which models how much water flows over the vertices of a terrain. When given an $r$-way separator, our implementation of the algorithm outperforms traditional sweep-line-based algorithms on the publicly available digital elevation model of Denmark.


title: A note on degenerate generalized Laguerre polynomials and Lah numbers

abstract: The aim of this paper is to introduce the degenerate generalized Laguerre polynomials as the degenerate version of the generalized Laguerre polynomials and to derive some properties related to those polynomials and Lah numbers, including an explicit expression, a Rodrigues' type formula and expressions for the derivatives. The novelty of the present paper is that it is the first paper on degenerate versions of orthogonal polynomials.


title: Unsupervised Knowledge-Transfer for Learned Image Reconstruction

abstract: Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not available in medical imaging. To circumvent this issue we develop a novel unsupervised knowledge-transfer paradigm for learned reconstruction within a Bayesian framework. The proposed approach learns a reconstruction network in two phases. The first phase trains a reconstruction network with a set of ordered pairs comprising of ground truth images of ellipses and the corresponding simulated measurement data. The second phase fine-tunes the pretrained network to more realistic measurement data without supervision. By construction, the framework is capable of delivering predictive uncertainty information over the reconstructed image. We present extensive experimental results on low-dose and sparse-view computed tomography showing that the approach is competitive with several state-of-the-art supervised and unsupervised reconstruction techniques. Moreover, for test data distributed differently from the training data, the proposed framework can significantly improve reconstruction quality not only visually, but also quantitatively in terms of PSNR and SSIM, when compared with learned methods trained on the synthetic dataset only.


title: Irregular Invertible Bloom Look-Up Tables

abstract: We consider invertible Bloom lookup tables (IBLTs) which are probabilistic data structures that allow to store keyvalue pairs. An IBLT supports insertion and deletion of key-value pairs, as well as the recovery of all key-value pairs that have been inserted, as long as the number of key-value pairs stored in the IBLT does not exceed a certain number. The recovery operation on an IBLT can be represented as a peeling process on a bipartite graph. We present a density evolution analysis of IBLTs which allows to predict the maximum number of key-value pairs that can be inserted in the table so that recovery is still successful with high probability. This analysis holds for arbitrary irregular degree distributions and generalizes results in the literature. We complement our analysis by numerical simulations of our own IBLT design which allows to recover a larger number of key-value pairs as state-of-the-art IBLTs of same size.


title: Parton distribution functions beyond leading twist from lattice QCD: The $h_L(x)$ case

abstract: We report the first-ever calculation of the isovector flavor combination of the chiral-odd twist-3 parton distribution $h_L(x)$ for the proton from lattice QCD. We employ gauge configurations with two degenerate light, a strange and a charm quark ($N_f=2+1+1$) of maximally twisted mass fermions with a clover improvement. The lattice has a spatial extent of 3 fm and lattice spacing of 0.093 fm. The values of the quark masses lead to a pion mass of $260$ MeV. We use a source-sink time separation of 1.12 fm to control contamination from excited states. Our calculation is based on the quasi-distribution approach, with three values for the proton momentum: 0.83 GeV, 1.25 GeV, and 1.67 GeV. The lattice data are renormalized non-perturbatively using the RI$'$ scheme, and the final result for $h_L(x)$ is presented in the $\overline{\rm MS}$ scheme at the scale of 2 GeV. Furthermore, we compute in the same setup the transversity distribution, $h_1(x)$, which allows us, in particular, to compare $h_L(x)$ to its Wandzura-Wilczek approximation. We also combine results for the isovector and isoscalar flavor combinations to disentangle the individual quark contributions for $h_1(x)$ and $h_L(x)$, and address the Wandzura-Wilczek approximation in that case as well.


title: Contrastive Multimodal Fusion with TupleInfoNCE

abstract: This paper proposes a method for representation learning of multimodal data using contrastive losses. A traditional approach is to contrast different modalities to learn the information shared between them. However, that approach could fail to learn the complementary synergies between modalities that might be useful for downstream tasks. Another approach is to concatenate all the modalities into a tuple and then contrast positive and negative tuple correspondences. However, that approach could consider only the stronger modalities while ignoring the weaker ones. To address these issues, we propose a novel contrastive learning objective, TupleInfoNCE. It contrasts tuples based not only on positive and negative correspondences but also by composing new negative tuples using modalities describing different scenes. Training with these additional negatives encourages the learning model to examine the correspondences among modalities in the same tuple, ensuring that weak modalities are not ignored. We provide a theoretical justification based on mutual information for why this approach works, and we propose a sample optimization algorithm to generate positive and negative samples to maximize training efficacy. We find that TupleInfoNCE significantly outperforms the previous state of the arts on three different downstream tasks.


title: Comparing the effective enhancement of local and non-local spin-orbit couplings on honeycomb lattices due to strong electronic correlations

abstract: We investigate the interplay of electronic correlations and spin-orbit coupling (SOC) for a one-band and a two-band honeycomb lattice model. The main difference between the two models concerning SOC is that in the one-band case the SOC is a purely non-local term in the basis of the $p_z$ orbitals, whereas in the two-band case with $p_x$ and $p_y$ as basis functions it is purely local. In order to grasp the correlation effects on non-local spin-orbit coupling, we apply the TRILEX approach that allows to calculate non-local contributions to the self-energy approximatively. For the two-band case we apply dynamical mean-field theory. In agreement with previous studies, we find that for all parameter values in our study, the effect of correlations on the spin-orbit coupling strength is that the bare effective SOC parameter is increased. However, this increase is much weaker in the non-local than in the local SOC case. Concerning the TRILEX method, we introduce the necessary formulas for calculations with broken SU(2) symmetry.


title: Strong downward L\"owenheim-Skolem theorems for stationary logics, III -- mixed support iteration

abstract: Continuing [Fuchino, Ottenbreit and Sakai[9, 10]] and [Fuchino and Ottenbreit[11]], we further study reflection principles in connection with the L\"owenheim-Skolem Theorems of stationary logics. In this paper, we mainly analyze the situations in the models obtained by mixed support iteration of a supercompact length and then collapsing another supercompact cardinal to make it $(2^{\aleph_0})^+$. We show, among other things, that the reflection down to $< 2^{\aleph_0}$ of the non-metrizability of topological spaces with small character is independent from the reflection properties studied in [Fuchino, Ottenbreit and Sakai[9, 10]] and [Fuchino and Ottenbreit[11]].


title: Noisy Boolean Hidden Matching with Applications

abstract: The Boolean Hidden Matching (BHM) problem, introduced in a seminal paper of Gavinsky et. al. [STOC'07], has played an important role in the streaming lower bounds for graph problems such as triangle and subgraph counting, maximum matching, MAX-CUT, Schatten $p$-norm approximation, maximum acyclic subgraph, testing bipartiteness, $k$-connectivity, and cycle-freeness. The one-way communication complexity of the Boolean Hidden Matching problem on a universe of size $n$ is $\Theta(\sqrt{n})$, resulting in $\Omega(\sqrt{n})$ lower bounds for constant factor approximations to several of the aforementioned graph problems. The related (and, in fact, more general) Boolean Hidden Hypermatching (BHH) problem introduced by Verbin and Yu [SODA'11] provides an approach to proving higher lower bounds of $\Omega(n^{1-1/t})$ for integer $t\geq 2$. Reductions based on Boolean Hidden Hypermatching generate distributions on graphs with connected components of diameter about $t$, and basically show that long range exploration is hard in the streaming model of computation with adversarial arrivals. In this paper we introduce a natural variant of the BHM problem, called noisy BHM (and its natural noisy BHH variant), that we use to obtain higher than $\Omega(\sqrt{n})$ lower bounds for approximating several of the aforementioned problems in graph streams when the input graphs consist only of components of diameter bounded by a fixed constant. We also use the noisy BHM problem to show that the problem of classifying whether an underlying graph is isomorphic to a complete binary tree in insertion-only streams requires $\Omega(n)$ space, which seems challenging to show using BHM or BHH alone.


title: Numerical Matrix Decomposition

abstract: In 1954, Alston S. Householder published \textit{Principles of Numerical Analysis}, one of the first modern treatments on matrix decomposition that favored a (block) LU decomposition-the factorization of a matrix into the product of lower and upper triangular matrices. And now, matrix decomposition has become a core technology in machine learning, largely due to the development of the back propagation algorithm in fitting a neural network. The sole aim of this survey is to give a self-contained introduction to concepts and mathematical tools in numerical linear algebra and matrix analysis in order to seamlessly introduce matrix decomposition techniques and their applications in subsequent sections. However, we clearly realize our inability to cover all the useful and interesting results concerning matrix decomposition and given the paucity of scope to present this discussion, e.g., the separated analysis of the Euclidean space, Hermitian space, Hilbert space, and things in the complex domain. We refer the reader to literature in the field of linear algebra for a more detailed introduction to the related fields. Keywords: Existence and computing of matrix decompositions, Floating point operations (flops), Low-rank approximation, Pivot, LU/PLU decomposition, CR/CUR/Skeleton decomposition, Coordinate transformation, ULV/URV decomposition, Rank decomposition, Rank revealing decomposition, Update/downdate, Tensor decomposition.


title: Magnetic Twists of Solar Filaments

abstract: Solar filaments are cold and dense materials situated in magnetic dips, which show distinct radiation characteristics compared to the surrounding coronal plasma. They are associated with coronal sheared and twisted magnetic field lines. However, the exact magnetic configuration supporting a filament material is not easy to be ascertained because of the absence of routine observations of the magnetic field inside filaments. Since many filaments lie above weak-field regions, it is nearly impossible to extrapolate their coronal magnetic structures by applying the traditional methods to noisy photospheric magnetograms, in particular the horizontal components. In this paper, we construct magnetic structures for some filaments with the regularized Biot--Savart laws and calculate their magnetic twists. Moreover, we make a parameter survey for the flux ropes of the Titov-Demoulin-modified model to explore the factors affecting the twist of a force-free magnetic flux rope. It is found that the twist of a force-free flux rope is proportional to its axial length to minor radius ratio, and is basically independent of the overlying background magnetic field strength. Thus, we infer that long quiescent filaments are likely to be supported by more twisted flux ropes than short active-region filaments, which is consistent with observations.


title: A General Approach to Approximate Multistage Subgraph Problems

abstract: In a Subgraph Problem we are given some graph and want to find a feasible subgraph that optimizes some measure. We consider Multistage Subgraph Problems (MSPs), where we are given a sequence of graph instances (stages) and are asked to find a sequence of subgraphs, one for each stage, such that each is optimal for its respective stage and the subgraphs for subsequent stages are as similar as possible. We present a framework that provides a $(1/\sqrt{2\chi})$-approximation algorithm for the $2$-stage restriction of an MSP if the similarity of subsequent solutions is measured as the intersection cardinality and said MSP is preficient, i.e., we can efficiently find a single-stage solution that prefers some given subset. The approximation factor is dependent on the instance's intertwinement $\chi$, a similarity measure for multistage graphs. We also show that for any MSP, independent of similarity measure and preficiency, given an exact or approximation algorithm for a constant number of stages, we can approximate the MSP for an unrestricted number of stages. Finally, we combine and apply these results and show that the above restrictions describe a very rich class of MSPs and that proving membership for this class is mostly straightforward. As examples, we explicitly state these proofs for natural multistage versions of Perfect Matching, Shortest s-t-Path, Minimum s-t-Cut and further classical problems on bipartite or planar graphs, namely Maximum Cut, Vertex Cover, Independent Set, and Biclique.


title: Polynomial-Division-Based Algorithms for Computing Linear Recurrence Relations

abstract: Sparse polynomial interpolation, sparse linear system solving or modular rational reconstruction are fundamental problems in Computer Algebra. They come down to computing linear recurrence relations of a sequence with the Berlekamp-Massey algorithm. Likewise, sparse multivariate polynomial interpolation and multidimensional cyclic code decoding require guessing linear recurrence relations of a multivariate sequence.Several algorithms solve this problem. The so-called Berlekamp-Massey-Sakata algorithm (1988) uses polynomial additions and shifts by a monomial. The Scalar-FGLM algorithm (2015) relies on linear algebra operations on a multi-Hankel matrix, a multivariate generalization of a Hankel matrix. The Artinian Gorenstein border basis algorithm (2017) uses a Gram-Schmidt process.We propose a new algorithm for computing the Gr{\"o}bner basis of the ideal of relations of a sequence based solely on multivariate polynomial arithmetic. This algorithm allows us to both revisit the Berlekamp-Massey-Sakata algorithm through the use of polynomial divisions and to completely revise the Scalar-FGLM algorithm without linear algebra operations.A key observation in the design of this algorithm is to work on the mirror of the truncated generating series allowing us to use polynomial arithmetic modulo a monomial ideal. It appears to have some similarities with Pad{\'e} approximants of this mirror polynomial.As an addition from the paper published at the ISSAC conferance, we give an adaptive variant of this algorithm taking into account the shape of the final Gr{\"o}bner basis gradually as it is discovered. The main advantage of this algorithm is that its complexity in terms of operations and sequence queries only depends on the output Gr{\"o}bner basis.All these algorithms have been implemented in Maple and we report on our comparisons.


title: Point Cloud Registration using Representative Overlapping Points

abstract: 3D point cloud registration is a fundamental task in robotics and computer vision. Recently, many learning-based point cloud registration methods based on correspondences have emerged. However, these methods heavily rely on such correspondences and meet great challenges with partial overlap. In this paper, we propose ROPNet, a new deep learning model using Representative Overlapping Points with discriminative features for registration that transforms partial-to-partial registration into partial-to-complete registration. Specifically, we propose a context-guided module which uses an encoder to extract global features for predicting point overlap score. To better find representative overlapping points, we use the extracted global features for coarse alignment. Then, we introduce a Transformer to enrich point features and remove non-representative points based on point overlap score and feature matching. A similarity matrix is built in a partial-to-complete mode, and finally, weighted SVD is adopted to estimate a transformation matrix. Extensive experiments over ModelNet40 using noisy and partially overlapping point clouds show that the proposed method outperforms traditional and learning-based methods, achieving state-of-the-art performance. The code is available at https://github.com/zhulf0804/ROPNet.


title: Deep learning for bioimage analysis

abstract: Deep learning has transformed the way large and complex image datasets can be processed, reshaping what is possible in bioimage analysis. As the complexity and size of bioimage data continues to grow, this new analysis paradigm is becoming increasingly ubiquitous. In this Review, we begin by introducing the concepts needed for beginners to understand deep learning. We then review how deep learning has impacted bioimage analysis and explore the open-source resources available to integrate it into a research project. Finally, we discuss the future of deep learning applied to cell and developmental biology. We analyse how state-of-the-art methodologies have the potential to transform our understanding of biological systems through new image-based analysis and modelling that integrate multimodal inputs in space and time.


title: Human resources management system for Higher Education institutions

abstract: In an environment where employees and their experience are of central value to the company, human resources management (HRM) represents a significant aspect of business efficiency. In this paper we present a model of an HRM information system for universities. Special attention is paid to aspects of the system that support processes specific to science and higher education. UML was used for modelling the global and detailed system architecture and database model. FURPS+ methodology was used for classification of requirements and the MoSCoW method for analysis of requirement priority.


title: Differentially private federated deep learning for multi-site medical image segmentation

abstract: Collaborative machine learning techniques such as federated learning (FL) enable the training of models on effectively larger datasets without data transfer. Recent initiatives have demonstrated that segmentation models trained with FL can achieve performance similar to locally trained models. However, FL is not a fully privacy-preserving technique and privacy-centred attacks can disclose confidential patient data. Thus, supplementing FL with privacy-enhancing technologies (PTs) such as differential privacy (DP) is a requirement for clinical applications in a multi-institutional setting. The application of PTs to FL in medical imaging and the trade-offs between privacy guarantees and model utility, the ramifications on training performance and the susceptibility of the final models to attacks have not yet been conclusively investigated. Here we demonstrate the first application of differentially private gradient descent-based FL on the task of semantic segmentation in computed tomography. We find that high segmentation performance is possible under strong privacy guarantees with an acceptable training time penalty. We furthermore demonstrate the first successful gradient-based model inversion attack on a semantic segmentation model and show that the application of DP prevents it from divulging sensitive image features.


title: Generalized Polish spaces at regular uncountable cardinals

abstract: In the context of generalized descriptive set theory, we systematically compare and analyze various notions of Polish-like spaces and standard $\kappa$-Borel spaces for $\kappa$ an uncountable (regular) cardinal satisfying $\kappa^{<\kappa} = \kappa$. As a result, we obtain a solid framework where one can develop the theory in full generality. We also provide natural characterizations of the generalized Cantor and Baire spaces. Some of the results obtained considerably extend previous work from [Coskey-Schlicht 2016, Galeotti 2019, Luecke-Schlicht 2015], and answer some questions contained therein.


title: Temporal Nuances of Coordination Network Semantics

abstract: Current network-based methods for detecting coordinated inauthentic behaviour on social media focus primarily on inferring links between accounts based on common "behavioural traces" [19], such as retweeting the same tweet or posting the same URL. Assuming the goal of coordination is amplification, boosting a message within a constrained period, most approaches use a temporal window to ensure the co-activity occurs within a specific timeframe [9, 14, 19, 24]. Real-world application requires considering near real-time processing, creating performance requirements, which also highlight gaps in the semantics of coordination in the literature. These methods could all exploit temporal elements of coordinated activity. We describe preliminary research regarding coordination network semantics, coordination network construction, relevant observations in three political Twitter datasets and the role of cheerleaders in revealing social bots.


title: Connections between two classes of generalized Fibonacci numbers squared and permanents of (0,1) Toeplitz matrices

abstract: By considering the tiling of an $N$-board (a linear array of $N$ square cells of unit width) with new types of tile that we refer to as combs, we give a combinatorial interpretation of the product of two consecutive generalized Fibonacci numbers $s_n$ (where $s_{n}=\sum_{i=1}^q v_i s_{n-m_i}$, $s_0=1$, $s_{n<0}=0$, where $v_i$ and $m_i$ are positive integers and $m_1<\cdots<m_q$) each raised to an arbitrary non-negative integer power. A $(w,g;m)$-comb is a tile composed of $m$ rectangular sub-tiles of dimensions $w\times1$ separated by gaps of width $g$. The interpretation is used to give combinatorial proof of new convolution-type identities relating $s_n^2$ for the cases $q=2$, $v_i=1$, $m_1=M$, $m_2=m+1$ for $M=0,m$ to the permanent of a (0,1) Toeplitz matrix with 3 nonzero diagonals which are $-2$, $M-1$, and $m$ above the leading diagonal. When $m=1$ these identities reduce to ones connecting the Padovan and Narayana's cows numbers.


title: Coherent terahertz-to-microwave link using electro-optic-modulated Turing rolls

abstract: Arising from modulation instability, Turing rolls in optical Kerr microresonators have been used in the generation of optical frequency combs and the synthesis of microwave and terahertz frequencies. In this work, by applying electro-optic modulation on terahertz-frequency Turing rolls, we implement electro-optic frequency division with a microcomb to synthesize variable low-noise microwave signals. We also actively stabilize the terahertz oscillations to a microwave reference via intracavity power modulation, obtaining fractional frequency instabilities that are better than those of the free-running situation by up to six orders of magnitude. This study not only highlights the extraordinary spectral purity of Turing roll oscillations but also opens the way for bidirectional terahertz-to-microwave links with hybrid optical frequency comb techniques.


title: Decision problems for origin-close top-down tree transducers (full version)

abstract: Tree transductions are binary relations of finite trees. For tree transductions defined by non-deterministic top-down tree transducers, inclusion, equivalence and synthesis problems are known to be undecidable. Adding origin semantics to tree transductions, i.e., tagging each output node with the input node it originates from, is a known way to recover decidability for inclusion and equivalence. The origin semantics is rather rigid, in this work, we introduce a similarity measure for transducers with origin semantics and show that we can decide inclusion, equivalence and synthesis problems for origin-close non-deterministic top-down tree transducers.


title: Mean-field limits of Riesz-type singular flows

abstract: We provide a proof of mean-field convergence of first-order dissipative or conservative dynamics of particles with Riesz-type singular interaction (the model interaction is an inverse power $s$ of the distance for any $0<s<d$) when assuming a certain regularity of the solutions to the limiting evolution equations. It relies on a modulated-energy approach, as introduced in previous works where it was restricted to the Coulomb and super-Coulombic cases. The method is also capable of incorporating multiplicative noise of transport type into the dynamics. It relies in extending functional inequalities of arXiv:1803.08345, arXiv:2011.12180, arXiv:2003.11704 to more general interactions, via a new, robust proof that exploits a certain commutator structure.


title: Security of round-robin differential-phase-shift quantum key distribution protocol with correlated light sources

abstract: Among various quantum key distribution (QKD) protocols, the round-robin differential-phase-shift (RRDPS) protocol has a unique feature that its security is guaranteed without monitoring any statistics. Moreover, this protocol has a remarkable property of being robust against source imperfections assuming that the emitted pulses are independent. Unfortunately, some experiments confirmed the violation of the independence due to pulse correlations, and therefore the lack of a security proof without taking into account this effect is an obstacle for the security. In this paper, we prove that the RRDPS protocol is secure against any source imperfections by establishing a proof with the pulse correlations. Our proof is simple in the sense that we make only three experimentally simple assumptions for the source. Our numerical simulation based on the proof shows that the long-range pulse correlation does not cause a significant impact on the key rate, which reveals another striking feature of the RRDPS protocol. Our security proof is thus effective and applicable to wide range of practical sources and paves the way to realize truly secure QKD in high-speed systems.


title: Accelerated identification of equilibrium structures of multicomponent inorganic crystals using machine learning potentials

abstract: The discovery of new multicomponent inorganic compounds can provide direct solutions to many scientific and engineering challenges, yet the vast size of the uncharted material space dwarfs current synthesis throughput. While the computational crystal structure prediction is expected to mitigate this frustration, the NP-hardness and steep costs of density functional theory (DFT) calculations prohibit material exploration at scale. Herein, we introduce SPINNER, a highly efficient and reliable structure-prediction framework based on exhaustive random searches and evolutionary algorithms, which is completely free from empiricism. Empowered by accurate neural network potentials, the program can navigate the configuration space faster than DFT by more than 10$^{2}$-fold. In blind tests on 60 ternary compositions diversely selected from the experimental database, SPINNER successfully identifies experimental (or theoretically more stable) phases for ~80% of materials within 5000 generations, entailing up to half a million structure evaluations for each composition. When benchmarked against previous data mining or DFT-based evolutionary predictions, SPINNER identifies more stable phases in the majority of cases. By developing a reliable and fast structure-prediction framework, this work opens the door to large-scale, unbounded computational exploration of undiscovered inorganic crystals.


title: $\mathcal{H}_\infty$ Network Optimization for Edge Consensus

abstract: This paper examines the $\mathcal{H}_\infty$ performance problem of the edge agreement protocol for networks of agents operating on independent time scales, connected by weighted edges, and corrupted by exogenous disturbances. $\mathcal{H}_\infty$-norm expressions and bounds are computed that are then used to derive new insights on network performance in terms of the effect of time scales and edge weights on disturbance rejection. We use our bounds to formulate a convex optimization problem for time scale and edge weight selection. Numerical examples are given to illustrate the applicability of the derived $\mathcal{H}_\infty$-norm bound expressions, and the optimization paradigm is illustrated via a formation control example involving non-homogeneous agents.


title: Chiral conformal field theory for topological states and the anyon eigenbasis on the torus

abstract: Model wave functions constructed from (1+1)D conformal field theory (CFT) have played a vital role in studying chiral topologically ordered systems. There usually exist multiple degenerate ground states when such states are placed on the torus. The common practice for dealing with this degeneracy within the CFT framework is to take a full correlator on the torus, which includes both holomorphic and antiholomorphic sectors, and decompose it into several conformal blocks. In this paper, we propose a pure chiral approach for the torus wave function construction. By utilizing the operator formalism, the wave functions are written as chiral correlators of holormorphic fields restricted to each individual topological sector. This method is not only conceptually much simpler, but also automatically provides us the anyon eigenbasis of the degenerate ground states (also known as the "minimally entangled states"). As concrete examples, we construct the full set of degenerate ground states for SO($n$)$_1$ and SU($n$)$_1$ chiral spin liquids on the torus, the former of which provide a complete wave function realization of Kitaev's sixteenfold way of anyon theories. We further characterize their topological orders by analytically computing the associated modular $S$ and $T$ matrices.


title: Physics-informed regularization and structure preservation for learning stable reduced models from data with operator inference

abstract: Operator inference learns low-dimensional dynamical-system models with polynomial nonlinear terms from trajectories of high-dimensional physical systems (non-intrusive model reduction). This work focuses on the large class of physical systems that can be well described by models with quadratic nonlinear terms and proposes a regularizer for operator inference that induces a stability bias onto quadratic models. The proposed regularizer is physics informed in the sense that it penalizes quadratic terms with large norms and so explicitly leverages the quadratic model form that is given by the underlying physics. This means that the proposed approach judiciously learns from data and physical insights combined, rather than from either data or physics alone. Additionally, a formulation of operator inference is proposed that enforces model constraints for preserving structure such as symmetry and definiteness in the linear terms. Numerical results demonstrate that models learned with operator inference and the proposed regularizer and structure preservation are accurate and stable even in cases where using no regularization or Tikhonov regularization leads to models that are unstable.


title: Morphogenesis and self-organization of persistent filaments confined within flexible biopolymeric shells

abstract: We systematically explore the self-assembly of semi-flexible polymers in deformable spherical confinement across a wide regime of chain stiffness, contour lengths and packing fractions by means of coarse-grained molecular dynamics simulations. Compliant, DNA-like filaments are found to undergo a continuous crossover from two distinct surface-ordered quadrupolar states, both characterized by tetrahedral patterns of topological defects, to either longitudinal or latitudinal bipolar structures with increasing polymer concentrations. These transitions, along with the intermediary arrangements that they involve, may be attributed to the combination of an orientational wetting phenomenon with subtle density- and contour-length-dependent variations in the elastic anisotropies of the corresponding liquid crystal phases. Conversely, the organization of rigid, microtubule-like polymers evidences a progressive breakdown of continuum elasticity theory as chain dimensions become comparable to the equilibrium radius of the encapsulating membrane. In this case, we observe a gradual shift from prolate, tactoid-like morphologies to oblate, erythrocyte-like structures with increasing contour lengths, which is shown to arise from the interplay between nematic ordering, polymer and membrane buckling. We further provide numerical evidence of a number of yet-unidentified, self-organized states in such confined systems of stiff achiral filaments, including spontaneous spiral smectic assemblies, faceted polyhedral and twisted bundle-like arrangements. Our results are quantified through the introduction of several order parameters and an unsupervised learning scheme for the localization of surface topological defects, and are in excellent agreement with field-theoretical predictions as well as classical elastic theories of thin rods and spherical shells.


title: A Transferable Machine-learning Scheme from Pure Metals to Alloys in Predicting Adsorption Energies

abstract: Alloys present the great potential in catalysis because of their adjustable compositions, structures and element distributions, which unfortunately also limit the fast screening of the potential alloy catalysts. Machine learning methods are able to tackle the multi-variable issues but still cannot yet predict the complex alloy catalysts from the properties of pure metals due to the lack of universal descriptors. Herein we propose a transferable machine-learning model based on the intrinsic properties of substrates and adsorbates, which can predict the adsorption energies of single-atom alloys (SAAs), AB intermetallics (ABs) and high-entropy alloys (HEAs), simply by training the properties of transition metals (TMs). Furthermore, this model builds the structure-activity relationship of the adsorption energies on alloys from the perspective of machine learning, which reveals the role of the surface atoms' valence, electronegativity and coordination and the adsorbates' valence in determining the adsorption energies. This transferable scheme advances the understanding of the adsorption mechanism on alloys and the rapid design of alloy catalysts.


title: Stateless actor-critic for instance segmentation with high-level priors

abstract: Instance segmentation is an important computer vision problem which remains challenging despite impressive recent advances due to deep learning-based methods. Given sufficient training data, fully supervised methods can yield excellent performance, but annotation of ground-truth data remains a major bottleneck, especially for biomedical applications where it has to be performed by domain experts. The amount of labels required can be drastically reduced by using rules derived from prior knowledge to guide the segmentation. However, these rules are in general not differentiable and thus cannot be used with existing methods. Here, we relax this requirement by using stateless actor critic reinforcement learning, which enables non-differentiable rewards. We formulate the instance segmentation problem as graph partitioning and the actor critic predicts the edge weights driven by the rewards, which are based on the conformity of segmented instances to high-level priors on object shape, position or size. The experiments on toy and real datasets demonstrate that we can achieve excellent performance without any direct supervision based only on a rich set of priors.


title: An Ultrasonically Actuated Needle Promotes the Transport of Nanoparticles and Fluids

abstract: Non-invasive therapeutic ultrasound methods, such as high-intensity focused ultrasound (HIFU), have limited access to tissue targets shadowed by bones or presence of gas. This study demonstrates that an ultrasonically actuated medical needle can be used to translate nanoparticles and fluids under the action of nonlinear phenomena, potentially overcoming some limitations of HIFU. A simulation study was first conducted to study the delivery of a tracer with an ultrasonically actuated needle (33 kHz) inside a porous medium acting as a model for soft tissue. The model was then validated experimentally in different concentrations of agarose gel showing a close match with the experimental results, when diluted soot nanoparticles (diameter < 150 nm) were employed as delivered entity. An additional simulation study demonstrated a threefold increase of the volume covered by the delivered agent in liver under a constant injection rate, when compared to without ultrasound. This method, if developed to its full potential, could serve as a cost effective way to improve safety and efficacy of drug therapies by maximizing the concentration of delivered entities within e.g. a small lesion, while minimizing exposure outside the lesion.


title: Inference for Low-Rank Models

abstract: This paper studies inference in linear models with a high-dimensional parameter matrix that can be well-approximated by a ``spiked low-rank matrix.'' A spiked low-rank matrix has rank that grows slowly compared to its dimensions and nonzero singular values that diverge to infinity. We show that this framework covers a broad class of models of latent-variables which can accommodate matrix completion problems, factor models, varying coefficient models, and heterogeneous treatment effects. For inference, we apply a procedure that relies on an initial nuclear-norm penalized estimation step followed by two ordinary least squares regressions. We consider the framework of estimating incoherent eigenvectors and use a rotation argument to argue that the eigenspace estimation is asymptotically unbiased. Using this framework we show that our procedure provides asymptotically normal inference and achieves the semiparametric efficiency bound. We illustrate our framework by providing low-level conditions for its application in a treatment effects context where treatment assignment might be strongly dependent.


title: Meta-Reinforcement Learning for Heuristic Planning

abstract: In Meta-Reinforcement Learning (meta-RL) an agent is trained on a set of tasks to prepare for and learn faster in new, unseen, but related tasks. The training tasks are usually hand-crafted to be representative of the expected distribution of test tasks and hence all used in training. We show that given a set of training tasks, learning can be both faster and more effective (leading to better performance in the test tasks), if the training tasks are appropriately selected. We propose a task selection algorithm, Information-Theoretic Task Selection (ITTS), based on information theory, which optimizes the set of tasks used for training in meta-RL, irrespectively of how they are generated. The algorithm establishes which training tasks are both sufficiently relevant for the test tasks, and different enough from one another. We reproduce different meta-RL experiments from the literature and show that ITTS improves the final performance in all of them.


title: Reconstructing the neutrino energy for in-ice radio detectors

abstract: Starting in summer 2021, the Radio Neutrino Observatory in Greenland (RNO-G) will search for astrophysical neutrinos at energies >10 PeV by detecting the radio emission from particle showers in the ice around Summit Station, Greenland. We present an extensive simulation study that shows how RNO-G will be able to measure the energy of such particle cascades, which will in turn be used to estimate the energy of the incoming neutrino that caused them. The location of the neutrino interaction is determined using the differences in arrival times between channels and the electric field of the radio signal is reconstructed using a novel approach based on Information Field Theory. Based on these properties, the shower energy can be estimated. We show that this method can achieve an uncertainty of 13% on the logarithm of the shower energy after modest quality cuts and estimate how this can constrain the energy of the neutrino. The method presented in this paper is applicable to all similar radio neutrino detectors, such as the proposed radio array of IceCube-Gen2.


title: Making Three Out of Two: Three-Way Online Correlated Selection

abstract: Two-way online correlated selection (two-way OCS) is an online algorithm that, at each timestep, takes a pair of elements from the ground set and irrevocably chooses one of the two elements, while ensuring negative correlation in the algorithm's choices. Whilst OCS was initially invented by Fahrbach, Huang, Tao, and Zadimoghaddam to solve the edge-weighted online bipartite matching problem, it is an interesting technique on its own due to its capability of introducing a powerful algorithmic tool, namely negative correlation, to online algorithms. As such, Fahrbach et al. posed two tantalizing open questions in their paper, one of which was the following: Can we obtain n-way OCS for n>2, in which the algorithm can be given n>2 elements to choose from at each timestep? In this paper, we affirmatively answer this open question by presenting a three-way OCS. Our algorithm uses two-way OCS as its building block and is simple to describe; however, as it internally runs two instances of two-way OCS, one of which is fed with the output of the other, the final output probability distribution becomes highly elusive. We tackle this difficulty by approximating the output distribution of OCS by a flat, less correlated function and using it as a safe "surrogate" of the real distribution. Our three-way OCS also yields a 0.5093-competitive algorithm for edge-weighted online matching, demonstrating its usefulness.


title: Quasi-convex Hamilton--Jacobi equations via limits of Finsler $p$-Laplace problems as $p\to \infty$

abstract: In this paper we show that the maximal viscosity solution of a class of quasi-convex Hamilton--Jacobi equations, coupled with inequality constraints on the boundary, can be recovered by taking the limit as $p\to\infty$ in a family of Finsler $p$-Laplace problems. The approach also enables us to provide an optimal solution to a Beckmann-type problem in general Finslerian setting and allows recovering a bench of known results based on the Evans--Gangbo technique.


title: Extended higher Herglotz functions I. Functional equations

abstract: In 1975, Don Zagier obtained a new version of the Kronecker limit formula for a real quadratic field which involved an interesting function $F(x)$ which is now known as the \emph{Herglotz function}. As demonstrated by Zagier, and very recently by Radchenko and Zagier, $F(x)$ satisfies beautiful properties which are of interest in both algebraic number theory as well as in analytic number theory. In this paper, we study $\mathscr{F}_{k,N}(x)$, an extension of the Herglotz function which also subsumes \emph{higher Herglotz function} of Vlasenko and Zagier. We call it the \emph{extended higher Herglotz function}. It is intimately connected with a certain generalized Lambert series. We derive two different kinds of functional equations satisfied by $\mathscr{F}_{k,N}(x)$. Radchenko and Zagier gave a beautiful relation between the integral $\displaystyle\int_{0}^{1}\frac{\log(1+t^x)}{1+t}\, dt$ and $F(x)$ and used it to evaluate this integral at various rational as well as irrational arguments. We obtain a relation between $\mathscr{F}_{k,N}(x)$ and a generalization of the above integral involving polylogarithm. The asymptotic expansions of $\mathscr{F}_{k, N}(x)$ and some generalized Lambert series are also obtained along with other supplementary results.


title: Suppression of antiferromagnetic order and strong ferromagnetic spin fluctuations in Ni-doped CaCo2As2 single crystals

abstract: CaCo2As2 is a unique itinerant system having strong magnetic frustration. Here we report the effect of electron doping on the physical properties resulting from Ni substitutions for Co. The A-type antiferromagnetic transition temperature TN = 52 K for x = 0 decreases to 22 K with only 3 percent Ni substitution and is completely suppressed for x > 0.11. For 0.11 < x < 0.52 strong ferromagnetic (FM) fluctuations develop as revealed by magnetic susceptibility chi(T) measurements. Heat-capacity Cp(T) measurements reveal the presence of FM quantum spin fluctuations for 0.11 < x < 0.52. Our density-functional theory (DFT) calculations confirm that FM fluctuations are enhanced by Ni substitutions for Co. The Sommerfeld electronic heat-capacity coefficient is enhanced for x = 0, 0.21, and 0.42 by about a factor of two compared to DFT calculations of the bare density of states at the Fermi energy. The crystals with x > 0.52 do not exhibit FM spin fluctuations or magnetic order, which was found from the DFT calculations to arise from a Stoner transition. Neutron-diffraction studies of crystals with x = 0.11 and 0.16 found no evidence of A-type ordering as observed in CaCo2As2 or of other common magnetic structures.


title: How to Discover a Semantic Web Service by Knowing Its Functionality Parameters

abstract: In this work, we show how to discover a semantic web service among a repository of web services. A new approach for web service discovery based on calculating the functions similarity. We define the Web service functions with Ontology Web Language (OWL). We wrote some rules for comparing two web services` parameters. Our algorithm compares the parameters of two web services` inputs/outputs by making a bipartite graph. We compute the similarity rate by using the Ford-Fulkerson algorithm. The higher the similarity, the less are the differences between their functions. At last, our algorithm chooses the service which has the highest similarity. As a consequence, our method is useful when we need to find a web service suitable to replace an existing one that has failed. Especially in autonomic systems, this situation is very common and important since we need to ensure the availability of the application which is based on the failed web service. We use Universal Description, Discovery and Integration (UDDI) compliant web service registry.


title: Elliptic polytopes and invariant norms of linear operators

abstract: We address the problem of constructing elliptic polytopes in R^d, which are convex hulls of finitely many two-dimensional ellipses with a common center. Such sets arise in the study of spectral properties of matrices, asymptotics of long matrix products, in the Lyapunov stability, etc.. The main issue in the construction is to decide whether a given ellipse is in the convex hull of others. The computational complexity of this problem is analysed by considering an equivalent optimisation problem. We show that the number of local extrema of that problem may grow exponentially in d. For d=2,3, it admits an explicit solution for an arbitrary number of ellipses; for higher dimensions, several geometric methods for approximate solutions are derived. Those methods are analysed numerically and their efficiency is demonstrated in applications.


title: Generalized quantum subspace expansion

abstract: One of the major challenges for erroneous quantum computers is undoubtedly the control over the effect of noise. Considering the rapid growth of available quantum resources that are not fully fault-tolerant, it is crucial to develop practical hardware-friendly quantum error mitigation (QEM) techniques to suppress unwanted errors. Here, we propose a novel generalized quantum subspace expansion method which can handle stochastic, coherent, and algorithmic errors in quantum computers. By fully exploiting the substantially extended subspace, we can efficiently mitigate the noise present in the spectra of a given Hamiltonian, without relying on any information of noise. The performance of our method is discussed under two highly practical setups: the quantum subspaces are mainly spanned by powers of the noisy state $\rho^m$ and a set of error-boosted states, respectively. We numerically demonstrate in both situations that we can suppress errors by orders of magnitude, and show that out protocol inherits the advantages of previous error-agnostic QEM techniques as well as overcoming their drawbacks.


title: Combining EfficientNet and Vision Transformers for Video Deepfake Detection

abstract: Deepfakes are the result of digital manipulation to forge realistic yet fake imagery. With the astonishing advances in deep generative models, fake images or videos are nowadays obtained using variational autoencoders (VAEs) or Generative Adversarial Networks (GANs). These technologies are becoming more accessible and accurate, resulting in fake videos that are very difficult to be detected. Traditionally, Convolutional Neural Networks (CNNs) have been used to perform video deepfake detection, with the best results obtained using methods based on EfficientNet B7. In this study, we focus on video deep fake detection on faces, given that most methods are becoming extremely accurate in the generation of realistic human faces. Specifically, we combine various types of Vision Transformers with a convolutional EfficientNet B0 used as a feature extractor, obtaining comparable results with some very recent methods that use Vision Transformers. Differently from the state-of-the-art approaches, we use neither distillation nor ensemble methods. Furthermore, we present a straightforward inference procedure based on a simple voting scheme for handling multiple faces in the same video shot. The best model achieved an AUC of 0.951 and an F1 score of 88.0%, very close to the state-of-the-art on the DeepFake Detection Challenge (DFDC).


title: Machine Learning-Assisted High-Throughput Semi-empirical Search of OFET Molecular Materials

abstract: Machine learning has been widely verified and applied in chemoinformatics, and have achieved outstanding results in the prediction, modification, and optimization of luminescence, magnetism, and electrode materials. Here, we propose a deepth first search traversal (DFST) approach combined with lightGBM machine learning model to search the classic Organic field-effect transistor (OFET) functional molecules chemical space, which is simple but effective. Totally 2820588 molecules of different structure within two certain types of skeletons are generated successfully, which shows the searching efficiency of the DFST strategy. With the simplified molecular-input line-entry system (SMILES) utilized, the generation of alphanumeric strings that describe molecules directly tackle the inverse design problem, for the generation set has 100% chemical validity. Light Gradient Boosting Machine (LightGBM) model's intrinsic Distributed and efficient features enables much faster training process and higher training efficiency, which means better model performance with less amount of data. 184 out of 2.8 million molecules are finally screened out with density functional theory (DFT) calculation carried out to verify the accuracy of the prediction.


title: Transverse Linear Beam Dynamics

abstract: The subject of this introductory course is transverse dynamics of charged particle beams in linear approximation. Starting with a discussion of the most important types of magnets and defining their multipole strengths, the linearized equations of motion of charged particles in static magnetic fields are derived using an orthogonal reference frame following the design orbit. Analytical solutions are determined for linear elements of a typical beam transfer line (drift, dipole and quadrupole magnets), and stepwise combined by introducing the matrix formalism in which each element's contribution is represented by a single transfer matrix. Application of this formalism allows to calculate single particle's trajectories in linear approximation. After introducing the beam emittance as the area occupied by a particle beam in phase space, a linear treatment of transverse beam dynamics based on appropriately defined optical functions is introduced. The formalism is applied to the concepts of both weak and strong focusing, in particular discussing the properties of the widely-used FODO cell. Specific characteristics of transverse beam dynamics in periodic systems like circular accelerators are studied in detail, emphazising the effects of linear field errors on orbit stability and introducing the phenomena of optical resonances. Finally, the dynamics of off-momentum particles is presented, introducing dispersion functions and explaining effects like chromaticity.


title: Integral geometry and unique continuation principles

abstract: This is the introductory part of my PhD thesis on inverse problems arising in medical and seismic imaging. The topics include X-ray tomography of scalar and vector fields with partial data, higher order fractional Calder\'on problems, travel time tomography on Riemannian and Finsler manifolds, and unique continuation of fractional Laplacians. The thesis additionally includes these articles: arXiv:1909.05585, arXiv:2001.06210, arXiv:2006.05790, arXiv:2008.10227, arXiv:2009.01043, arXiv:2010.11484, arXiv:2103.14385.


title: Spectral asymptotics of Krein--Feller operators for weak Gibbs measures on self-conformal fractals with overlaps

abstract: We study the spectral dimensions and spectral asymptotics of Krein--Feller operators for weak Gibbs measures on self-conformal fractals with or without overlaps. We show that, restricted to the unit interval, the $L^{q}$-spectrum for every weak Gibbs measure $\rho$ with respect to a $\mathcal{C}^{1}$-IFS exists as a limit. Building on recent results of the authors, we can deduce that the spectral dimension with respect to a weak Gibbs measure exists and equals the fixed point of its $L^{q}$-spectrum. For an IFS satisfying the open set condition, it turns out that the spectral dimension equals the unique zero of the associated pressure function. Moreover, for a Gibbs measure with respect to a $\mathcal{C}^{1+\gamma}$-IFS under the open set condition, we are able to determine the asymptotics of the eigenvalue counting function.


title: On Search Complexity of Discrete Logarithm

abstract: In this work, we study the discrete logarithm problem in the context of TFNP - the complexity class of search problems with a syntactically guaranteed existence of a solution for all instances. Our main results establish that suitable variants of the discrete logarithm problem are complete for the complexity class PPP, respectively PWPP, i.e., the subclasses of TFNP capturing total search problems with a solution guaranteed by the pigeonhole principle, respectively the weak pigeonhole principle. Besides answering an open problem from the recent work of Sotiraki, Zampetakis, and Zirdelis (FOCS'18), our completeness results for PPP and PWPP have implications for the recent line of work proving conditional lower bounds for problems in TFNP under cryptographic assumptions. In particular, they highlight that any attempt at basing average-case hardness in subclasses of TFNP (other than PWPP and PPP) on the average-case hardness of the discrete logarithm problem must exploit its structural properties beyond what is necessary for constructions of collision-resistant hash functions. Additionally, our reductions provide new structural insights into the class PWPP by establishing two new PWPP-complete problems. First, the problem DOVE, a relaxation of the PPP-complete problem PIGEON. DOVE is the first PWPP-complete problem not defined in terms of an explicitly shrinking function. Second, the problem CLAW, a total search problem capturing the computational complexity of breaking claw-free permutations. In the context of TFNP, the PWPP-completeness of CLAW matches the known intrinsic relationship between collision-resistant hash functions and claw-free permutations established in the cryptographic literature.


title: Characterizing driver heterogeneity within stochastic traffic simulation

abstract: Drivers' heterogeneity and the broad range of vehicle characteristics on public roads are primarily responsible for the stochasticity observed in road traffic dynamics. Understanding the behavioural differences in drivers (human or automated systems) and reproducing observed behaviours in microsimulation attracts significant attention lately. Calibration of car-following model parameters is the prevalent way to simulate different driving behaviors through randomly injected variation around average parameter values. An issue is that, as shown in the literature, most car-following model do not realistically reproduce free-flow acceleration, that is in turn highly correlated with heterogeneity in driving styles. Furthermore, often, model parameters lose their physical interpretation upon calibration. The present study proposes a novel framework to analyse observed vehicle trajectories from various drivers, identify individual driver fingerprints based on their acceleration behavior, cluster drivers in categorically-meaningful driving styles (e.g. mild, normal and aggressive) and reproduce observed individual driver acceleration behaviors in microsimulation.


title: Quantum resonant tunnelling enhances hydrogen bond rotation of confined water

abstract: Many studies have revealed that confined water chain flipping is closely related to the spatial size and even quantum effects of the confinement environment. Here, we show that these are not the only factors that affect the flipping process of a confined water chain. First-principles calculations and analyses confirm that quantum tunnelling effects from the water chain itself, especially resonant tunnelling, enhance the hydrogen bond rotation process. Importantly, resonant tunnelling can result in tunnelling rotation of hydrogen bonds with a probability close to 1 with only 0.597 eV provided energy. Compared to sequential tunnelling, resonant tunnelling dominants water chain flipping at temperatures up to 20 K higher. Additionally, the ratio of the resonant tunnelling probability to the thermal disturbance probability at 200 K is at least ten times larger than that of sequential tunnelling, which further illustrates the enhancement of hydrogen bond rotation brought about by resonant tunnelling.


title: Direct X-ray detection of the spin Hall effect in CuBi

abstract: The spin Hall effect and its inverse are important spin-charge conversion mechanisms. The direct spin Hall effect induces a surface spin accumulation from a transverse charge current due to spin orbit coupling even in non-magnetic conductors. However, most detection schemes involve additional interfaces, leading to large scattering in reported data. Here we perform interface free x-ray spectroscopy measurements at the Cu L_{3,2} absorption edges of highly Bi-doped Cu (Cu_{95}Bi_{5}). The detected X-ray magnetic circular dichroism (XMCD) signal corresponds to an induced magnetic moment of (2.7 +/- 0.5) x 10-12 {\mu}_{B} A^{-1} cm^{2} per Cu atom averaged over the probing depth, which is of the same order as for Pt measured by magneto-optics. The results highlight the importance of interface free measurements to assess material parameters and the potential of CuBi for spin-charge conversion applications.


title: Energy Consumption of Deep Generative Audio Models

abstract: In most scientific domains, the deep learning community has largely focused on the quality of deep generative models, resulting in highly accurate and successful solutions. However, this race for quality comes at a tremendous computational cost, which incurs vast energy consumption and greenhouse gas emissions. At the heart of this problem are the measures that we use as a scientific community to evaluate our work. In this paper, we suggest relying on a multi-objective measure based on Pareto optimality, which takes into account both the quality of the model and its energy consumption. By applying our measure on the current state-of-the-art in generative audio models, we show that it can drastically change the significance of the results. We believe that this type of metric can be widely used by the community to evaluate their work, while putting computational cost -- and in fine energy consumption -- in the spotlight of deep learning research.


title: Detecting Outliers with Poisson Image Interpolation

abstract: Supervised learning of every possible pathology is unrealistic for many primary care applications like health screening. Image anomaly detection methods that learn normal appearance from only healthy data have shown promising results recently. We propose an alternative to image reconstruction-based and image embedding-based methods and propose a new self-supervised method to tackle pathological anomaly detection. Our approach originates in the foreign patch interpolation (FPI) strategy that has shown superior performance on brain MRI and abdominal CT data. We propose to use a better patch interpolation strategy, Poisson image interpolation (PII), which makes our method suitable for applications in challenging data regimes. PII outperforms state-of-the-art methods by a good margin when tested on surrogate tasks like identifying common lung anomalies in chest X-rays or hypo-plastic left heart syndrome in prenatal, fetal cardiac ultrasound images. Code available at https://github.com/jemtan/PII.


title: Enhancement of the pinning potential in a single-crystal superconductor FeTe0.65Se0.35 under the influence of hydrogen sorption

abstract: As a result of experimental studies of the single-crystal iron-chalcogenide compound FeTe0.65Se0.35, the effect of structural transitions caused by hydrogen sorption on the magnetic and current-carrying properties of a superconductor has been established. An increase in the volume-averaged effective pinning potential (and the associated critical current density) after the process of hydrogen sorption at temperatures up to 150 {\deg}C - 200 {\deg}C can be explained by the appearance of additional pinning centers due to the local action of implanted H ions on its crystal structure and electronic states. It was confirmed that hydrogenation is an efficient tool for increasing flux pining properties of superconductors.


title: Understanding Consumer Preferences for Explanations Generated by XAI Algorithms

abstract: Explaining firm decisions made by algorithms in customer-facing applications is increasingly required by regulators and expected by customers. While the emerging field of Explainable Artificial Intelligence (XAI) has mainly focused on developing algorithms that generate such explanations, there has not yet been sufficient consideration of customers' preferences for various types and formats of explanations. We discuss theoretically and study empirically people's preferences for explanations of algorithmic decisions. We focus on three main attributes that describe automatically-generated explanations from existing XAI algorithms (format, complexity, and specificity), and capture differences across contexts (online targeted advertising vs. loan applications) as well as heterogeneity in users' cognitive styles. Despite their popularity among academics, we find that counterfactual explanations are not popular among users, unless they follow a negative outcome (e.g., loan application was denied). We also find that users are willing to tolerate some complexity in explanations. Finally, our results suggest that preferences for specific (vs. more abstract) explanations are related to the level at which the decision is construed by the user, and to the deliberateness of the user's cognitive style.


title: Open-Source LiDAR Time Synchronization System by Mimicking GNSS-clock

abstract: Data fusion algorithms that employ LiDAR measurements, such as Visual-LiDAR, LiDAR-Inertial, or Multiple LiDAR Odometry and simultaneous localization and mapping (SLAM) rely on precise timestamping schemes that grant synchronicity to data from LiDAR and other sensors. Poor synchronization performance, due to incorrect timestamping procedure, may negatively affect the algorithms' state estimation results. To provide highly accurate and precise synchronization between the sensors, we introduce an open-source hardware-software LiDAR to other sensors time synchronization system that exploits a dedicated hardware LiDAR time synchronization interface by providing emulated GNSS-clock to this interface, no physical GNSS-receiver is needed. The emulator is based on a general-purpose microcontroller and, due to concise hardware and software architecture, can be easily modified or extended for synchronization of sets of different sensors such as cameras, inertial measurement units (IMUs), wheel encoders, other LiDARs, etc. In the paper, we provide an example of such a system with synchronized LiDAR and IMU sensors. We conducted an evaluation of the sensors synchronization accuracy and precision, and state 1 microsecond performance. We compared our results with timestamping provided by ROS software and by a LiDAR inner clocking scheme to underline clear advantages over these two baseline methods.


title: Asymptotic Analysis of Max-Min Weighted SINR for IRS-Assisted MISO Systems with Hardware Impairments

abstract: We focus on the realistic maximization of the uplink minimum signal-to-interference-plus-noise ratio (SINR) of a general multiple-input single-output (MISO) system assisted by an intelligent reflecting surface (IRS) in the large system limit accounting for HIs. In particular, we introduce the HIs at both the IRS (IRS-HIs) and the transceiver HIs (AT-HIs), usually neglected despite their inevitable impact. Specifically, the deterministic equivalent analysis enables the derivation of the asymptotic weighted maximum-minimum SINR with HIs by jointly optimizing the HIs-aware receiver, the transmit power, and the reflect beamforming matrix (RBM). Notably, we obtain the optimal power allocation and reflect beamforming matrix with low overhead instead of their frequent necessary computation in conventional MIMO systems based on the instantaneous channel information. Monte Carlo simulations verify the analytical results which show the insightful interplay among the key parameters and the degradation of the performance due to HIs.


title: Fast, universal estimation of latent variable models using extended variational approximations

abstract: Generalized linear latent variable models (GLLVMs) are a class of methods for analyzing multi-response data which has garnered considerable popularity in recent years, for example, in the analysis of multivariate abundance data in ecology. One of the main features of GLLVMs is their capacity to handle a variety of responses types, such as (overdispersed) counts, binomial responses, (semi-)continuous, and proportions data. On the other hand, the introduction of underlying latent variables presents some major computational challenges, as the resulting marginal likelihood function involves an intractable integral for non-normally distributed responses. This has spurred research into approximation methods to overcome this integral, with a recent and particularly computationally scalable one being that of variational approximations (VA). However, research into the use of VA of GLLVMs and related models has been hampered by the fact that closed-form approximations have only been obtained for certain pairs of response distributions and link functions. In this article, we propose an extended variational approximations (EVA) approach which widens the set of VA-applicable GLLVMs drastically. EVA draws inspiration from the underlying idea of Laplace approximations: by replacing the complete-data likelihood function with its second order Taylor approximation about the mean of the variational distribution, we can obtain a closed-form approximation to the marginal likelihood of the GLLVM for any response type and link function. Through simulation studies and an application to testate amoebae data set in ecology, we demonstrate how EVA results in a universal approach to fitting GLLVMs, which remains competitive in terms of estimation and inferential performance relative to both standard VA and a Laplace approximation approach, while being computationally more scalable than both in practice.


title: A dynamic version of the super-replication theorem under proportional transaction costs

abstract: We extend the super-replication theorems of [27] in a dynamic setting, both in the num\'eraire-based as well as in the num\'eraire-free setting. For this purpose, we generalize the notion of admissible strategies. In particular, we obtain a well-defined super-replication price process, which is right-continuous under some regularity assumptions.


title: Embracing the Dark Knowledge: Domain Generalization Using Regularized Knowledge Distillation

abstract: Though convolutional neural networks are widely used in different tasks, lack of generalization capability in the absence of sufficient and representative data is one of the challenges that hinder their practical application. In this paper, we propose a simple, effective, and plug-and-play training strategy named Knowledge Distillation for Domain Generalization (KDDG) which is built upon a knowledge distillation framework with the gradient filter as a novel regularization term. We find that both the ``richer dark knowledge" from the teacher network, as well as the gradient filter we proposed, can reduce the difficulty of learning the mapping which further improves the generalization ability of the model. We also conduct experiments extensively to show that our framework can significantly improve the generalization capability of deep neural networks in different tasks including image classification, segmentation, reinforcement learning by comparing our method with existing state-of-the-art domain generalization techniques. Last but not the least, we propose to adopt two metrics to analyze our proposed method in order to better understand how our proposed method benefits the generalization capability of deep neural networks.