title: DeScarGAN: Disease-Specific Anomaly Detection with Weak Supervision

abstract: Anomaly detection and localization in medical images is a challenging task, especially when the anomaly exhibits a change of existing structures, e.g., brain atrophy or changes in the pleural space due to pleural effusions. In this work, we present a weakly supervised and detail-preserving method that is able to detect structural changes of existing anatomical structures. In contrast to standard anomaly detection methods, our method extracts information about the disease characteristics from two groups: a group of patients affected by the same disease and a healthy control group. Together with identity-preserving mechanisms, this enables our method to extract highly disease-specific characteristics for a more detailed detection of structural changes. We designed a specific synthetic data set to evaluate and compare our method against state-of-the-art anomaly detection methods. Finally, we show the performance of our method on chest X-ray images. Our method called DeScarGAN outperforms other anomaly detection methods on the synthetic data set and by visual inspection on the chest X-ray image data set.


title: Pohozaev-type identities for differential operators driven by homogeneous vector fields

abstract: We prove Pohozaev-type identities for smooth solutions of Euler-Lagrange equations of second and fourth order that arise from functional depending on homogeneous H\"{o}rmander vector fields. We then exploit such integral identities to prove non-existence results for the associated boundary value problems.


title: Reachable Sets of Classifiers and Regression Models: (Non-)Robustness Analysis and Robust Training

abstract: Neural networks achieve outstanding accuracy in classification and regression tasks. However, understanding their behavior still remains an open challenge that requires questions to be addressed on the robustness, explainability and reliability of predictions. We answer these questions by computing reachable sets of neural networks, i.e. sets of outputs resulting from continuous sets of inputs. We provide two efficient approaches that lead to over- and under-approximations of the reachable set. This principle is highly versatile, as we show. First, we use it to analyze and enhance the robustness properties of both classifiers and regression models. This is in contrast to existing works, which are mainly focused on classification. Specifically, we verify (non-)robustness, propose a robust training procedure, and show that our approach outperforms adversarial attacks as well as state-of-the-art methods of verifying classifiers for non-norm bound perturbations. Second, we provide techniques to distinguish between reliable and non-reliable predictions for unlabeled inputs, to quantify the influence of each feature on a prediction, and compute a feature ranking.


title: Visible shapes of black holes M87* and SgrA*

abstract: We review the physical origins for possible visible images of the supermassive black hole M87* in the galaxy M87 and SgrA* in the Milky Way Galaxy. The classical dark black hole shadow of the maximal size is visible in the case of luminous background behind the black hole at the distance exceeding the so-called photon spheres. The notably smaller dark shadow (dark silhouette) of the black hole event horizon is visible if the black hole is highlighted by the inner parts of the luminous accreting matter inside the photon spheres. The first image of the supermassive black hole M87 *, obtained by the Event Horizon Telescope collaboration, shows the lensed dark image of the southern hemisphere of the black hole event horizon globe, highlighted by accreting matter, while the classical black hole shadow is invisible at all. A size of the dark spot on the Event Horizon Telescope (EHT) image agrees with a corresponding size of the dark event horizon silhouette in a thin accretion disk model in the case of either the high or moderate value of the black hole spin, $a\gtrsim0.75$.


title: Linearized von K\'arm\'an theory for incompressible magnetoelastic plates

abstract: We study the asymptotic behaviour, in the sense of $\Gamma$-convergence, of a thin incompressible magnetoelastic plate, as its thickness goes to zero. We focus on the linearized von K\'arm\'an regime. The model features a mixed Eulerian-Lagrangian formulation, as magnetizations are defined on the deformed confguration.


title: Determinants of some Special Matrices over Commutative Finite Chain Rings

abstract: Circulant matrices over finite fields and over commutative finite chain rings have been of interest due to their nice algebraic structures and wide applications. In many cases, such matrices over rings have a closed connection with diagonal matrices over their extension rings. In this paper, the determinants of diagonal and circulant matrices over commutative finite chain rings $R$ with residue field $\mathbb{F}_q$ are studied. The number of $n\times n$ diagonal matrices over ${R}$ of determinant $a$ is determined for all elements $a$ in $ {R}$ and for all positive integers $n$. Subsequently, the enumeration of nonsingular $n\times n$ circulant matrices over ${R}$ of determinant $a$ is given for all units $a$ in $ {R}$ and all positive integers $n$ such that $\gcd(n,q)=1$. In some cases, the number of singular $n\times n$ circulant matrices over ${R}$ with a fixed determinant is determined through the link between the rings of circulant matrices and diagonal matrices. As applications, a brief discussion on the determinant of diagonal and circulant matrices over commutative finite principal ideal rings is given. Finally, some open problems and conjectures are posted


title: Precise Calculation of the Decay Rate of False Vacuum with Multi-Field Bounce

abstract: We study the decay rate of a false vacuum in gauge theory at the one-loop level. We pay particular attention to the case where the bounce consists of an arbitrary number of scalar fields. With a multi-field bounce, which has a curved trajectory in the field space, the mixing among the gauge fields and the scalar fields evolves along the path of the bounce in the field space and the one-loop calculation of the vacuum decay rate becomes complicated. We consider the one-loop contribution to the decay rate with an arbitrary choice of the gauge parameter, and obtain a gauge invariant expression of the vacuum decay rate. We also give proper treatments of gauge zero modes and renormalization.


title: Gouy phase-matched angular and radial mode conversion in four-wave mixing

abstract: Studying the conversion between transverse light modes via four-wave mixing in a heated rubidium vapour, we demonstrate and explain a transfer between azimuthal and radial mode numbers. These relate to orthogonal modal dimensions, which one would not normally expect to interact. While angular momentum conservation in this nonlinear process dictates the selection rules for the angular mode number, the role of the radial mode number is more esoteric. We demonstrate systematically that the Gouy phase is the key to understanding this conversion, leading to strikingly different conversion behaviour in the thick and thin medium regime. Our experimental investigation of the transition between these regimes bridges the gap between previous experiments in atomic thick media and work in nonlinear crystals. Our work sets a clear starting point to explore new territory in the thick medium regime, allowing efficient radial-to-azimuthal and radial-to-radial mode conversion.


title: Multi-camera Torso Pose Estimation using Graph Neural Networks

abstract: Estimating the location and orientation of humans is an essential skill for service and assistive robots. To achieve a reliable estimation in a wide area such as an apartment, multiple RGBD cameras are frequently used. Firstly, these setups are relatively expensive. Secondly, they seldom perform an effective data fusion using the multiple camera sources at an early stage of the processing pipeline. Occlusions and partial views make this second point very relevant in these scenarios. The proposal presented in this paper makes use of graph neural networks to merge the information acquired from multiple camera sources, achieving a mean absolute error below 125 mm for the location and 10 degrees for the orientation using low-resolution RGB images. The experiments, conducted in an apartment with three cameras, benchmarked two different graph neural network implementations and a third architecture based on fully connected layers. The software used has been released as open-source in a public repository (https://github.com/vangiel/WheresTheFellow).


title: Robust Rhythmogenesis in the Gamma Band via Spike Timing Dependent Plasticity

abstract: Rhythmic activity in the gamma band (30-100Hz) has been observed in numerous animal species ranging from insects to humans, and in relation to a wide range of cognitive tasks. Various experimental and theoretical studies have investigated this rhythmic activity. The theoretical efforts have mainly been focused on the neuronal dynamics, under the assumption that network connectivity satisfies certain fine-tuning conditions required to generate gamma oscillations. However, it remains unclear how this fine tuning is achieved. Here we investigated the hypothesis that spike timing dependent plasticity (STDP) can provide the underlying mechanism for tuning synaptic connectivity to generate rhythmic activity in the gamma band. We addressed this question in a modeling study. We examined STDP dynamics in the framework of a network of excitatory and inhibitory neuronal populations that has been suggested to underlie the generation of gamma. Mean field Fokker Planck equations for the synaptic weights dynamics are derived in the limit of slow learning. We drew on this approximation to determine which types of STDP rules drive the system to exhibit gamma oscillations, and demonstrate how the parameters that characterize the plasticity rule govern the rhythmic activity. Finally, we propose a novel mechanism that can ensure the robustness of self-developing processes, in general and for rhythmogenesis in particular.


title: BUT-FIT at SemEval-2020 Task 5: Automatic detection of counterfactual statements with deep pre-trained language representation models

abstract: This paper describes BUT-FIT's submission at SemEval-2020 Task 5: Modelling Causal Reasoning in Language: Detecting Counterfactuals. The challenge focused on detecting whether a given statement contains a counterfactual (Subtask 1) and extracting both antecedent and consequent parts of the counterfactual from the text (Subtask 2). We experimented with various state-of-the-art language representation models (LRMs). We found RoBERTa LRM to perform the best in both subtasks. We achieved the first place in both exact match and F1 for Subtask 2 and ranked second for Subtask 1.


title: COMET: Convolutional Dimension Interaction for Collaborative Filtering

abstract: Representation learning-based recommendation models play a dominant role among recommendation techniques. However, most of the existing methods assume both historical interactions and embedding dimensions are independent of each other, and thus regrettably ignore the high-order interaction information among historical interactions and embedding dimensions. In this paper, we propose a novel representation learning-based model called COMET (COnvolutional diMEnsion inTeraction), which simultaneously models the high-order interaction patterns among historical interactions and embedding dimensions. To be specific, COMET stacks the embeddings of historical interactions horizontally at first, which results in two "embedding maps". In this way, internal interactions and dimensional interactions can be exploited by convolutional neural networks (CNN) with kernels of different sizes simultaneously. A fully-connected multi-layer perceptron (MLP) is then applied to obtain two interaction vectors. Lastly, the representations of users and items are enriched by the learnt interaction vectors, which can further be used to produce the final prediction. Extensive experiments and ablation studies on various public implicit feedback datasets clearly demonstrate the effectiveness and rationality of our proposed method.


title: Adoption and Effects of Software Engineering Best Practices in Machine Learning

abstract: The increasing reliance on applications with machine learning (ML) components calls for mature engineering techniques that ensure these are built in a robust and future-proof manner. We aim to empirically determine the state of the art in how teams develop, deploy and maintain software with ML components. We mined both academic and grey literature and identified 29 engineering best practices for ML applications. We conducted a survey among 313 practitioners to determine the degree of adoption for these practices and to validate their perceived effects. Using the survey responses, we quantified practice adoption, differentiated along demographic characteristics, such as geography or team size. We also tested correlations and investigated linear and non-linear relationships between practices and their perceived effect using various statistical models. Our findings indicate, for example, that larger teams tend to adopt more practices, and that traditional software engineering practices tend to have lower adoption than ML specific practices. Also, the statistical models can accurately predict perceived effects such as agility, software quality and traceability, from the degree of adoption for specific sets of practices. Combining practice adoption rates with practice importance, as revealed by statistical models, we identify practices that are important but have low adoption, as well as practices that are widely adopted but are less important for the effects we studied. Overall, our survey and the analysis of responses received provide a quantitative basis for assessment and step-wise improvement of practice adoption by ML teams.


title: Dynamical Zeeman resonance in spin-orbit-coupled spin-1 Bose gases

abstract: We predict a dynamical resonant effect, which is driven by externally applied linear and quadratic Zeeman fields, in a spin-orbit-coupled spin-1 Bose-Einstein condensate. The Bose-Einstein condensate is assumed to be initialized in some superposed state of Zeeman sublevels and subject to a sudden shift of the trapping potential. It is shown that the time-averaged center-of-mass oscillation and the spin polarizations of the Bose-Einstein condensate exhibit remarkable resonant peaks when the Zeeman fields are tuned to certain strengths. The underlying physics behind this resonance can be traced back to the out-of-phase interference of the dynamical phases carried by different spinorbit states. By analyzing the single particle spectrum, the resonant condition is summarized as a simple algebraic relation, connecting the strengths of the linear and quadratic Zeeman fields. This property is potentially applicable in quantum information and quantum precision measurement.


title: Toward Reliable Models for Authenticating Multimedia Content: Detecting Resampling Artifacts With Bayesian Neural Networks

abstract: In multimedia forensics, learning-based methods provide state-of-the-art performance in determining origin and authenticity of images and videos. However, most existing methods are challenged by out-of-distribution data, i.e., with characteristics that are not covered in the training set. This makes it difficult to know when to trust a model, particularly for practitioners with limited technical background. In this work, we make a first step toward redesigning forensic algorithms with a strong focus on reliability. To this end, we propose to use Bayesian neural networks (BNN), which combine the power of deep neural networks with the rigorous probabilistic formulation of a Bayesian framework. Instead of providing a point estimate like standard neural networks, BNNs provide distributions that express both the estimate and also an uncertainty range. We demonstrate the usefulness of this framework on a classical forensic task: resampling detection. The BNN yields state-of-the-art detection performance, plus excellent capabilities for detecting out-of-distribution samples. This is demonstrated for three pathologic issues in resampling detection, namely unseen resampling factors, unseen JPEG compression, and unseen resampling algorithms. We hope that this proposal spurs further research toward reliability in multimedia forensics.


title: Coherent characterisation of a single molecule in a photonic black box

abstract: Extinction spectroscopy is a powerful tool for demonstrating the coupling of a single quantum emitter to a photonic structure. However, it can be challenging in all but the simplest of geometries to deduce an accurate value of the coupling efficiency from the measured spectrum. Here we develop a theoretical framework to deduce the coupling efficiency from the measured transmission and reflection spectra without precise knowledge of the photonic environment. We then consider the case of a waveguide interrupted by a transverse cut in which an emitter is placed. We apply that theory to a silicon nitride waveguide interrupted by a gap filled with anthracene that is doped with dibenzoterrylene molecules. We describe the fabrication of these devices, and experimentally characterise the waveguide coupling of a single molecule in the gap.


title: Static and Ultrafast Optical Response of Two Ag Nanospheres Glued by a CdTe Quantum Dot

abstract: A hot-spot of high local field can be created in between two closely placed metal nanoparticles by irradiating them with an appropriate wavelength and polarization of incident light. The strength of the field at the hot-spot is expected to get enhanced by even up to six orders of magnitude than that of the applied field. Placing a semiconductor quantum dot or an analyte molecule at the hot-spot is an essential step towards harnessing the enhanced field for applications. In this article, we show that it is possible to position a CdTe quantum dot (QD) between two larger silver nanospheres in colloidal solution. The extinction spectra measured during growth suggests that the final hybrid nanostructure have two touching Ag nanoparticles (NPs) and a CdTe QD in between them close to the point of contact. Using ultrafast transient measurements, it has been shown that the presence of CdTe QD strongly influence the dynamics when the probe excites the hot-spot. The method demonstrated here to place the semiconductor QD in between the two Ag NPs is an important step in the area of colloidal self-assembly and for application of hot-spot in plasmonic sensing, optoelectronics, energy-harvesting, nanolithography, and optical nano-antennas.


title: Performance Analysis of Noise Subspace-based Narrowband Direction-of-Arrival (DOA) Estimation Algorithms on CPU and GPU

abstract: High-performance computing of array signal processing problems is a critical task as real-time system performance is required for many applications. Noise subspace-based Direction-of-Arrival (DOA) estimation algorithms are popular in the literature since they provide higher angular resolution and higher robustness. In this study, we investigate various optimization strategies for high-performance DOA estimation on GPU and comparatively analyze alternative implementations (MATLAB, C/C++ and CUDA). Experiments show that up to 3.1x speedup can be achieved on GPU compared to the baseline multi-threaded CPU implementation. The source code is publicly available at the following link: https://github.com/erayhamza/NssDOACuda


title: Impact of positive ion energy on carbon-surface production of negative ions in deuterium plasmas

abstract: This work focuses on the production of negative-ions on graphite and diamond surfaces bombarded by positive ions in a low pressure (2 Pa) low power (20 W) capacitively coupled deuterium plasma. A sample is placed opposite a mass spectrometer and negatively biased so that surface produced negative ions can be self-extracted from the plasma and measured by the mass spectrometer. The ratio between negative-ion counts at mass spectrometer and positive ion current at sample surface defines a relative negative-ion yield. Changes in negative-ion production yields versus positive ion energy in the range 10-60 eV are analysed. While the negative-ion production yield is decreasing for diamond surfaces when increasing the positive ion impact energy, it is strongly increasing for graphite. This increase is attributed to the onset of the sputtering mechanisms between 20 and 40 eV which creates negative ions at rather low energy that are efficiently collected by the mass spectrometer. The same mechanism occurs for diamond but is mitigated by a strong decrease of the ionization probability due to defect creation and loss of diamond electronic properties.


title: Nonnegative Low Rank Tensor Approximation and its Application to Multi-dimensional Images

abstract: The main aim of this paper is to develop a new algorithm for computing nonnegative low rank tensor approximation for nonnegative tensors that arise in many multi-dimensional imaging applications. Nonnegativity is one of the important property as each pixel value refers to nonzero light intensity in image data acquisition. Our approach is different from classical nonnegative tensor factorization (NTF) which requires each factorized matrix and/or tensor to be nonnegative. In this paper, we determine a nonnegative low Tucker rank tensor to approximate a given nonnegative tensor. We propose an alternating projections algorithm for computing such nonnegative low rank tensor approximation, which is referred to as NLRT. The convergence of the proposed manifold projection method is established. Experimental results for synthetic data and multi-dimensional images are presented to demonstrate the performance of NLRT is better than state-of-the-art NTF methods.


title: Generative Design for Performance Enhancement, Weight Reduction, and its Industrial Implications

abstract: This paper investigates the generative designing of a bracket that aids in the rotation of a linkage mounted on it with a revolute joint. Generative design is a term that is generally used when we care about weight reduction and performance gain in the manufacturing sector. Optimization is also a similar term. The only difference between the two is that generative design considers stress analysis while optimization considers load paths to give the required result. For a critical analysis of a generatively designed bracket, Autodesk Fusion 360 is used, which has in-built functionality of working on the generative design on the cloud, given Preserve and Obstacle geometries, Starting Shape and Resolution, Load cases and Constraints, Materials and Manufacturing methods. The generative bracket's iterative solutions are explored and further validated with simulations such as stress simulations, thermal simulations, buckling simulations, and modal frequencies, thus leading to a proper result for forming design and mesh. After post-processing the bracket's design and mesh, its CAD is further converted to CAM to send it for 3D printing under a suitable manufacturing method. The final generative bracket design is linked and employed into the initial assembly to check its proper working with the linkage, machine interface, and joints. The generated design considering various parameters is the best finish for performance enhancement and weight reduction. This paper will act as a basis for designing parts involving multiple studies and environments that will be a topic of industrial research in future technologies.


title: Accelerating ptychographic reconstructions using spectral initializations

abstract: Ptychography is a promising phase retrieval technique for label-free quantitative phase imaging. Recent advances in phase retrieval algorithms witnessed the development of spectral methods, in order to accelerate gradient descent algorithms. Using spectral initializations on experimental data, for the first time we report three times faster ptychographic reconstructions than with a standard gradient descent algorithm and improved resilience to noise. Coming at no additional computational cost compared to gradient-descent-based algorithms, spectral methods have the potential to be implemented in large-scale iterative ptychographic algorithms.


title: Defect Induced Room Temperature Ferromagnetism in High Quality Co-doped ZnO Bulk Samples

abstract: The nature of the often reported room temperature ferromagnetism in transition metal doped oxides is still a matter of huge debate. Herein we report on room temperature ferromagnetism in high quality Co-doped ZnO (Zn1-xCoxO) bulk samples synthesized via standard solid-state reaction route. Reference paramagnetic Co-doped ZnO samples with low level of structural defects are subjected to heat treatments in a reductive atmosphere in order to introduce defects in the samples in a controlled way. A detailed structural analysis is carried out in order to characterize the induced defects and their concentration. The magnetometry revealed the coexistence of a paramagnetic and a ferromagnetic phase at room temperature in straight correlation with the structural properties. The saturation magnetization is found to increase with the intensification of the heat treatment, and, therefore, with the increase of the density of induced defects. The magnetic behavior is fully explained in terms of the bound magnetic polaron model. Based on the experimental findings, supported by theoretical calculations, we attribute the origin of the observed defect-induced-ferromagnetism to the ferromagnetic coupling between the Co ions mediated by magnetic polarons due to zinc interstitial defects.


title: Real Space Orthogonal Projector-Augmented-Wave Method

abstract: The projector augmented wave (PAW) method of Bl\"ochl makes smooth but non-orthogonal orbitals. Here we show how to make PAW orthogonal, using a cheap transformation of the wave-functions. We show that the resulting Orthogonal PAW (OPAW), applied for DFT, reproduces (for a large variety of solids) band gaps from the ABINIT package. OPAW combines the underlying orthogonality of norm-conserving potentials with the large grid spacings and small spectral range in PAW. The OPAW framework can also be combined with other electronic structure theory methods.


title: Rectangle Tiling Binary Arrays

abstract: The problem of rectangle tiling binary arrays is defined as follows. Given an $n \times n$ array $A$ of zeros and ones and a natural number $p$, our task is to partition $A$ into at most $p$ rectangular tiles, so that the maximal weight of a tile is minimized. A tile is any rectangular subarray of $A$. The weight of a tile is the sum of elements that fall within it. We present a linear $(O(n^2))$ time $(\frac{3}{2}+\frac{p^2}{w(A)})$-approximation algorithm for this problem, where $w(A)$ denotes the weight of the whole array $A$. The algorithm employs the lower bound of $L=\lceil \frac{w(A)}{p} \rceil$, which is the same lower bound on the optimum that was used in all algorithms for rectangle tiling. We prove that a better approximation factor for the binary \RTILE cannot be achieved using the same lower bound $L$, because there exist arrays, whose every partition contains a tile of weight at least $(\frac{3}{2}+\frac{p^2}{w(A)})L$. The previously known approximation algorithm for rectangle tiling binary arrays achieved the ratio of $2$. We also consider the dual problem of rectangle tiling for binary arrays, where we are given an upper bound on the weight of the tiles, and we have to cover the array $A$ with the minimum number of non-overlapping tiles. Both problems have natural extensions to $d$-dimensional versions, for which we provide analogous results.


title: Rotating tensor-multiscalar black holes with two scalars

abstract: We construct hairy black hole solutions in a particular set of tensor-multi-scalar theories of gravity for which the target-space admits a Killing vector field with periodic flow that is furthermore the generator of a one-parameter family of point transformations which leave the whole theory invariant. As for black holes with scalar hair in general relativity, these must be rotating objects as the scalarization arises from superradiant instability. We analyze the most fundamental rotating solutions (winding number $m=1$) in five theories which differ from each other by the value of the Gauss curvature of the target-space. The domain of existence of these solutions is investigated, as well as their hairyness, horizon area and deformation factor.


title: Temperature-transferable coarse-graining of ionic liquids with dual graph convolutional neural networks

abstract: Computer simulations can provide mechanistic insight into ionic liquids (ILs) and predict the properties of experimentally unrealized ion combinations. However, ILs suffer from a particularly large disparity in the time scales of atomistic and ensemble motion. Coarse-grained models are therefore used in place of costly atomistic simulations, allowing simulation of longer time scales and larger systems. Nevertheless, constructing the many-body potential of mean force that defines the structure and dynamics of a coarse-grained system can be complicated and computationally intensive. Machine learning shows great promise for the key coupled challenges of dimensionality reduction and learning the potential of mean force. To improve the coarse-graining of ILs, we present a neural network model trained on all-atom classical molecular dynamics simulations. The potential of mean force is expressed as two jointly-trained neural network interatomic potentials that learn the coupled short-range and the many-body long range molecular interactions. These interatomic potentials treat temperature as an explicit input variable to capture the temperature dependence of the potential of mean force. The model reproduces structural quantities with high fidelity, outperforms the temperature-independent baseline at capturing dynamics, generalizes to unseen temperatures, and incurs low simulation cost.


title: Friction-controlled entropy-stability competition in granular systems

abstract: Using cyclic shear to drive a two dimensional granular system, we determine the structural characteristics for different inter-particle friction coefficients. These characteristics are the result of a competition between mechanical stability and entropy, with the latter's effect increasing with friction. We show that a parameter-free maximum-entropy argument alone predicts an exponential cell order distribution, with excellent agreement with the experimental observation. We show that friction only tunes the mean cell order and, consequently, the exponential decay rate and the packing fraction. We further show that cells, which can be very large in such systems, are short-lived, implying that our systems are liquid-like rather than glassy.


title: Siamese x-vector reconstruction for domain adapted speaker recognition

abstract: With the rise of voice-activated applications, the need for speaker recognition is rapidly increasing. The x-vector, an embedding approach based on a deep neural network (DNN), is considered the state-of-the-art when proper end-to-end training is not feasible. However, the accuracy significantly decreases when recording conditions (noise, sample rate, etc.) are mismatched, either between the x-vector training data and the target data or between enrollment and test data. We introduce the Siamese x-vector Reconstruction (SVR) for domain adaptation. We reconstruct the embedding of a higher quality signal from a lower quality counterpart using a lean auxiliary Siamese DNN. We evaluate our method on several mismatch scenarios and demonstrate significant improvement over the baseline.


title: Team Deep Mixture of Experts for Distributed Power Control

abstract: In the context of wireless networking, it was recently shown that multiple DNNs can be jointly trained to offer a desired collaborative behaviour capable of coping with a broad range of sensing uncertainties. In particular, it was established that DNNs can be used to derive policies that are robust with respect to the information noise statistic affecting the local information (e.g. CSI in a wireless network) used by each agent (e.g. transmitter) to make its decision. While promising, a major challenge in the implementation of such method is that information noise statistics may differ from agent to agent and, more importantly, that such statistics may not be available at the time of training or may evolve over time, making burdensome retraining necessary. This situation makes it desirable to devise a "universal" machine learning model, which can be trained once for all so as to allow for decentralized cooperation in any future feedback noise environment. With this goal in mind, we propose an architecture inspired from the well-known Mixture of Experts (MoE) model, which was previously used for non-linear regression and classification tasks in various contexts, such as computer vision and speech recognition. We consider the decentralized power control problem as an example to showcase the validity of the proposed model and to compare it against other power control algorithms. We show the ability of the so called Team-DMoE model to efficiently track time-varying statistical scenarios.


title: Towers and the first-order theory of hyperbolic groups

abstract: This paper is devoted to the first-order theory of torsion-free hyperbolic groups. One of its purposes is to review some results and to provide precise and correct statements and definitions, as well as some proofs and new results. A key concept is that of a tower (Sela) or NTQ system (Kharlampovich-Myasnikov). We discuss them thoroughly. We state and prove a new general theorem which unifies several results in the literature: elementarily equivalent torsion-free hyperbolic groups have isomorphic cores (Sela); if $H$ is elementarily embedded in a torsion-free hyperbolic group $G$, then $G$ is a tower over $H$ relative to $H$ (Perin); free groups (Perin-Sklinos, Ould-Houcine), and more generally free products of prototypes and free groups, are homogeneous. The converse to Sela and Perin's results just mentioned is true. This follows from the solution to Tarski's problem on elementary equivalence of free groups, due independently to Sela and Kharlampovich-Myasnikov, which we treat as a black box throughout the paper. We present many examples and counterexamples, and we prove some new model-theoretic results. We characterize prime models among torsion-free hyperbolic groups, and minimal models among elementarily free groups. Using Fra\"iss\'e's method, we associate to every torsion-free hyperbolic group $H$ a unique homogeneous countable group $\mathcal{M}$ in which any hyperbolic group $H'$ elementarily equivalent to $H$ has an elementary embedding. In an appendix we give a complete proof of the fact, due to Sela, that towers over a torsion-free hyperbolic group $H$ are $H$-limit groups.


title: Reverse H\"{o}lder Inequalities for log-Lipschitz Functions

abstract: Reverse H\"{o}lder inequalities for a class of functions on a probability space constitute an important tool in Analysis in Probability. After revisiting how a (modified) log-Sobolev inequality can be used to derive reverse H\"{o}lder inequalities for the class of log-Lipschitz functions, we obtain a weaker condition using general Transport-Entropy inequalities, which can also handle approximately log-Lipschitz functions. In its weakest form, the condition degenerates to the assumption of satisfying a concentration inequality. We compare this with a scenario in which the underlying space only satisfies a Poincar\'e inequality.


title: Partial spectral flow and the Aharonov-Bohm effect in graphene

abstract: We study the Aharonov-Bohm effect in an openended tube made of a graphene sheet whose dimensions are much larger than the interatomic distance in graphene. An external magnetic field vanishes on and in the vicinity of the graphene sheet and its flux through the tube is adiabatically switched on. It is shown that, in the process, the energy levels of the tight-binding Hamiltonian of pi-electrons unavoidably cross the Fermi level, which results in the creation of electron-hole pairs. The number of pairs is proven to be equal to the number of magnetic flux quanta of the external field. The proof is based on the new notion of partial spectral flow, which generalizes the ordinary spectral flow already having well-known applications (such as the Kopnin forces in superconductors and superfluids) in condensed matter physics.

categories: math-ph cond-mat.mes-hall math.MP quant-ph


title: A generalised mean-field approximation for the Deffuant opinion dynamics model on networks

abstract: When the interactions of agents on a network are assumed to follow the Deffuant opinion dynamics model, the outcomes are known to depend on the structure of the underlying network. This behavior cannot be captured by existing mean-field approximations for the Deffuant model. In this paper, a generalised mean-field approximation is derived that accounts for the effects of network topology on Deffuant dynamics through the degree distribution or community structure of the network. The accuracy of the approximation is examined by comparison with large-scale Monte Carlo simulations on both synthetic and real-world networks.


title: At-Scale Sparse Deep Neural Network Inference with Efficient GPU Implementation

abstract: This paper presents GPU performance optimization and scaling results for inference models of the Sparse Deep Neural Network Challenge 2020. Demands for network quality have increased rapidly, pushing the size and thus the memory requirements of many neural networks beyond the capacity of available accelerators. Sparse deep neural networks (SpDNN) have shown promise for reining in the memory footprint of large neural networks. However, there is room for improvement in implementing SpDNN operations on GPUs. This work presents optimized sparse matrix multiplication kernels fused with the ReLU function. The optimized kernels reuse input feature maps from the shared memory and sparse weights from registers. For multi-GPU parallelism, our SpDNN implementation duplicates weights and statically partition the feature maps across GPUs. Results for the challenge benchmarks show that the proposed kernel design and multi-GPU parallelization achieve up to 180 tera-edges per second inference throughput. These results are up to 4.3x faster for a single GPU and an order of magnitude faster at full scale than those of the champion of the 2019 Sparse Deep Neural Network Graph Challenge for the same generation of NVIDIA V100 GPUs. Using the same implementation, we also show single-GPU throughput on NVIDIA A100 is 2.37$\times$ faster than V100.


title: Martingale Representation in Progressively Enlarged L\'evy Filtrations

abstract: In this paper we obtain a martingale representation theorem in the progressive enlargement $\mathbb{G}$ by a random time $\tau$ of the filtration $\mathbb{F}^L$ generated by a L\'evy process $L$. The assumptions on the random time are that $\mathbb{F}^ L$ is immersed in $\mathbb{G}$ and that $\tau$ avoids $\mathbb{F}^ L$ stopping times. We also study the multiplicity of a progressively enlarged filtration.


title: Neutrinos masses in a supersymmtric model with exotic right-handed neutrinos in Global $(B-L)$ Symmetry

abstract: We consider an Supersymmetric extension of the Standard Model with some extra Higgs doublets and a global $(B - L)$, where $B$ and $L$ are the usual baryonic and lepton number respectivelly, and ${\cal Z}_{3} \otimes {\cal Z}^{\prime}_{3}$ symmetries of the non-SUSY model presented at [1]..


title: Local Variables and Quantum Relational Hoare Logic

abstract: We add local variables to quantum relational Hoare logic (Unruh, POPL 2019). We derive reasoning rules for supporting local variables (including an improved "adversary rule"). We extended the qrhl-tool for computer-aided verification of qRHL to support local variables and our new reasoning rules.


title: Dual Half-integrality for Uncrossable Cut Cover and its Application to Maximum Half-Integral Flow

abstract: Given an edge weighted graph and a forest $F$, the $\textit{2-edge connectivity augmentation problem}$ is to pick a minimum weighted set of edges, $E'$, such that every connected component of $E'\cup F$ is 2-edge connected. Williamson et al. gave a 2-approximation algorithm (WGMV) for this problem using the primal-dual schema. We show that when edge weights are integral, the WGMV procedure can be modified to obtain a half-integral dual. The 2-edge connectivity augmentation problem has an interesting connection to routing flow in graphs where the union of supply and demand is planar. The half-integrality of the dual leads to a tight 2-approximate max-half-integral-flow min-multicut theorem.


title: Explicit p-harmonic functions on rank-one Lie groups of Iwasawa type

abstract: We construct explicit proper p-harmonic functions on rank-one Lie groups of Iwasawa type. This class of Lie groups includes many classical Riemannian manifolds such as the rank-one symmetric spaces of non-compact type, Damek-Ricci spaces, rank-one Einstein solvmanifolds and Carnot spaces.


title: The Role of UAV-IoT Networks in Future Wildfire Detection

abstract: The challenge of wildfire management and detection is recently gaining increased attention due to the increased severity and frequency of wildfires worldwide. Popular fire detection techniques such as satellite imaging and remote camera-based sensing suffer from late detection and low reliability while early wildfire detection is a key to prevent massive fires. In this paper, we propose a novel wildfire detection solution based on unmanned aerial vehicles assisted Internet of things (UAV-IoT) networks. The main objective is to (1) study the performance and reliability of the UAV-IoT networks for wildfire detection and (2) present a guideline to optimize the UAV-IoT network to improve fire detection probability under limited budgets. We focus on optimizing the IoT devices' density and number of UAVs covering the forest area such that a lower bound of the wildfires detection probability is maximized within a limited time and budget. At any time after the fire ignition, the IoT devices within a limited distance from the fire can detect it. These IoT devices can then report their measurements only when the UAV is nearby. Discrete-time Markov chain (DTMC) analysis is utilized to compute the fire detection probability at discrete time. Before declaring fire detection, a validation state is designed to account for IoT devices' practical limitations such as miss-detection and false alarm probabilities. Numerical results suggest that given enough system budget, the UAV-IoT based fire detection can offer a faster and more reliable wildfire detection solution than the state of the art satellite imaging techniques.


title: Parameters of the Supernova-Driven Interstellar Turbulence

abstract: Galactic dynamo models take as input certain parameters of the interstellar turbulence, most essentially the correlation time $\tau$, root-mean-square turbulent speed $u$, and correlation scale $l$. However, these quantities are difficult, or, in the case of $\tau$, impossible, to directly observe, and theorists have mostly relied on order of magnitude estimates. Here we present an analytic model to derive these quantities in terms of a small set of more accessible parameters. In our model, turbulence is assumed to be driven concurrently by isolated supernovae (SNe) and superbubbles (SBs), but clustering of SNe to form SBs can be turned off if desired, which reduces the number of model parameters by about half. In general, we find that isolated SNe and SBs can inject comparable amounts of turbulent energy into the interstellar medium, but SBs do so less efficiently. This results in rather low overall conversion rates of SN energy into turbulent energy of $\sim1$-$3\%$. The results obtained for $l$, $u$ and $\tau$ for model parameter values representative of the Solar neighbourhood are consistent with those determined from direct numerical simulations. Our analytic model can be combined with existing dynamo models to predict more directly the magnetic field properties for nearby galaxies or for statistical populations of galaxies in cosmological models.


title: Hall's Marriage Theorem and Pawn Diagrams

abstract: This paper is concerned with unreachable pawn diagrams and the subset of which can be generated using Hall's Marriage Theorem. The result is 1 in 23 diagrams are unreachable by applying the theorem.


title: Twin-width III: Max Independent Set, Min Dominating Set, and Coloring

abstract: We recently introduced the graph invariant twin-width, and showed that first-order model checking can be solved in time $f(d,k)n$ for $n$-vertex graphs given with a witness that the twin-width is at most $d$, called $d$-contraction sequence or $d$-sequence, and formulas of size $k$ [Bonnet et al., FOCS '20]. The inevitable price to pay for such a general result is that $f$ is a tower of exponentials of height roughly $k$. In this paper, we show that algorithms based on twin-width need not be impractical. We present $2^{O(k)}n$-time algorithms for $k$-Independent Set, $r$-Scattered Set, $k$-Clique, and $k$-Dominating Set when an $O(1)$-sequence is provided. We further show how to solve weighted $k$-Independent Set, Subgraph Isomorphism, and Induced Subgraph Isomorphism, in time $2^{O(k \log k)}n$. These algorithms are based on a dynamic programming scheme following the sequence of contractions forward. We then show a second algorithmic use of the contraction sequence, by starting at its end and rewinding it. As an example, we establish that bounded twin-width classes are $\chi$-bounded. This significantly extends the $\chi$-boundedness of bounded rank-width classes, and does so with a very concise proof. The third algorithmic use of twin-width builds on the second one. Playing the contraction sequence backward, we show that bounded twin-width graphs can be edge-partitioned into a linear number of bicliques, such that both sides of the bicliques are on consecutive vertices, in a fixed vertex ordering. Given that biclique edge-partition, we show how to solve the unweighted Single-Source Shortest Paths and hence All-Pairs Shortest Paths in sublinear time $O(n \log n)$ and time $O(n^2 \log n)$, respectively. Finally we show that Min Dominating Set and related problems have constant integrality gaps on bounded twin-width classes, thereby getting constant approximations on these classes.


title: Insider Trading with Temporary Price Impact

abstract: We model an informed agent with information about the future value of an asset trying to maximize profits when subjected to a transaction cost as well as a market maker tasked with setting fair transaction prices. In a single auction model, equilibrium is characterized by the unique root of a particular polynomial. Analysis of this polynomial with small levels of risk-aversion and transaction costs reveal a dimensionless parameter which captures several orders of asymptotic accuracy of the equilibrium behaviour. In a continuous time analogue of the single auction model, incorporation of a transaction costs allows the informed agent's optimal trading strategy to be obtained in feedback form. Linear equilibrium is characterized by the unique solution to a system of two ordinary differential equations, of which one is forward in time and one is backward. When transaction costs are in effect, the price set by the market maker in equilibrium is not fully revealing of the informed agent's private signal, leaving an information gap at the end of the trading interval. When considering vanishing transaction costs, the equilibrium trading strategy and pricing rules converge to their frictionless counterparts.


title: Dependence of boundary layer thickness on layer height in laminar and transient convective regimes

abstract: Dependence of boundary layer thickness on layer height in laminar and transient regimes is studied for convection from localised heat source with an open surface. The measurements of Nusselt number and characteristic frequency of thermal plume formation are done for a wide range of Rayleigh number, different Prandtl numbers and different aspect ratios. The obtained results prove that for the developed (but not turbulent) convective flow the boundary layer thickness is almost independent of the layer height and it is mainly defined by applied temperature difference and physical properties of the fluid.


title: Learning Modality Interaction for Temporal Sentence Localization and Event Captioning in Videos

abstract: Automatically generating sentences to describe events and temporally localizing sentences in a video are two important tasks that bridge language and videos. Recent techniques leverage the multimodal nature of videos by using off-the-shelf features to represent videos, but interactions between modalities are rarely explored. Inspired by the fact that there exist cross-modal interactions in the human brain, we propose a novel method for learning pairwise modality interactions in order to better exploit complementary information for each pair of modalities in videos and thus improve performances on both tasks. We model modality interaction in both the sequence and channel levels in a pairwise fashion, and the pairwise interaction also provides some explainability for the predictions of target tasks. We demonstrate the effectiveness of our method and validate specific design choices through extensive ablation studies. Our method turns out to achieve state-of-the-art performances on four standard benchmark datasets: MSVD and MSR-VTT (event captioning task), and Charades-STA and ActivityNet Captions (temporal sentence localization task).


title: Glassy behaviour of sticky spheres: What lies beyond experimental timescales?

abstract: We use the swap Monte Carlo algorithm to analyse the glassy behaviour of sticky spheres in equilibrium conditions at densities where conventional simulations and experiments fail to reach equilibrium, beyond predicted phase transitions and dynamic singularities. We demonstrate the existence of a unique ergodic region comprising all the distinct phases previously reported, except for a phase-separated region at strong adhesion. All structural and dynamic observables evolve gradually within this ergodic region, the physics evolving smoothly from well-known hard sphere glassy behaviour at small adhesions and large densities, to a more complex glassy regime characterised by unusually-broad distributions of relaxation timescales and lengthscales at large adhesions.


title: A Comparison of Optimization Algorithms for Deep Learning

abstract: In recent years, we have witnessed the rise of deep learning. Deep neural networks have proved their success in many areas. However, the optimization of these networks has become more difficult as neural networks going deeper and datasets becoming bigger. Therefore, more advanced optimization algorithms have been proposed over the past years. In this study, widely used optimization algorithms for deep learning are examined in detail. To this end, these algorithms called adaptive gradient methods are implemented for both supervised and unsupervised tasks. The behaviour of the algorithms during training and results on four image datasets, namely, MNIST, CIFAR-10, Kaggle Flowers and Labeled Faces in the Wild are compared by pointing out their differences against basic optimization algorithms.


title: Growth of Transition Metal Dichalcogenides by Solvent Evaporation Technique

abstract: Due to their physical properties and potential applications in energy conversion and storage, transition metal dichalcogenides (TMDs) have garnered substantial interest in recent years. Amongst this class of materials, TMDs based on molybdenum, tungsten, sulfur and selenium are particularly attractive due to their semiconducting properties and the availability of bottom-up synthesis techniques. Here we report a method which yields high quality crystals of transition metal diselenide and ditelluride compounds (PtTe2, PdTe2, NiTe2, TaTe2, TiTe2, RuTe2, PtSe2, PdSe2, NbSe2, TiSe2, VSe2, ReSe2) from their solid solutions, via vapor deposition from a metal-saturated chalcogen melt. Additionally, we show the synthesis of rare-earth metal poly-chalcogenides and NbS2 crystals using the aforementioned process. Most of the obtained crystals have a layered CdI2 structure. We have investigated the physical properties of selected crystals and compared them to state-of-the-art findings reported in the literature. Remarkably, the charge density wave transition in 1T-TiSe2 and 2H-NbSe2 crystals is well-defined at TCDW ~ 200 K and ~ 33 K, respectively. Angle-resolved photoelectron spectroscopy and electron diffraction are used to directly access the electronic and crystal structures of PtTe2 single crystals, and yield state-of-the-art measurements.


title: MMSE Channel Estimation for Two-Port Demodulation Reference Signals in New Radio

abstract: Two-port demodulation reference signals (DMRS) have been employed in new radio (NR) recently. In this paper, we firstly propose a minimum mean square error (MMSE) scheme with full priori knowledge (F-MMSE) to achieve the channel estimation of two-port DMRS in NR. When the two ports are assigned to different users, the full priori knowledge of two ports is not easy to be obtained for one user. Then, we present a MMSE scheme with partial priori knowledge (P-MMSE). Finally, numerical results show that the proposed schemes achieve satisfactory channel estimation performance. Moreover, for both mean square error and bit error ratio metrics, the proposed schemes can achieve better performance compared with the classical discrete Fourier transform based channel estimation. Particularly, P-MMSE scheme delivers almost the same performance compared with F-MMSE scheme by a small amount of prior knowledge.


title: Semantic Width and the Fixed-Parameter Tractability of Constraint Satisfaction Problems

abstract: Constraint satisfaction problems (CSPs) are an important formal framework for the uniform treatment of various prominent AI tasks, e.g., coloring or scheduling problems. Solving CSPs is, in general, known to be NP-complete and fixed-parameter intractable when parameterized by their constraint scopes. We give a characterization of those classes of CSPs for which the problem becomes fixed-parameter tractable. Our characterization significantly increases the utility of the CSP framework by making it possible to decide the fixed-parameter tractability of problems via their CSP formulations. We further extend our characterization to the evaluation of unions of conjunctive queries, a fundamental problem in databases. Furthermore, we provide some new insight on the frontier of PTIME solvability of CSPs. In particular, we observe that bounded fractional hypertree width is more general than bounded hypertree width only for classes that exhibit a certain type of exponential growth. The presented work resolves a long-standing open problem and yields powerful new tools for complexity research in AI and database theory.


title: A Novel Compact Si-B-N Barrier on Mg-Li Alloys via Plasma Treatment

abstract: Mg-Li alloys have attracted much attention due to their superior properties. However, it is a great challenge to improve their inferior oxidation and corrosion resistance. We report a novel Si-B-N ceramic film deposited on the Mg-9.6Li alloy surface as an effective barrier against oxidation and corrosion. The films were deposited by using plasma enhanced chemical vapor deposition from a N2-B2H6-SiH4 gas mixtures, showing compact structure and adhesive attachment to the alloy surface. The barrier revealed excellent protection against oxidation in humid air for 500 days, and no observable changes were found in immersion test of the 3.5 wt.% NaCl solution for 10 min. The superior oxidation and corrosion resistance are attributed to the excellent material property of Si-B-N coatings with compact structure via plasma treatment. Moreover, it is found that moderate proportion of B_2 H_6 in the source gas mixture is beneficial to the protection of alloys, where the hydrogen release reaction nearly disappeared and no bubbles were generated on the surface in the immersion test.


title: Higher derivations of modules and the Hasse-Schmidt module

abstract: In this paper we revisit Ribenboim's notion of higher derivations of modules and relate it to the recent work of De Fernex and Docampo on the sheaf of differentials of the arc space. In particular, we derive their formula for the K\"ahler differentials of the Hasse-Schmidt algebra as a consequence of the fact that the Hasse-Schmidt algebra functors commute.


title: Collective locomotion of two-dimensional lattices of flapping plates

abstract: We study the propulsive properties of rectangular and rhombic lattices of flapping plates at O(10--100) Reynolds numbers in incompressible flow. We vary five parameters: flapping amplitude, frequency (or Reynolds number), horizontal and vertical spacings between plates, and oncoming fluid stream velocity. Lattices that are closely spaced in the streamwise direction produce intense vortex dipoles between adjacent plates. The lattices transition sharply from drag- to thrust-producing as these dipoles switch from upstream to downstream orientations at critical flow speeds. Near these transitions the flows assume a variety of periodic and nonperiodic states, with and without up-down symmetry, and multiple stable self-propelled speeds can occur. As the streamwise spacing increases, the plates may shed typical vortex wakes that impinge on downstream neighbors. With small lateral spacing, rectangular lattices yield net drag, while rhombic lattices may generate net thrust, sometimes with high efficiency. As lateral spacing increases, rectangular lattices begin to generate thrust, eventually with slightly higher efficiencies than rhombic lattices, as the two types of lattice flows converge. At Re = 70, the maximum Froude efficiencies of time-periodic lattice flows are about twice those of an isolated plate. At lower Re, the lattices' efficiency advantage increases until the isolated flapping plate no longer generates thrust. The mean input power needed to generate the lattice flows can be estimated in the limits of small and large streamwise spacings, with small-gap and Poiseuille-like flows between the plates respectively in the two cases. For both lattices, the mean input power saturates as the lateral spacing becomes large (and thrust occurs). At small lateral spacings, the rhombic lattices' input power may be much larger when the plates overlap, leading to a decrease in Froude efficiency.


title: Generalized Perfect Optical Vortex along Arbitrary Trajectories

abstract: Perfect optical vortex (POV) is a type of vortex beam with an infinite thin ring and a fixed radius independent of its topological charge. Here we propose the concept of generalized perfect optical vortex along arbitrary curves beyond the regular shapes of circle and ellipse. Generalized perfect optical vortices also share the similar properties as POVs, such as defined only along infinite thin curves and owning topological charges independent of scales. Notably, they naturally degenerate to the POVs and elliptic POVs along circles and ellipses, respectively. We also experimentally generated the generalized perfect optical vortices through a digital micromirror device (DMD) and measured the phase distributions by interferometry, exhibiting good agreements with the simulations. Moreover, we derive a proper modified formula to yield the generalized perfect optical vortices with uniform intensity distribution along predesigned curves. The generalized perfect optical vortices might find the potential applications in optical tweezers and communication.


title: Electronic Structure of Graphene/TiO$_2$ Interface: Design and Functional Perspectives

abstract: We propose the design of low strained and energetically favourable mono and bilayer graphene overlayer on anatase TiO$_2$ (001) surface and examined the electronic structure of the interface with the aid of first principle calculations. In the absence of hybridization between surface TiO$_2$ and graphene states, dipolar fluctuations govern the minor charge transfer across the interface. As a result, both the substrate and the overlayer retain their pristine electronic structure. The interface with the monolayer graphene retains its gapless linear band dispersion irrespective of the induced epitaxial strain. The potential gradient opens up a few meV bandgap in the case of Bernal stacking and strengthens the interpenetration of the Dirac cones in the case of hexagonal stacking of the bilayer graphene. The difference between the macroscopic average potential of the TiO$_2$ and graphene layer(s) in the heterostructure lies in the range 3 to 3.13 eV, which is very close to the TiO$_2$ bandgap ($\sim$ 3.2 eV). Therefore, the proposed heterostructure will exhibit enhanced photo-induced charge transfer and the graphene component will serve as a visible light sensitizer.


title: PyKEEN 1.0: A Python Library for Training and Evaluating Knowledge Graph Embeddings

abstract: Recently, knowledge graph embeddings (KGEs) received significant attention, and several software libraries have been developed for training and evaluating KGEs. While each of them addresses specific needs, we re-designed and re-implemented PyKEEN, one of the first KGE libraries, in a community effort. PyKEEN 1.0 enables users to compose knowledge graph embedding models (KGEMs) based on a wide range of interaction models, training approaches, loss functions, and permits the explicit modeling of inverse relations. Besides, an automatic memory optimization has been realized in order to exploit the provided hardware optimally, and through the integration of Optuna extensive hyper-parameter optimization (HPO) functionalities are provided.


title: Homological invariants of Cameron--Walker graphs

abstract: Let $G$ be a finite simple connected graph on $[n]$ and $R = K[x_1, \ldots, x_n]$ the polynomial ring in $n$ variables over a field $K$. The edge ideal of $G$ is the ideal $I(G)$ of $R$ which is generated by those monomials $x_ix_j$ for which $\{i, j\}$ is an edge of $G$. In the present paper, the possible tuples $(n, {\rm depth} (R/I(G)), {\rm reg} (R/I(G)), \dim R/I(G), {\rm deg} \ h(R/I(G)))$, where ${\rm deg} \ h(R/I(G))$ is the degree of the $h$-polynomial of $R/I(G)$, arising from Cameron--Walker graphs on $[n]$ will be completely determined.


title: Generative networks as inverse problems with fractional wavelet scattering networks

abstract: Deep learning is a hot research topic in the field of machine learning methods and applications. Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs) provide impressive image generations from Gaussian white noise, but both of them are difficult to train since they need to train the generator (or encoder) and the discriminator (or decoder) simultaneously, which is easy to cause unstable training. In order to solve or alleviate the synchronous training difficult problems of GANs and VAEs, recently, researchers propose Generative Scattering Networks (GSNs), which use wavelet scattering networks (ScatNets) as the encoder to obtain the features (or ScatNet embeddings) and convolutional neural networks (CNNs) as the decoder to generate the image. The advantage of GSNs is the parameters of ScatNets are not needed to learn, and the disadvantage of GSNs is that the expression ability of ScatNets is slightly weaker than CNNs and the dimensional reduction method of Principal Component Analysis (PCA) is easy to lead overfitting in the training of GSNs, and therefore affect the generated quality in the testing process. In order to further improve the quality of generated images while keep the advantages of GSNs, this paper proposes Generative Fractional Scattering Networks (GFRSNs), which use more expressive fractional wavelet scattering networks (FrScatNets) instead of ScatNets as the encoder to obtain the features (or FrScatNet embeddings) and use the similar CNNs of GSNs as the decoder to generate the image. Additionally, this paper develops a new dimensional reduction method named Feature-Map Fusion (FMF) instead of PCA for better keeping the information of FrScatNets and the effect of image fusion on the quality of image generation is also discussed.


title: Optimization of XNOR Convolution for Binary Convolutional Neural Networks on GPU

abstract: Binary convolutional networks have lower computational load and lower memory foot-print compared to their full-precision counterparts. So, they are a feasible alternative for the deployment of computer vision applications on limited capacity embedded devices. Once trained on less resource-constrained computational environments, they can be deployed for real-time inference on such devices. In this study, we propose an implementation of binary convolutional network inference on GPU by focusing on optimization of XNOR convolution. Experimental results show that using GPU can provide a speed-up of up to $42.61\times$ with a kernel size of $3\times3$. The implementation is publicly available at https://github.com/metcan/Binary-Convolutional-Neural-Network-Inference-on-GPU


title: Close relatives of Feedback Vertex Set without single-exponential algorithms parameterized by treewidth

abstract: The Cut & Count technique and the rank-based approach have lead to single-exponential FPT algorithms parameterized by treewidth, that is, running in time $2^{O(tw)}n^{O(1)}$, for Feedback Vertex Set and connected versions of the classical graph problems (such as Vertex Cover and Dominating Set). We show that Subset Feedback Vertex Set, Subset Odd Cycle Transversal, Restricted Edge-Subset Feedback Edge Set, Node Multiway Cut, and Multiway Cut are unlikely to have such running times. More precisely, we match algorithms running in time $2^{O(tw \log tw)}n^{O(1)}$ with tight lower bounds under the Exponential-Time Hypothesis (ETH), ruling out $2^{o(tw \log tw)}n^{O(1)}$, where $n$ is the number of vertices and $tw$ is the treewidth of the input graph. Our algorithms extend to the weighted case, while our lower bounds also hold for the larger parameter pathwidth and do not require weights. We also show that, in contrast to Odd Cycle Transversal, there is no $2^{o(tw \log tw)}n^{O(1)}$-time algorithm for Even Cycle Transversal under the ETH.


title: Low-complexity Point Cloud Filtering for LiDAR by PCA-based Dimension Reduction

abstract: Signals emitted by LiDAR sensors would often be negatively influenced during transmission by rain, fog, dust, atmospheric particles, scattering of light and other influencing factors, causing noises in point cloud images. To address this problem, this paper develops a new noise reduction method to filter LiDAR point clouds, i.e. an adaptive clustering method based on principal component analysis (PCA). Different from the traditional filtering methods that directly process three-dimension (3D) point cloud data, the proposed method uses dimension reduction to generate two-dimension (2D) data by extracting the first principal component and the second principal component of the original data with little information attrition. In the 2D space spanned by two principal components, the generated 2D data are clustered for noise reduction before being restored into 3D. Through dimension reduction and the clustering of the generated 2D data, this method derives low computational complexity, effectively removing noises while retaining details of environmental features. Compared with traditional filtering algorithms, the proposed method has higher precision and recall. Experimental results show a F-score as high as 0.92 with complexity reduced by 50% compared with traditional density-based clustering method.


title: Agreements between Enterprises digitized by Smart Contracts in the Domain of Industry 4.0

abstract: The digital transformation of companies is expected to increase the digital interconnection between different companies to develop optimized, customized, hybrid business models. These cross-company business models require secure, reliable, and traceable logging and monitoring of contractually agreed information sharing between machine tools, operators, and service providers. This paper discusses how the major requirements for building hybrid business models can be tackled by the blockchain for building a chain of trust and smart contracts for digitized contracts. A machine maintenance use case is used to discuss the readiness of smart contracts for the automation of workflows defined in contracts. Furthermore, it is shown that the number of failures is significantly improved by using these contracts and a blockchain.


title: Uniform bounds for rational points on hyperelliptic fibrations

abstract: We apply a variant of the square-sieve to produce a uniform upper bound for the number of rational points of bounded height on a family of surfaces that admit a fibration over the projective line, whose general fibre is a hyperelliptic curve.


title: Chebyshev polynomials and Galois groups of De Moivre polynomials

abstract: Let $n\ge 3$ be an odd natural number. In 1738, Abraham de Moivre introduced a family of polynomials of degree $n$ with rational coefficients, all of which are solvable. So far, the Galois groups of these polynomials have been investigated only for prime numbers $n$ and under special assumptions. We describe the Galois groups for arbitrary odd $n\ge 3$ in the irreducible case, up to few exceptions. In addition, we express all zeros of such a polynomial as rational functions of three zeros, two of which are connected in a certain sense. These results are based on the reduction of the radical $$ \sqrt[n]{d+\sqrt R}, $$ whose degree is $2n$ in general, to irrationals of degree $\le n$. Such a reduction was given in a previous paper of the author. Here, however, we present a much simpler approach that is based on properties of Chebyshev polynomials.


title: A Commentary on the Unsupervised Learning of Disentangled Representations

abstract: The goal of the unsupervised learning of disentangled representations is to separate the independent explanatory factors of variation in the data without access to supervision. In this paper, we summarize the results of Locatello et al., 2019, and focus on their implications for practitioners. We discuss the theoretical result showing that the unsupervised learning of disentangled representations is fundamentally impossible without inductive biases and the practical challenges it entails. Finally, we comment on our experimental findings, highlighting the limitations of state-of-the-art approaches and directions for future research.


title: Semi-invariants sym\'etriques de contractions paraboliques

abstract: Let $K$ be an algebraically closed field with characteristic zero, and $\mathfrak{g}$ a Lie algebra. Let $Y(\mathfrak{g})$ be the subalgebra of the symmetric algebra $S(\mathfrak{g})=K[\mathfrak{g}^*]$ made of the polynomials which are invariant under the adjoint action. Also define $Sy(\mathfrak{g})$ as the algebra generated by elements of $S(\mathfrak{g})$ for which the adjoint action acts homothetically. When $\mathfrak{q}$ is a parabolic contraction in type $A$ or $C$, and in some cases in type $B$, Panyushev and Yakimova showed that the algebra of invariants $Y(\mathfrak{q})$ is an algebra of polynomials. Using Panyushev's and Yakimova's result, we show the polynomiality of $Sy(\mathfrak{q})$ by constructing an algebraically free set of generators in type $A$ and in some cases in type $C$. We also study an example in type $C$ where $Sy(\mathfrak{q})$ is not polynomial.


title: Hierarchical Control of Multi-Agent Systems using Online Reinforcement Learning

abstract: We propose a new reinforcement learning based approach to designing hierarchical linear quadratic regulator (LQR) controllers for heterogeneous linear multi-agent systems with unknown state-space models and separated control objectives. The separation arises from grouping the agents into multiple non-overlapping groups, and defining the control goal as two distinct objectives. The first objective aims to minimize a group-wise block-decentralized LQR function that models group-level mission. The second objective, on the other hand, tries to minimize an LQR function between the average states (centroids) of the groups. Exploiting this separation, we redefine the weighting matrices of the LQR functions in a way that they allow us to decouple their respective algebraic Riccati equations. Thereafter, we develop a reinforcement learning strategy that uses online measurements of the agent states and the average states to learn the respective controllers based on the approximate Riccati equations. Since the first controller is block-decentralized and, therefore, can be learned in parallel, while the second controller is reduced-dimensional due to averaging, the overall design enjoys a significantly reduced learning time compared to centralized reinforcement learning.


title: Single Extra Dimension from $\kappa$-Poincar\'e and Gauge Invariance

abstract: We show that $\kappa$-Poincar\'e invariant gauge theories on $\kappa$-Minkowski space with physically acceptable commutative (low energy) limit must be 5-d. The gauge invariance requirement of the action fixes the dimension of the $\kappa$-Minkowski space to $d=5$ and selects the unique twisted differential calculus with which the construction can be achieved. We characterize a BRST symmetry related to the 5-d noncommutative gauge invariance though the definition of a nilpotent operation, which is used to construct a gauge-fixed action. We also consider standard scenarios assuming (compactification of) flat extra dimension, for which the 5-d deformation parameter $\kappa$ can be viewed as the bulk 5-d Planck mass. We study physical properties of the resulting 4-d effective theories. Recent data from collider experiments require $\kappa\gtrsim\mathcal{O}(10^{13})\ \text{GeV}$. The use of standard test of in-vacuo dispersion relations of Gamma Ray Burst photons increases this lower bound by 4 orders of magnitude. The robustness of this bound is discussed in the light of possible new features of noncommutative causal structures.


title: Electronic transport across quantum dots in graphene nanoribbons: Toward built-in gap-tunable metal-semiconductor-metal heterojunctions

abstract: The success of all-graphene electronics is severely hindered by the challenging realization and subsequent integration of semiconducting channels and metallic contacts. Here, we comprehensively investigate the electronic transport across width-modulated heterojunctions consisting of a graphene quantum dot of varying lengths and widths embedded in a pair of armchair-edged metallic nanoribbons, of the kind recently fabricated via on-surface synthesis. We show that the presence of the quantum dot enables the opening of a width-dependent transport gap, thereby yielding built-in one-dimensional metal-semiconductor-metal junctions. Furthermore, we find that, in the vicinity of the band edges, the conductance is subject to a smooth transition from an antiresonant to a resonant transport regime upon increasing the channel length. These results are rationalized in terms of a competition between quantum-confinement effects and quantum dot-to-lead coupling. Overall, our work establishes graphene quantum dot nanoarchitectures as appealing platforms to seamlessly integrate gap-tunable semiconducting channels and metallic contacts into an individual nanoribbon, hence realizing self-contained carbon-based electronic devices.


title: TrajGAIL: Generating Urban Vehicle Trajectories using Generative Adversarial Imitation Learning

abstract: Recently, an abundant amount of urban vehicle trajectory data has been collected in road networks. Many studies have used machine learning algorithms to analyze patterns in vehicle trajectories to predict location sequences of individual travelers. Unlike the previous studies that used a discriminative modeling approach, this research suggests a generative modeling approach to learn the underlying distributions of urban vehicle trajectory data. A generative model for urban vehicle trajectories can better generalize from training data by learning the underlying distribution of the training data and, thus, produce synthetic vehicle trajectories similar to real vehicle trajectories with limited observations. Synthetic trajectories can provide solutions to data sparsity or data privacy issues in using location data. This research proposesTrajGAIL, a generative adversarial imitation learning framework for the urban vehicle trajectory generation. In TrajGAIL, learning location sequences in observed trajectories is formulated as an imitation learning problem in a partially observable Markov decision process. The model is trained by the generative adversarial framework, which uses the reward function from the adversarial discriminator. The model is tested with both simulation and real-world datasets, and the results show that the proposed model obtained significant performance gains compared to existing models in sequence modeling.


title: Ultra-high Dimensional Variable Selection for Doubly Robust Causal Inference

abstract: Causal inference has been increasingly reliant on observational studies with rich covariate information. To build tractable causal procedures, such as the doubly robust estimators, it is imperative to first extract important features from high or even ultra-high dimensional data. In this paper, we propose causal ball screening for confounder selection from modern ultra-high dimensional data sets. Unlike the familiar task of variable selection for prediction modeling, our confounder selection procedure aims to control for confounding while improving efficiency in the resulting causal effect estimate. Previous empirical and theoretical studies suggest excluding causes of the treatment that are not confounders. Motivated by these results, our goal is to keep all the predictors of the outcome in both the propensity score and outcome regression models. A distinctive feature of our proposal is that we use an outcome model-free procedure for propensity score model selection, thereby maintaining double robustness in the resulting causal effect estimator. Our theoretical analyses show that the proposed procedure enjoys a number of properties, including model selection consistency and point-wise normality. Synthetic and real data analysis show that our proposal performs favorably with existing methods in a range of realistic settings. Data used in preparation of this article were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database.


title: Tempered Sigmoid Activations for Deep Learning with Differential Privacy

abstract: Because learning sometimes involves sensitive data, machine learning algorithms have been extended to offer privacy for training data. In practice, this has been mostly an afterthought, with privacy-preserving models obtained by re-running training with a different optimizer, but using the model architectures that already performed well in a non-privacy-preserving setting. This approach leads to less than ideal privacy/utility tradeoffs, as we show here. Instead, we propose that model architectures are chosen ab initio explicitly for privacy-preserving training. To provide guarantees under the gold standard of differential privacy, one must bound as strictly as possible how individual training points can possibly affect model updates. In this paper, we are the first to observe that the choice of activation function is central to bounding the sensitivity of privacy-preserving deep learning. We demonstrate analytically and experimentally how a general family of bounded activation functions, the tempered sigmoids, consistently outperform unbounded activation functions like ReLU. Using this paradigm, we achieve new state-of-the-art accuracy on MNIST, FashionMNIST, and CIFAR10 without any modification of the learning procedure fundamentals or differential privacy analysis.


title: Distance labeling schemes for $K_4$-free bridged graphs

abstract: $k$-Approximate distance labeling schemes are schemes that label the vertices of a graph with short labels in such a way that the $k$-approximation of the distance between any two vertices $u$ and $v$ can be determined efficiently by merely inspecting the labels of $u$ and $v$, without using any other information. One of the important problems is finding natural classes of graphs admitting exact or approximate distance labeling schemes with labels of polylogarithmic size. In this paper, we describe a $4$-approximate distance labeling scheme forthe class of $K_4$-free bridged graphs. This scheme uses labels of poly-logarithmic length $O(\log n^3)$ allowing a constant decoding time. Given the labels of two vertices $u$ and $v$, the decoding function returnsa value between the exact distance $d_G(u,v)$ and its quadruple $4d_G(u,v)$.


title: Strong convergence order for the scheme of fractional diffusion equation driven by fractional Gaussion noise

abstract: Fractional Gaussian noise models the time series with long-range dependence; when the Hurst index $H>1/2$, it has positive correlation reflecting a persistent autocorrelation structure. This paper studies the numerical method for solving stochastic fractional diffusion equation driven by fractional Gaussian noise. Using the operator theoretical approach, we present the regularity estimate of the mild solution and the fully discrete scheme with finite element approximation in space and backward Euler convolution quadrature in time. The $\mathcal{O}(\tau^{H-\rho\alpha})$ convergence rate in time and $\mathcal{O}(h^{\min(2,2-2\rho,\frac{H}{\alpha})})$ in space are obtained, showing the relationship between the regularity of noise and convergence rates, where $\rho$ is a parameter to measure the regularity of noise and $\alpha\in(0,1)$. Finally, numerical experiments are performed to support the theoretical results.


title: On real algebras generated by positive and nonnegative matrices

abstract: Algebras generated by strictly positive matrices are described up to similarity, including the commutative, simple, and semisimple cases. We provide sufficient conditions for some block diagonal matrix algebras to be generated by a set of nonnegative matrices up to similarity. Also we find all realizable dimensions of algebras generated by two nonnegative semi-commuting matrices. The last result provides the solution to the problem posed by M. Kandi\'{c}, K. \v{S}ivic (2017).


title: Data Confidentiality In P2P Communication And Smart Contracts Of Blockchain In Industry 4.0

abstract: Increased collaborative production and dynamic selection of production partners within industry 4.0 manufacturing leads to ever-increasing automatic data exchange between companies. Automatic and unsupervised data exchange creates new attack vectors, which could be used by a malicious insider to leak secrets via an otherwise considered secure channel without anyone noticing. In this paper we reflect upon approaches to prevent the exposure of secret data via blockchain technology, while also providing auditable proof of data exchange. We show that previous blockchain based privacy protection approaches offer protection, but give the control of the data to (potentially not trustworthy) third parties, which also can be considered a privacy violation. The approach taken in this paper is not utilize centralized data storage for data. It realizes data confidentiality of P2P communication and data processing in smart contracts of blockchains.


title: Lifelong Incremental Reinforcement Learning with Online Bayesian Inference

abstract: A central capability of a long-lived reinforcement learning (RL) agent is to incrementally adapt its behavior as its environment changes, and to incrementally build upon previous experiences to facilitate future learning in real-world scenarios. In this paper, we propose LifeLong Incremental Reinforcement Learning (LLIRL), a new incremental algorithm for efficient lifelong adaptation to dynamic environments. We develop and maintain a library that contains an infinite mixture of parameterized environment models, which is equivalent to clustering environment parameters in a latent space. The prior distribution over the mixture is formulated as a Chinese restaurant process (CRP), which incrementally instantiates new environment models without any external information to signal environmental changes in advance. During lifelong learning, we employ the expectation maximization (EM) algorithm with online Bayesian inference to update the mixture in a fully incremental manner. In EM, the E-step involves estimating the posterior expectation of environment-to-cluster assignments, while the M-step updates the environment parameters for future learning. This method allows for all environment models to be adapted as necessary, with new models instantiated for environmental changes and old models retrieved when previously seen environments are encountered again. Experiments demonstrate that LLIRL outperforms relevant existing methods, and enables effective incremental adaptation to various dynamic environments for lifelong learning.


title: Toric G-solid Fano threefolds

abstract: We study toric G-solid Fano threefolds that have at most terminal singularities, where G is an algebraic subgroup of the normalizer of a maximal torus in their automorphism groups.


title: Sublinear Regret with Barzilai-Borwein Step Sizes

abstract: This paper considers the online scenario using the Barzilai-Borwein Quasi-Newton Method. In an online optimization problem, an online agent uses a certain algorithm to decide on an objective at each time step after which a possible loss is encountered. Even though the online player will ideally try to make the best decisions possible at each time step, there is a notion of regret associated with the player's decisions. This study examines the regret of an online player using optimization methods like the Quasi-Newton methods, due to their fast convergent properties. The Barzilai-Borwein (BB) gradient method is chosen in this paper over other Quasi-Newton methods such as the Broyden-Fletcher-Goldfarb-Shanno (BFGS) algorithm because of its less computational complexities. In addition, the BB gradient method is suitable for large-scale optimization problems including the online optimization scenario presented in this paper. To corroborate the effectiveness of the Barzilai-Borwein (BB) gradient algorithm, a greedy online gradient algorithm is used in this study based on the two BB step sizes. Through a rigorous regret analysis on the BB step sizes, it is established that the regret obtained from the BB algorithm is sublinear in time. Moreover, this paper shows that the average regret using the online BB algorithm approaches zero without assuming strong convexity on the cost function to be minimized.


title: On a possible cosmological evolution of galaxy cluster $Y_{\rm X}-Y_{\rm SZE}$ scaling relation

abstract: An important result from self-similar models that describe the process of galaxy cluster formation is the simple scaling relation $Y_{\rm SZE}D_{\rm A}^{2}/C_{\rm XSZE}Y_{\rm X}= C$. In this ratio, $Y_{\rm SZE}$ is the integrated Sunyaev-Zel'dovich effect flux of a cluster, its x-ray counterpart is $Y_{\rm X}$, $C_{\rm XSZE}$ and $C$ are constants and $D_{\rm A}$ is the angular diameter distance to the cluster. In this paper, we consider the cosmic distance duality relation validity jointly with type Ia supernovae observations plus $61$ $Y_{\rm SZE}D_{\rm A}^{2}/C_{\rm XSZE}Y_{\rm X}$ measurements as reported by the Planck Collaboration to explore if this relation is constant in the redshift range considered ($z<0.5$). No one specific cosmological model is used. As basic result, although the data sets are compatible with no redshift evolution within 2$\sigma$ c.l., a Bayesian analysis indicates that other $C(z)$ functions analyzed in this work cannot be discarded. It is worth to stress that the observational determination of an universal $C(z)$ function turns the $Y_{\rm SZE}D_{\rm A}^{2}/C_{\rm XSZE}Y_{\rm X}$ ratio in an useful cosmological tool to determine cosmological parameters.


title: ECNU-SenseMaker at SemEval-2020 Task 4: Leveraging Heterogeneous Knowledge Resources for Commonsense Validation and Explanation

abstract: This paper describes our system for SemEval-2020 Task 4: Commonsense Validation and Explanation (Wang et al., 2020). We propose a novel Knowledge-enhanced Graph Attention Network (KEGAT) architecture for this task, leveraging heterogeneous knowledge from both the structured knowledge base (i.e. ConceptNet) and unstructured text to better improve the ability of a machine in commonsense understanding. This model has a powerful commonsense inference capability via utilizing suitable commonsense incorporation methods and upgraded data augmentation techniques. Besides, an internal sharing mechanism is cooperated to prohibit our model from insufficient and excessive reasoning for commonsense. As a result, this model performs quite well in both validation and explanation. For instance, it achieves state-of-the-art accuracy in the subtask called Commonsense Explanation (Multi-Choice). We officially name the system as ECNU-SenseMaker. Code is publicly available at https://github.com/ECNU-ICA/ECNU-SenseMaker.


title: An Asplund space with norming Marku\v{s}evi\v{c} basis that is not weakly compactly generated

abstract: We construct an Asplund Banach space $\mathcal{X}$ with a norming Marku\v{s}evi\v{c} basis such that $\mathcal{X}$ is not weakly compactly generated. This solves a long-standing open problem from the early nineties, originally due to Gilles Godefroy. En route to the proof, we construct a peculiar example of scattered compact space, that also solves a question due to Wies{\l}aw Kubi\'s and Arkady Leiderman.


title: Del Pezzo surfaces with infinite automorphism groups

abstract: We classify del Pezzo surfaces with Du Val singularities that have infinite automorphism groups, and describe the connected components of their automorphisms groups.


title: 3D city models for urban farming site identification in buildings

abstract: Studies have suggested that there is farming potential in residential buildings. However, these studies are limited in scope, require field visits and time-consuming measurements. Furthermore, they have not suggested ways to identify suitable sites on a larger scale let alone means of surveying numerous micro-locations across the same building. Using a case study area focused on high-rise buildings in Singapore, this paper examines a novel application of 3D city models to identify suitable farming micro-locations in buildings. We specifically investigate whether the vertical spaces of these buildings comprising outdoor corridors, fa\c{c}ades and windows receive sufficient photosynthetically active radiation (PAR) for growing food crops and do so at a high resolution. We also analyze the spatio-temporal characteristics of PAR, and the impact of shadows and different weather conditions on PAR in the building. Environmental simulations on the 3D model of the study area indicated that the cumulative daily PAR or Daily Light Integral (DLI) at a location in the building was dependent on its orientation and shape, sun's diurnal and annual motion, weather conditions, and shadowing effects of the building's fa\c{c}ades and surrounding buildings. The DLI in the study area generally increased with building's levels and, depending on the particular micro-location, was found suitable for growing moderately light-demanding crops such as lettuce and sweet pepper. These variations in DLI at different locations of the same building affirmed the need for such simulations. The simulations were validated with field measurements of PAR, and correlation coefficients between them exceeded 0.5 in most cases thus, making a case that 3D city models offer a promising practical solution to identifying suitable farming locations in residential buildings, and have the potential for urban-scale applications.


title: Graph Spanners by Sketching in Dynamic Streams and the Simultaneous Communication Model

abstract: Graph sketching is a powerful technique introduced by the seminal work of Ahn, Guha and McGregor'12 on connectivity in dynamic graph streams that has enjoyed considerable attention in the literature since then, and has led to near optimal dynamic streaming algorithms for many fundamental problems such as connectivity, cut and spectral sparsifiers and matchings. Interestingly, however, the sketching and dynamic streaming complexity of approximating the shortest path metric of a graph is still far from well-understood. Besides a direct $k$-pass implementation of classical spanner constructions (recently improved to $\lfloor\frac k2\rfloor+1$-passes by Fernandez, Woodruff and Yasuda'20) the state of the art amounts to a $O(\log k)$-pass algorithm of Ahn, Guha and McGregor'12, and a $2$-pass algorithm of Kapralov and Woodruff'14. In particular, no single pass algorithm is known, and the optimal tradeoff between the number of passes, stretch and space complexity is open. In this paper we introduce several new graph sketching techniques for approximating the shortest path metric of the input graph. We give the first {\em single pass} sketching algorithm for constructing graph spanners: we show how to obtain a $\widetilde{O}(n^{\frac23})$-spanner using $\widetilde{O}(n)$ space, and in general a $\widetilde{O}(n^{\frac23(1-\alpha)})$-spanner using $\widetilde{O}(n^{1+\alpha})$ space for every $\alpha\in [0, 1]$, a tradeoff that we think may be close optimal. We also give new spanner construction algorithms for any number of passes, simultaneously improving upon all prior work on this problem. Finally, we study the simultaneous communication model and propose the first protocols with low per player information.


title: Detecting and analysing spontaneous oral cancer speech in the wild

abstract: Oral cancer speech is a disease which impacts more than half a million people worldwide every year. Analysis of oral cancer speech has so far focused on read speech. In this paper, we 1) present and 2) analyse a three-hour long spontaneous oral cancer speech dataset collected from YouTube. 3) We set baselines for an oral cancer speech detection task on this dataset. The analysis of these explainable machine learning baselines shows that sibilants and stop consonants are the most important indicators for spontaneous oral cancer speech detection.


title: Machine Learning Potential Repository

abstract: This paper introduces a machine learning potential repository that includes Pareto optimal machine learning potentials. It also shows the systematic development of accurate and fast machine learning potentials for a wide range of elemental systems. As a result, many Pareto optimal machine learning potentials are available in the repository from a website. Therefore, the repository will help many scientists to perform accurate and fast atomistic simulations.

categories: physics.comp-ph cond-mat.mtrl-sci physics.chem-ph physics.data-an


title: Cylinders in Fano varieties

abstract: This paper is a survey about cylinders in Fano varieties and related problems.


title: Admissible ways of merging p-values under arbitrary dependence

abstract: Methods of merging several p-values into a single p-value are important in their own right and widely used in multiple hypothesis testing. This paper is the first to systematically study the admissibility (in Wald's sense) of p-merging functions and their domination structure, without any information on the dependence structure of the input p-values. As a technical tool we use the notion of e-values, which are alternatives to p-values recently promoted by several authors. We obtain several results on the representation of admissible p-merging functions via e-values and on (in)admissibility of existing p-merging functions. By introducing new admissible p-merging functions, we show that some classic merging methods can be strictly improved to enhance power without compromising validity under arbitrary dependence.


title: Langevin Monte Carlo: random coordinate descent and variance reduction

abstract: Langevin Monte Carlo (LMC) is a popular Bayesian sampling method. For the log-concave distribution function, the method converges exponentially fast, up to a controllable discretization error. However, the method requires the evaluation of a full gradient in each iteration, and for a problem on $\mathbb{R}^d$, this amounts to $d$ times partial derivative evaluations per iteration. The cost is high when $d\gg1$. In this paper, we investigate how to enhance computational efficiency through the application of RCD (random coordinate descent) on LMC. There are two sides of the theory: 1 By blindly applying RCD to LMC, one surrogates the full gradient by a randomly selected directional derivative per iteration. Although the cost is reduced per iteration, the total number of iteration is increased to achieve a preset error tolerance. Ultimately there is no computational gain; 2 We then incorporate variance reduction techniques, such as SAGA (stochastic average gradient) and SVRG (stochastic variance reduced gradient), into RCD-LMC. It will be proved that the cost is reduced compared with the classical LMC, and in the underdamped case, convergence is achieved with the same number of iterations, while each iteration requires merely one-directional derivative. This means we obtain the best possible computational cost in the underdamped-LMC framework.