title: Tight limits and completions from Dedekind-MacNeille to Lambek-Isbell

abstract: While any infimum in a poset can also be computed as a supremum, and vice versa, categorical limits and colimits do not always approximate each other. If I approach a point from below, and you approach it from above, then we will surely meet if we live in a poset, but we may miss each other in a category. Can we characterize the limits and the colimits that approximate each other, and guarantee that we will meet? Such limits and colimits are called *tight*. Some critically important network applications depend on them. This paper characterizes tight limits and colimits, and describes tight completions, derived by applying the nucleus construction to adjunctions between loose completions. Just as the Dedekind-MacNeille completion of a poset preserves any existing infima and suprema, the tight completion of a category preserves any existing tight limits and colimits and is therefore idempotent.


title: Exact Stringy Microstates from Gauge Theories

abstract: We study how the microstates of BPS sectors in string theory are organized in the dual $U(N)$ gauge theory. The microstates take the form of a coherent sum of stacks of branes and their open/closed string excitations. We propose a prescription to holographically construct the indices of string/brane configurations by analyzing the modifications of determinant operators in gauge theory. The string/brane configurations should be interpreted in the tensionless limit, but their indices are well-defined at finite $N$. In various examples, we provide evidence that a sum, of the giant graviton-type recently proposed in the literature, over all such configurations gives the finite $N$ gauge theory index. Finally, we discuss how these microstates assemble in the BPS Hilbert space and in what circumstances the branes can form bound states to produce black hole degeneracies.


title: Enabling Dynamic and Intelligent Workflows for HPC, Data Analytics, and AI Convergence

abstract: The evolution of High-Performance Computing (HPC) platforms enables the design and execution of progressively larger and more complex workflow applications in these systems. The complexity comes not only from the number of elements that compose the workflows but also from the type of computations they perform. While traditional HPC workflows target simulations and modelling of physical phenomena, current needs require in addition data analytics (DA) and artificial intelligence (AI) tasks. However, the development of these workflows is hampered by the lack of proper programming models and environments that support the integration of HPC, DA, and AI, as well as the lack of tools to easily deploy and execute the workflows in HPC systems. To progress in this direction, this paper presents use cases where complex workflows are required and investigates the main issues to be addressed for the HPC/DA/AI convergence. Based on this study, the paper identifies the challenges of a new workflow platform to manage complex workflows. Finally, it proposes a development approach for such a workflow platform addressing these challenges in two directions: first, by defining a software stack that provides the functionalities to manage these complex workflows; and second, by proposing the HPC Workflow as a Service (HPCWaaS) paradigm, which leverages the software stack to facilitate the reusability of complex workflows in federated HPC infrastructures. Proposals presented in this work are subject to study and development as part of the EuroHPC eFlows4HPC project.


title: Lightweight HI source finding for next generation radio surveys

abstract: Future deep HI surveys will be essential for understanding the nature of galaxies and the content of the Universe. However, the large volume of these data will require distributed and automated processing techniques. We introduce LiSA, a set of python modules for the denoising, detection and characterization of HI sources in 3D spectral data. LiSA was developed and tested on the Square Kilometer Array Science Data Challenge 2 dataset, and contains modules and pipelines for easy domain decomposition and parallel execution. LiSA contains algorithms for 2D-1D wavelet denoising using the starlet transform and flexible source finding using null-hypothesis testing. These algorithms are lightweight and portable, needing only a few user-defined parameters reflecting the resolution of the data. LiSA also includes two convolutional neural networks developed to analyse data cubes which separate HI sources from artifacts and predict the HI source properties. All of these components are designed to be as modular as possible, allowing users to mix and match different components to create their ideal pipeline. We demonstrate the performance of the different components of LiSA on the SDC2 dataset, which is able to find 95% of HI sources with SNR > 3 and accurately predict their properties.


title: Distributed Coverage Control of Multi-Agent Systems in Uncertain Environments using Heat Transfer Equations

abstract: This paper addresses the coverage control problem of multi-agent systems in the uncertain environment. With the aid of Voronoi partition, a distributed coverage control formulation of multi-agent system is proposed to complete the workload in uncertain environments. Driven by the gradient of thermal field, each agent is able to move around for clearing the workload on its own subregion. Theoretical analysis is conducted to ensure the completion of workload in finite time. Finally, numerical simulations are carried out to demonstrate the effectiveness and advantages of the proposed coverage control approach as compared to other existing approaches.


title: Human-Object Interaction Detection via Disentangled Transformer

abstract: Human-Object Interaction Detection tackles the problem of joint localization and classification of human object interactions. Existing HOI transformers either adopt a single decoder for triplet prediction, or utilize two parallel decoders to detect individual objects and interactions separately, and compose triplets by a matching process. In contrast, we decouple the triplet prediction into human-object pair detection and interaction classification. Our main motivation is that detecting the human-object instances and classifying interactions accurately needs to learn representations that focus on different regions. To this end, we present Disentangled Transformer, where both encoder and decoder are disentangled to facilitate learning of two sub-tasks. To associate the predictions of disentangled decoders, we first generate a unified representation for HOI triplets with a base decoder, and then utilize it as input feature of each disentangled decoder. Extensive experiments show that our method outperforms prior work on two public HOI benchmarks by a sizeable margin. Code will be available.


title: Improving generalization of machine learning-identified biomarkers with causal modeling: an investigation into immune receptor diagnostics

abstract: Machine learning is increasingly used to discover diagnostic and prognostic biomarkers from high-dimensional molecular data. However, a variety of factors related to experimental design may affect the ability to learn generalizable and clinically applicable diagnostics. Here, we argue that a causal perspective improves the identification of these challenges and formalizes their relation to the robustness and generalization of machine learning-based diagnostics. To make for a concrete discussion, we focus on a specific, recently established high-dimensional biomarker - adaptive immune receptor repertoires (AIRRs). Through simulations, we illustrate how major biological and experimental factors of the AIRR domain may influence the learned biomarkers. In conclusion, we argue that causal modeling improves machine learning-based biomarker robustness by identifying stable relations between variables and by guiding the adjustment of the relations and variables that vary between populations.


title: Towards Arabic Sentence Simplification via Classification and Generative Approaches

abstract: This paper presents an attempt to build a Modern Standard Arabic (MSA) sentence-level simplification system. We experimented with sentence simplification using two approaches: (i) a classification approach leading to lexical simplification pipelines which use Arabic-BERT, a pre-trained contextualised model, as well as a model of fastText word embeddings; and (ii) a generative approach, a Seq2Seq technique by applying a multilingual Text-to-Text Transfer Transformer mT5. We developed our training corpus by aligning the original and simplified sentences from the internationally acclaimed Arabic novel "Saaq al-Bambuu". We evaluate effectiveness of these methods by comparing the generated simple sentences to the target simple sentences using the BERTScore evaluation metric. The simple sentences produced by the mT5 model achieve P 0.72, R 0.68 and F-1 0.70 via BERTScore, while, combining Arabic-BERT and fastText achieves P 0.97, R 0.97 and F-1 0.97. In addition, we report a manual error analysis for these experiments. \url{https://github.com/Nouran-Khallaf/Lexical_Simplification}


title: A variational framework for the inverse Henderson problem of statistical mechanics

abstract: The inverse Henderson problem refers to the determination of the pair potential which specifies the interactions in an ensemble of classical particles in continuous space, given the density and the equilibrium pair correlation function of these particles as data. For a canonical ensemble in a bounded domain it has been observed that this pair potential minimizes a corresponding convex relative entropy functional, and that the Newton iteration for minimizing this functional coincides with the so-called inverse Monte Carlo (IMC) iterative scheme. In this paper we show that in the thermodynamic limit analogous connections exist between the specific relative entropy introduced by Georgii and Zessin and a proper formulation of the IMC iteration in the full space. This provides a rigorous variational framework for the inverse Henderson problem, valid within a large class of pair potentials, including, for example, Lennard-Jones type potentials. It is further shown that the pressure is strictly convex as a function of the pair potential and the chemical potential, and that the specific relative entropy at fixed density is a strictly convex function of the pair potential. At a given reference potential and a corresponding density in the gas phase we determine the gradient and the Hessian of the specific relative entropy, and we prove that the Hessian extends to a symmetric positive semidefinite quadratic functional in the space of square integrable perturbations of this potential.


title: A 3-stage Spectral-spatial Method for Hyperspectral Image Classification

abstract: Hyperspectral images often have hundreds of spectral bands of different wavelengths captured by aircraft or satellites that record land coverage. Identifying detailed classes of pixels becomes feasible due to the enhancement in spectral and spatial resolution of hyperspectral images. In this work, we propose a novel framework that utilizes both spatial and spectral information for classifying pixels in hyperspectral images. The method consists of three stages. In the first stage, the pre-processing stage, Nested Sliding Window algorithm is used to reconstruct the original data by {enhancing the consistency of neighboring pixels} and then Principal Component Analysis is used to reduce the dimension of data. In the second stage, Support Vector Machines are trained to estimate the pixel-wise probability map of each class using the spectral information from the images. Finally, a smoothed total variation model is applied to smooth the class probability vectors by {ensuring spatial connectivity} in the images. We demonstrate the superiority of our method against three state-of-the-art algorithms on six benchmark hyperspectral data sets with 10 to 50 training labels for each class. The results show that our method gives the overall best performance in accuracy. Especially, our gain in accuracy increases when the number of labeled pixels decreases and therefore our method is more advantageous to be applied to problems with small training set. Hence it is of great practical significance since expert annotations are often expensive and difficult to collect.


title: Nuclear Spin Quantum Memory in Silicon Carbide

abstract: Transition metal (TM) defects in silicon carbide (SiC) are a promising platform for applications in quantum technology. Some TM defects, e.g. vanadium, emit in one of the telecom bands, but the large ground state hyperfine manifold poses a problem for applications which require pure quantum states. We develop a driven, dissipative protocol to polarize the nuclear spin, based on a rigorous theoretical model of the defect. We further show that nuclear-spin polarization enables the use of well-known methods for initialization and long-time coherent storage of quantum states. The proposed nuclear-spin preparation protocol thus marks the first step towards an all-optically controlled integrated platform for quantum technology with TM defects in SiC.


title: Image Restoration in Non-Linear Filtering Domain using MDB approach

abstract: This paper proposes a new technique based on a non-linear Minmax Detector Based (MDB) filter for image restoration. The aim of image enhancement is to reconstruct the true image from the corrupted image. The process of image acquisition frequently leads to degradation and the quality of the digitized image becomes inferior to the original image. Image degradation can be due to the addition of different types of noise in the original image. Image noise can be modelled of many types and impulse noise is one of them. Impulse noise generates pixels with gray value not consistent with their local neighbourhood. It appears as a sprinkle of both light and dark or only light spots in the image. Filtering is a technique for enhancing the image. Linear filter is the filtering in which the value of an output pixel is a linear combination of neighborhood values, which can produce blur in the image. Thus a variety of smoothing techniques have been developed that are non linear. Median filter is the one of the most popular non-linear filter. When considering a small neighborhood it is highly efficient but for large window and in case of high noise it gives rise to more blurring to image. The Centre Weighted Mean (CWM) filter has got a better average performance over the median filter. However the original pixel corrupted and noise reduction is substantial under high noise condition. Hence this technique has also blurring affect on the image. To illustrate the superiority of the proposed approach, the proposed new scheme has been simulated along with the standard ones and various restored performance measures have been compared.


title: Effects of Graph Convolutions in Multi-layer Networks

abstract: Graph Convolutional Networks (GCNs) are one of the most popular architectures that are used to solve classification problems accompanied by graphical information. We present a rigorous theoretical understanding of the effects of graph convolutions in multi-layer networks. We study these effects through the node classification problem of a non-linearly separable Gaussian mixture model coupled with a stochastic block model. First, we show that a single graph convolution expands the regime of the distance between the means where multi-layer networks can classify the data by a factor of at least $1/\sqrt[4]{\mathbb{E}{\rm deg}}$, where $\mathbb{E}{\rm deg}$ denotes the expected degree of a node. Second, we show that with a slightly stronger graph density, two graph convolutions improve this factor to at least $1/\sqrt[4]{n}$, where $n$ is the number of nodes in the graph. Finally, we provide both theoretical and empirical insights into the performance of graph convolutions placed in different combinations among the layers of a network, concluding that the performance is mutually similar for all combinations of the placement. We present extensive experiments on both synthetic and real-world data that illustrate our results.


title: Exploring Widevine for Fun and Profit

abstract: For years, Digital Right Management (DRM) systems have been used as the go-to solution for media content protection against piracy. With the growing consumption of content using Over-the-Top platforms, such as Netflix or Prime Video, DRMs have been deployed on numerous devices considered as potential hostile environments. In this paper, we focus on the most widespread solution, the closed-source Widevine DRM. Installed on billions of devices, Widevine relies on cryptographic operations to protect content. Our work presents a study of Widevine internals on Android, mapping its distinct components and bringing out its different cryptographic keys involved in content decryption. We provide a structural view of Widevine as a protocol with its complete key ladder. Based on our insights, we develop WideXtractor, a tool based on Frida to trace Widevine function calls and intercept messages for inspection. Using this tool, we analyze Netflix usage of Widevine as a proof-of-concept, and raised privacy concerns on user-tracking. In addition, we leverage our knowledge to bypass the obfuscation of Android Widevine software-only version, namely L3, and recover its Root-of-Trust.


title: Heavy-Quark Diffusion in the Quark-Gluon Plasma

abstract: The diffusion of heavy quarks through the quark-gluon plasma (QGP) as produced in high-energy heavy-ion collisions has long been recognized as an excellent probe of its transport properties. In addition, the experimentally observed heavy-flavor hadrons carry valuable information about the hadronization process of the transported quarks. Here we review recent progress in the theoretical developments of heavy-quark interactions in the QGP and how they relate to the nonperturbative hadronization process, and discuss the recent status of the pertinent phenomenology in heavy-ion collisions at the RHIC and the LHC. The interactions of heavy quarks in the QGP also constitute a central building block in the description of the heavy quarkonia which controls their transport parameters as well. We will thus focus on theoretical approaches that aim for a unified description of open and hidden heavy-flavor particles in medium, and discuss how they can be constrained by lattice QCD "data" and utilized to deduce fundamental properties of the microscopic interactions and emerging spectral properties of the strongly coupled QGP.


title: Heavy-Ball-Based Hard Thresholding Algorithms for Sparse Signal Recovery

abstract: The hard thresholding technique plays a vital role in the development of algorithms for sparse signal recovery. By merging this technique and heavy-ball acceleration method which is a multi-step extension of the traditional gradient descent method, we propose the so-called heavy-ball-based hard thresholding (HBHT) and heavy-ball-based hard thresholding pursuit (HBHTP) algorithms for signal recovery. It turns out that the HBHT and HBHTP can successfully recover a $k$-sparse signal if the restricted isometry constant of the measurement matrix satisfies $\delta_{3k}<0.618 $ and $\delta_{3k}<0.577,$ respectively. The guaranteed success of HBHT and HBHTP is also shown under the conditions $\delta_{2k}<0.356$ and $\delta_{2k}<0.377,$ respectively. Moreover, the finite convergence and stability of the two algorithms are also established in this paper. Simulations on random problem instances are performed to compare the performance of the proposed algorithms and several existing ones. Empirical results indicate that the HBHTP performs very comparably to a few existing algorithms and it takes less average time to achieve the signal recovery than these existing methods.


title: Bistable pulsating fronts in slowly oscillating environments *

abstract: We consider reaction-diffusion fronts in spatially periodic bistable media with large periods. Whereas the homogenization regime associated with small periods had been well studied for bistable or Fisher-KPP reactions and, in the latter case, a formula for the limit minimal speeds of fronts in media with large periods had also been obtained thanks to the linear formulation of these minimal speeds and their monotonicity with respect to the period, the main remaining open question is concerned with fronts in bistable environments with large periods. In bistable media the unique front speeds are not linearly determined and are not monotone with respect to the spatial period in general, making the analysis of the limit of large periods more intricate. We show in this paper the existence of and an explicit formula for the limit of bistable front speeds as the spatial period goes to infinity. We also prove that the front profiles converge to a family of front profiles associated with spatially homogeneous equations. The main results are based on uniform estimates on the spatial width of the fronts, which themselves use zero number properties and intersection arguments.


title: Adaptive Non-linear Filtering Technique for Image Restoration

abstract: Removing noise from the any processed images is very important. Noise should be removed in such a way that important information of image should be preserved. A decisionbased nonlinear algorithm for elimination of band lines, drop lines, mark, band lost and impulses in images is presented in this paper. The algorithm performs two simultaneous operations, namely, detection of corrupted pixels and evaluation of new pixels for replacing the corrupted pixels. Removal of these artifacts is achieved without damaging edges and details. However, the restricted window size renders median operation less effective whenever noise is excessive in that case the proposed algorithm automatically switches to mean filtering. The performance of the algorithm is analyzed in terms of Mean Square Error [MSE], Peak-Signal-to-Noise Ratio [PSNR], Signal-to-Noise Ratio Improved [SNRI], Percentage Of Noise Attenuated [PONA], and Percentage Of Spoiled Pixels [POSP]. This is compared with standard algorithms already in use and improved performance of the proposed algorithm is presented. The advantage of the proposed algorithm is that a single algorithm can replace several independent algorithms which are required for removal of different artifacts.


title: Attention in Attention: Modeling Context Correlation for Efficient Video Classification

abstract: Attention mechanisms have significantly boosted the performance of video classification neural networks thanks to the utilization of perspective contexts. However, the current research on video attention generally focuses on adopting a specific aspect of contexts (e.g., channel, spatial/temporal, or global context) to refine the features and neglects their underlying correlation when computing attentions. This leads to incomplete context utilization and hence bears the weakness of limited performance improvement. To tackle the problem, this paper proposes an efficient attention-in-attention (AIA) method for element-wise feature refinement, which investigates the feasibility of inserting the channel context into the spatio-temporal attention learning module, referred to as CinST, and also its reverse variant, referred to as STinC. Specifically, we instantiate the video feature contexts as dynamics aggregated along a specific axis with global average and max pooling operations. The workflow of an AIA module is that the first attention block uses one kind of context information to guide the gating weights calculation of the second attention that targets at the other context. Moreover, all the computational operations in attention units act on the pooled dimension, which results in quite few computational cost increase ($<$0.02\%). To verify our method, we densely integrate it into two classical video network backbones and conduct extensive experiments on several standard video classification benchmarks. The source code of our AIA is available at \url{https://github.com/haoyanbin918/Attention-in-Attention}.


title: Boundary pointwise regularity and applications to the regularity of free boundaries

abstract: In this paper, we develop a series of boundary pointwise regularity for Dirichlet problems and oblique derivative problems. As applications, we give direct and simple proofs of the higher regularity of the free boundaries in obstacle-type problems and one phase problems.


title: Recent Advances in Asymptotic Analysis

abstract: This is a survey article on an old topic in classical analysis. We present some new developments in asymptotics in the last fifty years. We start with the classical method of Darboux and its generalizations, including an uniformity treatment which has a direct application to the Heisenberg polynomials. We then present the development of an asymptotic theory for difference equations, which is a major advancement since the work of Birkhoff and Trjitzinsky in 1933. A new method was introduced into this field in the nineteen nineties, which is now known as the nonlinear steepest descent method or the Riemann-Hilbert approach. The advantage of this method is that it can be applied to orthogonal polynomials which do not satisfy any differential or difference equations neither do they have any integral representations. As an example, we mention the case of orthogonal polynomials with respect to the Freud weight. Finally, we show how the Wiener-Hopf technique can be used to derive asymptotic expansions for the solutions of an integral equation on a half line.


title: On the $\nu$-zeros of the Bessel functions of purely imaginary order

abstract: The $\nu$-zeros of the Bessel functions of purely imaginary order are examined for fixed argument $x>0$. In the case of the modified Bessel function of the second kind $K_{i\nu}(x)$, it is known that it possesses a countably infinite sequence of real $\nu$-zeros described by $\nu_n\sim \pi n/\log\,n$ as $n\to\infty$. Here we apply a unified approach to determine asymptotic estimates of the $\nu$-zeros of the modified Bessel functions $L_{i\nu}(x)\equiv I_{i\nu}(x)+I_{-i\nu}(x)$ and $K_{i\nu}(x)$ and the ordinary Bessel functions $J_{i\nu}(x)\pm J_{-i\nu}(x)$.


title: Self-similar shrinking of supports and non-extinction for a nonlinear diffusion equation with spatially inhomogeneous strong absorption

abstract: We study the dynamics of the following porous medium equation with strong absorption $$\partial_t u=\Delta u^m-|x|^{\sigma}u^q,$$ posed for $(t, x) \in (0,\infty) \times \mathbb{R}^N$, with $m > 1$, $q \in (0, 1)$ and $\sigma > 2(1-q)/(m-1)$. Considering the Cauchy problem with non-negative initial condition $u_0 \in L^\infty(\mathbb{R}^N)$ instantaneous shrinking and localization of supports for the solution $u(t)$ at any $t > 0$ are established. With the help of this property, existence and uniqueness of a nonnegative compactly supported and radially symmetric forward self-similar solution with algebraic decay in time are proven. Finally, it is shown that finite time extinction does not occur for a wide class of initial conditions and this unique self-similar solution is the pattern for large time behavior of these general solutions.


title: A Deeper Look into Aleatoric and Epistemic Uncertainty Disentanglement

abstract: Neural networks are ubiquitous in many tasks, but trusting their predictions is an open issue. Uncertainty quantification is required for many applications, and disentangled aleatoric and epistemic uncertainties are best. In this paper, we generalize methods to produce disentangled uncertainties to work with different uncertainty quantification methods, and evaluate their capability to produce disentangled uncertainties. Our results show that: there is an interaction between learning aleatoric and epistemic uncertainty, which is unexpected and violates assumptions on aleatoric uncertainty, some methods like Flipout produce zero epistemic uncertainty, aleatoric uncertainty is unreliable in the out-of-distribution setting, and Ensembles provide overall the best disentangling quality. We also explore the error produced by the number of samples hyper-parameter in the sampling softmax function, recommending N > 100 samples. We expect that our formulation and results help practitioners and researchers choose uncertainty methods and expand the use of disentangled uncertainties, as well as motivate additional research into this topic.


title: Subsonic and supersonic gas flows to condensation surface

abstract: Intense heat-mass transfer in a gas flow to a condensation surface is studied with the consistent atomistic and kinetic theory methods. The simple moment method is utilized for solving the Boltzmann kinetic equation (BKE) for the nonequilibrium gas flow and its condensation, while molecular dynamics (MD) simulation of a similar flow is used for verification of BKE results. We demonstrate that BKE can provide the steady flow profiles close to those obtained from MD simulations in both subsonic and supersonic regimes of steady gas flows. Surprisingly, the elementary theory of condensation is shown with BKE results to have a good accuracy in a wide range of gas flow parameters. MD confirms that a steady supersonic gas flow condensates on a surface at the distinctive temperature after formation of a standing shock front in reference to this surface, which can be interpreted as a permeable condensating piston. The last produces the shock compression but completely absorbs incoming gas flow in contrast to a common impermeable piston. The shock front divides the vapor flow on the supersonic and subsonic zones, and condensation of compressed gas happens in the subsonic regime. The complete and partial condensation regimes are discussed. It is shown that above the certain surface temperatures determined by the shock Hugoniot the runaway shock front stops an inflow gas and condensation is ceased.


title: Where is Your App Frustrating Users?

abstract: User reviews of mobile apps provide a communication channel for developers to perceive user satisfaction. Many app features that users have problems with are usually expressed by key phrases such as "upload pictures", which could be buried in the review texts. The lack of fine-grained view about problematic features could obscure the developers' understanding of where the app is frustrating users, and postpone the improvement of the apps. Existing pattern-based approaches to extract target phrases suffer from low accuracy due to insufficient semantic understanding of the reviews, thus can only summarize the high-level topics/aspects of the reviews. This paper proposes a semantic-aware, fine-grained app review analysis approach (SIRA) to extract, cluster, and visualize the problematic features of apps. The main component of SIRA is a novel BERT+Attr-CRF model for fine-grained problematic feature extraction, which combines textual descriptions and review attributes to better model the semantics of reviews and boost the performance of the traditional BERT-CRF model. SIRA also clusters the extracted phrases based on their semantic relations and presents a visualization of the summaries. Our evaluation on 3,426 reviews from six apps confirms the effectiveness of SIRA in problematic feature extraction and clustering. We further conduct an empirical study with SIRA on 318,534 reviews of 18 popular apps to explore its potential application and examine its usefulness in real-world practice.


title: Wireless Crowd Charging with Battery Aging Mitigation

abstract: Battery aging is one of the major concerns for the pervasive devices such as smartphones, wearables and laptops. Current battery aging mitigation approaches only partially leverage the available options to prolong battery lifetime. In this regard, we claim that wireless crowd charging via network-wide smart charging protocols can provide a useful setting for applying battery aging mitigation. In this paper, for the first time in the state-of-the-art, we couple the two concepts and we design a fine-grained battery aging model in the context of wireless crowd charging, and two network-wide protocols to mitigate battery aging. Our approach directly challenges the related contemporary research paradigms by (i) taking into account important characteristic phenomena in the algorithmic modeling process related to fine-grained battery aging properties, (ii) deploying ubiquitous computing and network-wide protocols for battery aging mitigation, and (iii) fulfilling the user QoE expectations with respect to the enjoyment of a longer battery lifetime. Simulation-based results indicate that the proposed protocols are able to mitigate battery aging quickly in terms of nearly 46.74-60.87% less reduction of battery capacity among the crowd, and partially outperform state-of-the-art protocols in terms of energy balance quality.


title: Classification of log smooth toric del Pezzo pairs

abstract: We give a description of all log-Fano pairs (X, D) where X is a smooth toric surface and D a reduced simple normal crossing divisor such that the pair (X, D) is equivariant.


title: Minimal models of field theories: SDYM and SDGR

abstract: There exists a natural $L_\infty$-algebra or $Q$-manifold that can be associated to any (gauge) field theory. Perturbatively, it can be obtained by reducing the $L_\infty$-algebra behind the jet space BV-BRST formulation to its minimal model. We explicitly construct the minimal models of self-dual Yang-Mills and self-dual gravity theories, which also represents their equations of motion as Free Differential Algebras. The minimal model regains all relevant information about the field theory, e.g. actions, charges, anomalies, can be understood in terms of the corresponding $Q$-cohomology.


title: NTIRE 2022 Challenge on Super-Resolution and Quality Enhancement of Compressed Video: Dataset, Methods and Results

abstract: This paper reviews the NTIRE 2022 Challenge on Super-Resolution and Quality Enhancement of Compressed Video. In this challenge, we proposed the LDV 2.0 dataset, which includes the LDV dataset (240 videos) and 95 additional videos. This challenge includes three tracks. Track 1 aims at enhancing the videos compressed by HEVC at a fixed QP. Track 2 and Track 3 target both the super-resolution and quality enhancement of HEVC compressed video. They require x2 and x4 super-resolution, respectively. The three tracks totally attract more than 600 registrations. In the test phase, 8 teams, 8 teams and 12 teams submitted the final results to Tracks 1, 2 and 3, respectively. The proposed methods and solutions gauge the state-of-the-art of super-resolution and quality enhancement of compressed video. The proposed LDV 2.0 dataset is available at https://github.com/RenYang-home/LDV_dataset. The homepage of this challenge (including open-sourced codes) is at https://github.com/RenYang-home/NTIRE22_VEnh_SR.


title: Learning to Constrain Policy Optimization with Virtual Trust Region

abstract: We introduce a constrained optimization method for policy gradient reinforcement learning, which uses a virtual trust region to regulate each policy update. In addition to using the proximity of one single old policy as the normal trust region, we propose forming a second trust region through another virtual policy representing a wide range of past policies. We then enforce the new policy to stay closer to the virtual policy, which is beneficial if the old policy performs poorly. More importantly, we propose a mechanism to automatically build the virtual policy from a memory of past policies, providing a new capability for dynamically learning appropriate virtual trust regions during the optimization process. Our proposed method, dubbed Memory-Constrained Policy Optimization (MCPO), is examined in diverse environments, including robotic locomotion control, navigation with sparse rewards and Atari games, consistently demonstrating competitive performance against recent on-policy constrained policy gradient methods.


title: Massive Twinning to Enhance Emergent Intelligence

abstract: As a complement to conventional AI solutions, emergent intelligence (EI) exhibits competitiveness in 6G IIoT scenario for its various outstanding features including robustness, protection to privacy, and scalability. However, despite the low computational complexity, EI is challenged by its high demand of data traffic in massive deployment. We propose to leverage massive twinning, which 6G is envisaged to support, to reduce the data traffic in EI and therewith enhance its performance.


title: Regularity in shape optimization under convexity constraint

abstract: This paper is concerned with the regularity of shape optimizers of a class of isoperimetric problems under convexity constraint. We prove that minimizers of the sum of the perimeter and a perturbative term, among convex shapes, are C 1,1-regular. To that end, we define a notion of quasi-minimizer fitted to the convexity context and show that any such quasi-minimizer is C 1,1-regular. The proof relies on a cutting procedure which was introduced to prove similar regularity results in the calculus of variations context. Using a penalization method we are able to treat a volume constraint, showing the same regularity in this case. We go through some examples taken from PDE theory, that is when the perturbative term is of PDE type, and prove that a large class of such examples fit into our C 1,1-regularity result. Finally we provide a counterexample showing that we cannot expect higher regularity in general.


title: Semistable reduction over thick log points

abstract: We establish a version of a semistable reduction theorem over a log point with a non-trivial nilpotent structure. In order to do this we extend the classical desingularization theories to non-reduced schemes with generically principal nilradical.


title: Logarithmic Morphological Neural Nets robust to lighting variations

abstract: Morphological neural networks allow to learn the weights of a structuring function knowing the desired output image. However, those networks are not intrinsically robust to lighting variations in images with an optical cause, such as a change of light intensity. In this paper, we introduce a morphological neural network which possesses such a robustness to lighting variations. It is based on the recent framework of Logarithmic Mathematical Morphology (LMM), i.e. Mathematical Morphology defined with the Logarithmic Image Processing (LIP) model. This model has a LIP additive law which simulates in images a variation of the light intensity. We especially learn the structuring function of a LMM operator robust to those variations, namely : the map of LIP-additive Asplund distances. Results in images show that our neural network verifies the required property.


title: SpiderNet: Hybrid Differentiable-Evolutionary Architecture Search via Train-Free Metrics

abstract: Neural Architecture Search (NAS) algorithms are intended to remove the burden of manual neural network design, and have shown to be capable of designing excellent models for a variety of well-known problems. However, these algorithms require a variety of design parameters in the form of user configuration or hard-coded decisions which limit the variety of networks that can be discovered. This means that NAS algorithms do not eliminate model design tuning, they instead merely shift the burden of where that tuning needs to be applied. In this paper, we present SpiderNet, a hybrid differentiable-evolutionary and hardware-aware algorithm that rapidly and efficiently produces state-of-the-art networks. More importantly, SpiderNet is a proof-of-concept of a minimally-configured NAS algorithm; the majority of design choices seen in other algorithms are incorporated into SpiderNet's dynamically-evolving search space, minimizing the number of user choices to just two: reduction cell count and initial channel count. SpiderNet produces models highly-competitive with the state-of-the-art, and outperforms random search in accuracy, runtime, memory size, and parameter count.


title: Impredicativity and Trees with Gap Condition: A Second Course on Ordinal Analysis

abstract: These lecture notes introduce central notions of impredicative ordinal analysis, such as the Bachmann-Howard ordinal and the method of collapsing, which transforms uncountable proof trees into countable ones. Specifically, we analyze parameter-free $\Pi^1_1$-comprehension and show that it cannot prove the extended Kruskal theorem due to Harvey Friedman (not even for two labels). In terms of prerequisites, we build on a previous lecture on the ordinal analysis of Peano arithmetic. The present material is intended for 12 lectures and 6 exercise sessions of 90 minutes each.


title: Density of rational points on some quadric bundle threefolds

abstract: We prove the Manin-Peyre conjecture for the number of rational points of bounded height outside of a thin subset on a family of Fano threefolds of bidegree (1,2). The proof uses a mixture of the circle method and techniques from the geometry of numbers.


title: Self-supervised Learning for Sonar Image Classification

abstract: Self-supervised learning has proved to be a powerful approach to learn image representations without the need of large labeled datasets. For underwater robotics, it is of great interest to design computer vision algorithms to improve perception capabilities such as sonar image classification. Due to the confidential nature of sonar imaging and the difficulty to interpret sonar images, it is challenging to create public large labeled sonar datasets to train supervised learning algorithms. In this work, we investigate the potential of three self-supervised learning methods (RotNet, Denoising Autoencoders, and Jigsaw) to learn high-quality sonar image representation without the need of human labels. We present pre-training and transfer learning results on real-life sonar image datasets. Our results indicate that self-supervised pre-training yields classification performance comparable to supervised pre-training in a few-shot transfer learning setup across all three methods. Code and self-supervised pre-trained models are be available at https://github.com/agrija9/ssl-sonar-images


title: In-situ imaging of the three-dimensional shape of soft responsive particles at fluid interfaces by atomic force microscopy

abstract: The reconfiguration of soft, deformable particles upon adsorption at the interface between two fluids underpins many aspects of their dynamics and interactions, ultimately controlling the macroscopic properties of particle monolayers of relevance for materials, such as particle-stabilized emulsions and foams, and processes, e. g. particle-based lithography. In spite of its importance, experimentally determining the three-dimensional shape of soft particles at fluid interfaces with high resolution remains an elusive task. In this work, we take poly(N-isopropylacrylamide) (pNIPAM) microgels as model soft particles and demonstrate that their conformation at the interface between an aqueous and an oil phase can be fully reconstructed by means of in-situ atomic force microscopy (AFM) imaging. We show that imaging the particle topography from both sides of the interface allows one to characterize the in-plane deformation of the particle under the action of interfacial tension and to visualize the occurrence of asymmetric swelling in the two fluids. Additionally, the technique enables investigating different fluid phases and particle architectures, as well as studying in situ the effect of temperature variations on particle conformation. We envisage that these results open up an exciting range of possibilities to provide microscopic insights between the single-particle behavior of soft objects at fluid interfaces and macroscopic material properties of relevance for applications and fundamental studies alike.


title: Congestion Mitigation in Unbalanced Residential Networks with OPF-based Demand Management

abstract: This paper proposes a novel congestion mitigation strategy for low voltage residential feeders in which the rising power demand due to the electrification of the transport and heating systems leads to congestion problems. The strategy is based on requiring residential customers to limit their demand for a certain amount of time in exchange for economic benefits. The main novelty of the method consists of combining a thorough representation of the network physics with advanced constraints that ensure the comfort of residential users, in a scalable manner that suits real systems. The mitigation strategy is presented from a DSO perspective, and takes the form of contracts between users and system operator. The focus on user comfort aims to make the contracts appealing, encouraging users to voluntarily enroll in the proposed mitigation scheme. The presented solution is implemented as a mixed-integer multi-period optimal power flow problem which relies on a linearized three-phase power flow formulation. Calculations on 100 real-life distribution feeders are performed, to analyze the congestion-relieving potential of several possible system operator-user contracts. From a planning perspective, the results can help the system operator define contractual terms that make a specific congestion mitigation scheme effective and viable. From an operational perspective, the same calculations can be used to optimally schedule power reduction on a day-ahead basis.


title: On generalisations of the Aharoni-Pouzet base exchange theorem

abstract: The Greene-Magnanti theorem states that if $ M $ is a finite matroid, $ B_0 $ and $ B_1 $ are bases and $ B_0=\bigcup_{i=1}^{n} X_i $ is a partition, then there is a partition $ B_1=\bigcup_{i=1}^{n}Y_i $ such that $ (B_0 \setminus X_i) \cup Y_i $ is a base for every $ i $. The special case where each $ X_i $ is a singleton can be rephrased as the existence of a perfect matching in the base transition graph. Pouzet conjectured that this remains true in infinite dimensional vector spaces. Later he and Aharoni answered this conjecture affirmatively not just for vector spaces but for infinite matroids. We prove two generalisations of their result. On the one hand, we show that `being a singleton' can be relaxed to `being finite' and this is sharp in the sense the exclusion of infinite sets is really necessary. On the other hand, we prove that if $ B_0$ and $ B_1 $ are bases, then there is a bijection $ F $ between their finite subsets such that $ (B_0\setminus I) \cup F(I) $ is a base for every $ I$. In contrast to the approach of Aharoni and Pouzet, our proofs are completely elementary, they do not rely on infinite matching theory.


title: Narrowband spikes observed during the 13 June 2012 flare in the 800-2000 MHz range

abstract: Narrowband (~5 MHz) and short-lived (~0.01 s) spikes with three different distributions on the 800-2000 MHz radio spectrum of the 13 June 2012 flare are detected and analyzed. We designate them as SB (spikes distributed in broad band or bands), SZ (spikes distributed in zebra-like bands) and SBN (spikes distributed in broad and narrow bands). Analyzing AIA/SDO images of the active region NOAA 11504, a rough correspondence between groups of the spikes observed on 1000 MHz and peaks in the time profiles of AIA channels taken from the flare sub-area close to the leading sunspot is found. Among types of spikes the SZ type is the most interesting because it resembles to zebras. Therefore, using auto-correlation and cross-correlation methods we compare SZ and SBN spikes with the typical zebra observed in the same frequency range. While the ratio of SZ band frequencies with their frequency separation (220 MHz) is about 4, 5 and 6, in the zebra the frequency stripe separation is about 24 MHz and the ratio is around 50. Moreover, the bandwidth of SZ bands, which consists of clouds of narrowband spikes, is much broader than that of zebra stripes. This comparison indicates that SZ spikes are generated different way than the zebra, but similar way as SBN spikes. We successfully fit the SZ band frequencies by the Bernstein modes. Based on this fitting we interpret SZ and SBN spikes as those generated in the model with Bernstein modes. Thus, the magnetic field and plasma density in the SZ spike source is estimated as about 79 G and 8.4x10^9 cm-3, respectively.


title: Federated Learning in Multi-Center Critical Care Research: A Systematic Case Study using the eICU Database

abstract: Federated learning (FL) has been proposed as a method to train a model on different units without exchanging data. This offers great opportunities in the healthcare sector, where large datasets are available but cannot be shared to ensure patient privacy. We systematically investigate the effectiveness of FL on the publicly available eICU dataset for predicting the survival of each ICU stay. We employ Federated Averaging as the main practical algorithm for FL and show how its performance changes by altering three key hyper-parameters, taking into account that clients can significantly vary in size. We find that in many settings, a large number of local training epochs improves the performance while at the same time reducing communication costs. Furthermore, we outline in which settings it is possible to have only a low number of hospitals participating in each federated update round. When many hospitals with low patient counts are involved, the effect of overfitting can be avoided by decreasing the batchsize. This study thus contributes toward identifying suitable settings for running distributed algorithms such as FL on clinical datasets.


title: Deterministic Distributed algorithms and Descriptive Combinatorics on \Delta-regular trees

abstract: We study complexity classes of local problems on regular trees from the perspective of distributed local algorithms and descriptive combinatorics. We show that, surprisingly, some deterministic local complexity classes from the hierarchy of distributed computing exactly coincide with well studied classes of problems in descriptive combinatorics. Namely, we show that a local problem admits a continuous solution if and only if it admits a local algorithm with local complexity $O(\log^* n)$, and a Baire measurable solution if and only if it admits a local algorithm with local complexity $O(\log n)$.


title: Group relations, resilience and the I Ching

abstract: We evaluate the robustness and adaptivity of social groups with heterogeneous agents that are characterized by their binary state, their ability to change this state, their status and their preferred relations to other agents. To define group structures, we operationalize the hexagrams of the \emph{I Ching}. The relations and properties of agents are used to quantify their influence according to the social impact theory. From these influence values we derive a weighted stability measure for triads involving three agents, which is based on the weighted balance theory. It allows to quantify the robustness of groups and to propose a novel measure for group resilience which combines robustness and adaptivity. A stochastic approach determines the probabilities to find robust and adaptive groups. The discussion focuses on the generalization of our approach.


title: NFormer: Robust Person Re-identification with Neighbor Transformer

abstract: Person re-identification aims to retrieve persons in highly varying settings across different cameras and scenarios, in which robust and discriminative representation learning is crucial. Most research considers learning representations from single images, ignoring any potential interactions between them. However, due to the high intra-identity variations, ignoring such interactions typically leads to outlier features. To tackle this issue, we propose a Neighbor Transformer Network, or NFormer, which explicitly models interactions across all input images, thus suppressing outlier features and leading to more robust representations overall. As modelling interactions between enormous amount of images is a massive task with lots of distractors, NFormer introduces two novel modules, the Landmark Agent Attention, and the Reciprocal Neighbor Softmax. Specifically, the Landmark Agent Attention efficiently models the relation map between images by a low-rank factorization with a few landmarks in feature space. Moreover, the Reciprocal Neighbor Softmax achieves sparse attention to relevant -- rather than all -- neighbors only, which alleviates interference of irrelevant representations and further relieves the computational burden. In experiments on four large-scale datasets, NFormer achieves a new state-of-the-art. The code is released at \url{https://github.com/haochenheheda/NFormer}.


title: Detection of stellar-like abundance anomalies in the slow solar wind

abstract: The elemental composition of the Sun's hot atmosphere, the corona, shows a distinctive pattern that is different than the underlying surface, or photosphere (Pottasch 1963). Elements that are easy to ionize in the chromosphere are enhanced in abundance in the corona compared to their photospheric values. A similar pattern of behavior is often observed in the slow speed (< 500 km/s) solar wind (Meyer 1985), and in solar-like stellar coronae (Drake et al. 1997), while a reversed effect is seen in M-dwarfs (Liefke et al. 2008). Studies of the inverse effect have been hampered in the past because only unresolved (point source) spectroscopic data were available for these stellar targets. Here we report the discovery of several inverse events observed in-situ in the slow solar wind using particle counting techniques. These very rare events all occur during periods of high solar activity that mimic conditions more widespread on M-dwarfs. The detections allow a new way of connecting the slow wind to its solar source, and are broadly consistent with theoretical models of abundance variations due to chromospheric fast mode waves with amplitudes of 8-10 km/s; sufficient to accelerate the solar wind. The results imply that M-dwarf winds are dominated by plasma depleted in easily ionized elements, and lend credence to previous spectroscopic measurements.


title: Profiling and Evolution of Intellectual Property

abstract: In recent years, with the rapid growth of Internet data, the number and types of scientific and technological resources are also rapidly expanding. However, the increase in the number and category of information data will also increase the cost of information acquisition. For technology-based enterprises or users, in addition to general papers, patents, etc., policies related to technology or the development of their industries should also belong to a type of scientific and technological resources. The cost and difficulty of acquiring users. Extracting valuable science and technology policy resources from a huge amount of data with mixed contents and providing accurate and fast retrieval will help to break down information barriers and reduce the cost of information acquisition, which has profound social significance and social utility. This article focuses on the difficulties and problems in the field of science and technology policy, and introduces related technologies and developments.


title: Unsupervised Domain Adaptation for Cardiac Segmentation: Towards Structure Mutual Information Maximization

abstract: Unsupervised domain adaptation approaches have recently succeeded in various medical image segmentation tasks. The reported works often tackle the domain shift problem by aligning the domain-invariant features and minimizing the domain-specific discrepancies. That strategy works well when the difference between a specific domain and between different domains is slight. However, the generalization ability of these models on diverse imaging modalities remains a significant challenge. This paper introduces UDA-VAE++, an unsupervised domain adaptation framework for cardiac segmentation with a compact loss function lower bound. To estimate this new lower bound, we develop a novel Structure Mutual Information Estimation (SMIE) block with a global estimator, a local estimator, and a prior information matching estimator to maximize the mutual information between the reconstruction and segmentation tasks. Specifically, we design a novel sequential reparameterization scheme that enables information flow and variance correction from the low-resolution latent space to the high-resolution latent space. Comprehensive experiments on benchmark cardiac segmentation datasets demonstrate that our model outperforms previous state-of-the-art qualitatively and quantitatively. The code is available at https://github.com/LOUEY233/Toward-Mutual-Information}{https://github.com/LOUEY233/Toward-Mutual-Information


title: Superradiant instabilities by accretion disks in scalar-tensor theories

abstract: We study the superradiant instability in scalar-tensor theories of gravitation, where matter outside a black hole provides an effective mass to the scalar degree of freedom of the gravitational sector. We discuss this effect for arbitrarily spinning black holes and for realistic models of truncated thin and thick accretion disks (where the perturbation equations are nonseparable), paying particular attention to the role of hot coronal flows in the vicinity of the black hole. The system qualitatively resembles the phenomenology of plasma-driven superradiant instabilities in General Relativity. Nevertheless, we show that the obstacles hampering the efficiency of plasma-driven superradiant instabilities in General Relativity can be circumvented in scalar-tensor theories. We find a wide range of parameter space where superradiant instabilities can be triggered in realistic scenarios, and discuss the constraints on scalar-tensor theories imposed by this effect. In particular, we argue that the existence of highly spinning accreting black holes is in tension with some scalar-tensor alternatives to the dark energy, e.g. symmetron models with screening.


title: On chiral bosons in 2D and 6D

abstract: In the Hamiltonian formulation of chiral 2k-form electrodynamics, the 2k-form potential on the (4k+1)-space is defined up to the addition of either (i) a closed $2k$-form or (ii) an exact 2k-form, depending on the choice of chirality constraint. Case (i) is realized by the Floreanini-Jackiw 2D chiral boson (for k=0) and its Henneaux-Teitelboim generalisation to k>0. For all k, but focusing on the 6D case, we present a simple Lorentz-invariant Hamiltonian model that realizes case (ii), and we derive it from Siegel's manifestly Lorentz invariant Lagrangian formulation.


title: Sequential Point Clouds: A Survey

abstract: Point cloud has drawn more and more research attention as well as real-world applications. However, many of these applications (e.g. autonomous driving and robotic manipulation) are actually based on sequential point clouds (i.e. four dimensions) because the information of the static point cloud data could provide is still limited. Recently, researchers put more and more effort into sequential point clouds. This paper presents an extensive review of the deep learning-based methods for sequential point cloud research including dynamic flow estimation, object detection \& tracking, point cloud segmentation, and point cloud forecasting. This paper further summarizes and compares the quantitative results of the reviewed methods over the public benchmark datasets. Finally, this paper is concluded by discussing the challenges in the current sequential point cloud research and pointing out insightful potential future research directions.


title: Control of magnetic susceptibility of probiotic strain Lactobacillus Rhamnosus GG

abstract: The paper investigates the increase in the natural magnetically controlled properties of probiotic microorganisms Lactobacillus rhamnosus GG (LGG) and their ability to form magnetic sensitive inclusions (MsI). The magnetic susceptibility of LGG was increased by modifying the nutrient medium composition and by cultivating the probiotic culture in a constant magnetic field. Therefore, this study can be useful for their further use as magnetically controlled vectors, since it is being extensively researched for the use in targeted drug delivery in cancer treatment, for the prevention of chemotherapy complications, etc. The results of this study indicate that growing microorganisms with natural magnetically-guided properties in a modified medium with iron chelate and in an external magnetic field leads to an increase in the magnetic susceptibility of LGG by 1,8 and 2,6 times, respectively, compared with the control. The best magnetic susceptibility was recorded for LGG suspensions, which were grown in a constant magnetic field and cultured in modified medium with iron chelate. The LGG suspension, grown both in a constant magnetic field and on a modified medium with iron chelate, had the highest magnetic susceptibility and was 4.8 times larger than the control.


title: Energy-dependent flavor ratios, cascade/track spectrum tension and high-energy neutrinos from magnetospheres of supermassive black holes

abstract: The IceCube neutrino observatory measures the diffuse flux of high-energy astrophysical neutrinos by means of various techniques, and there exists a mild tension between spectra obtained in different analyses. The spectrum derived from reconstruction of muon tracks is harder than that from cascades, dominated by electron and tau neutrinos. If confirmed, this tension may provide a clue to the origin of these neutrinos, which remains uncertain. Here we investigate the possibility that this tension may be caused by the change of the flavor content of astrophysical neutrinos with energy. We assume that at higher energies, the flux contains more muon neutrinos than expected in the usually assumed flavor equipartition. This may happen if the neutrinos are produced in regions of the magnetic field so strong that muons, born in pi-meson decays, cool by synchrotron radiation faster than decay. The magnetic field of $\sim 10^4 G$ is required for this mechanism to be relevant for the IceCube results. We note that these field values are reachable in the immediate vicinity of supermassive black holes in active galactic nuclei and present a working toy model of the population of these potential neutrino sources. While this model predicts the required flavor ratios and describes the high-energy spectrum, it needs an additional component to explain the observed neutrino flux at lower energies.


title: Partitions for stratified sampling

abstract: Classical jittered sampling partitions $[0,1]^d$ into $m^d$ cubes for a positive integer $m$ and randomly places a point inside each of them, providing a point set of size $N=m^d$ with small discrepancy. The aim of this note is to provide a construction of partitions that works for arbitrary $N$ and improves straight-forward constructions. We show how to construct equivolume partitions of the $d$-dimensional unit cube with hyperplanes that are orthogonal to the main diagonal of the cube. We investigate the discrepancy of such point sets and optimise the expected discrepancy numerically by relaxing the equivolume constraint using different black-box optimisation techniques.


title: OutCast: Outdoor Single-image Relighting with Cast Shadows

abstract: We propose a relighting method for outdoor images. Our method mainly focuses on predicting cast shadows in arbitrary novel lighting directions from a single image while also accounting for shading and global effects such the sun light color and clouds. Previous solutions for this problem rely on reconstructing occluder geometry, e.g. using multi-view stereo, which requires many images of the scene. Instead, in this work we make use of a noisy off-the-shelf single-image depth map estimation as a source of geometry. Whilst this can be a good guide for some lighting effects, the resulting depth map quality is insufficient for directly ray-tracing the shadows. Addressing this, we propose a learned image space ray-marching layer that converts the approximate depth map into a deep 3D representation that is fused into occlusion queries using a learned traversal. Our proposed method achieves, for the first time, state-of-the-art relighting results, with only a single image as input. For supplementary material visit our project page at: https://dgriffiths.uk/outcast.


title: Disconnected contributions to the magnetic polarisability of the neutral pion

abstract: The magnetic polarisability of the neutral pion has been calculated using the background field method in lattice QCD. These early results do not consider the effect of the disconnected loop contractions arising from the breaking of charge symmetry in a background magnetic field. Recent work in chiral perturbation theory has shown that these quark-self-annihilation contractions provide the leading loop-order contributions to the magnetic polarisability. A first investigation of these contractions in a background magnetic field is presented.


title: Utilizing unsupervised learning to improve sward content prediction and herbage mass estimation

abstract: Sward species composition estimation is a tedious one. Herbage must be collected in the field, manually separated into components, dried and weighed to estimate species composition. Deep learning approaches using neural networks have been used in previous work to propose faster and more cost efficient alternatives to this process by estimating the biomass information from a picture of an area of pasture alone. Deep learning approaches have, however, struggled to generalize to distant geographical locations and necessitated further data collection to retrain and perform optimally in different climates. In this work, we enhance the deep learning solution by reducing the need for ground-truthed (GT) images when training the neural network. We demonstrate how unsupervised contrastive learning can be used in the sward composition prediction problem and compare with the state-of-the-art on the publicly available GrassClover dataset collected in Denmark as well as a more recent dataset from Ireland where we tackle herbage mass and height estimation.


title: Cyber-Forensic Review of Human Footprint and Gait for Personal Identification

abstract: The human footprint is having a unique set of ridges unmatched by any other human being, and therefore it can be used in different identity documents for example birth certificate, Indian biometric identification system AADHAR card, driving license, PAN card, and passport. There are many instances of the crime scene where an accused must walk around and left the footwear impressions as well as barefoot prints and therefore, it is very crucial to recovering the footprints from identifying the criminals. Footprint-based biometric is a considerably newer technique for personal identification. Fingerprints, retina, iris and face recognition are the methods most useful for attendance record of the person. This time the world is facing the problem of global terrorism. It is challenging to identify the terrorist because they are living as regular as the citizens do. Their soft target includes the industries of special interests such as defence, silicon and nanotechnology chip manufacturing units, pharmacy sectors. They pretend themselves as religious persons, so temples and other holy places, even in markets is in their targets. These are the places where one can obtain their footprints quickly. The gait itself is sufficient to predict the behaviour of the suspects. The present research is driven to identify the usefulness of footprint and gait as an alternative to personal identification.


title: Online Caching with no Regret: Optimistic Learning via Recommendations

abstract: The design of effective online caching policies is an increasingly important problem for content distribution networks, online social networks and edge computing services, among other areas. This paper proposes a new algorithmic toolbox for tackling this problem through the lens of \emph{optimistic} online learning. We build upon the Follow-the-Regularized-Leader (FTRL) framework, which is developed further here to include predictions for the file requests, and we design online caching algorithms for bipartite networks with pre-reserved or dynamic storage subject to time-average budget constraints. The predictions are provided by a content recommendation system that influences the users viewing activity and hence can naturally reduce the caching network's uncertainty about future requests. We also extend the framework to learn and utilize the best request predictor in cases where many are available. We prove that the proposed {optimistic} learning caching policies can achieve \emph{sub-zero} performance loss (regret) for perfect predictions, and maintain the sub-linear regret bound $O(\sqrt T)$, which is the best achievable bound for policies that do not use predictions, even for arbitrary-bad predictions. The performance of the proposed algorithms is evaluated with detailed trace-driven numerical tests.


title: The Impact of Standard Ablation Strategies for Atrial Fibrillation on Cardiovascular Performance in a Four-chamber Heart Model

abstract: Atrial fibrillation is one of the most frequent cardiac arrhythmias in the industrialized world and ablation therapy is the method of choice for many patients. However, ablation scars alter the electrophysiological activation and the mechanical behavior of the affected atria. Different ablation strategies with the aim to terminate atrial fibrillation and prevent its recurrence exist but their impact on the hemodynamic performance of the heart has not been investigated thoroughly. In this work, we present a simulation study analyzing five commonly used ablation scar patterns and their combinations in the left atrium regarding their impact on the pumping function of the heart using an electromechanical whole-heart model. We analyzed how the altered atrial activation and increased stiffness due to the ablation scar affect atrial as well as ventricular contraction and relaxation. We found that systolic and diastolic function of the left atrium is impaired by ablation scars and that the reduction of atrial stroke volume of up to 11.43% depends linearly on the amount of inactivated tissue. Consequently, the end-diastolic volume of the left ventricle, and thus stroke volume, was reduced by up to 1.4% and 1.8%, respectively. During ventricular systole, left atrial pressure was increased by up to 20% due to changes in the atrial activation sequence and the stiffening of scar tissue. This study provides biomechanical evidence that atrial ablation has acute effects not only on atrial contraction but also on ventricular pumping function. Our results have the potential to help tailoring ablation strategies towards minimal global hemodynamic impairment.


title: Active Few-Shot Learning with FASL

abstract: Recent advances in natural language processing (NLP) have led to strong text classification models for many tasks. However, still often thousands of examples are needed to train models with good quality. This makes it challenging to quickly develop and deploy new models for real world problems and business needs. Few-shot learning and active learning are two lines of research, aimed at tackling this problem. In this work, we combine both lines into FASL, a platform that allows training text classification models using an iterative and fast process. We investigate which active learning methods work best in our few-shot setup. Additionally, we develop a model to predict when to stop annotating. This is relevant as in a few-shot setup we do not have access to a large validation set.


title: Paving Springer fibers for E7

abstract: The purpose of this paper is to show that, for each unipotent element in type E7, the corresponding Springer fiber can be paved by affine spaces.


title: Long Term X-Ray Spectral Variation of the Wolf-Rayet Binary WR 102-1 in the Galactic bulge: evidence for wind distortion in the binary

abstract: WR~102-1 was detected by Suzaku as a conspicuous point source in the 6.7 keV intensity map of the central region of the Milky Way. The source was suggested as a possible Wolf-Rayet binary based on its X-ray and infrared spectral characteristics. The iron line emission is expected to originate in the Wolf-Rayet star's dynamic stellar-wind when colliding the companion's mild stellar wind. Here, we report the result of a long-term X-ray monitoring of WR~102-1 since 1998 using archival data of ASCA, XMM-Newton, Chandra, Suzaku, and Swift to reveal variations of the iron K-emission line and the circumstellar absorption. Consequently, we have detected significant redshifts of the iron K-emission line from the XMM-Newton observation in March 2003 and the Suzaku observation in September 2006. Furthermore, when the red-shift was observed, which suggests that the Wolf-Rayet star was in front of the companion star, the circumstellar absorption values were smaller than other periods. These results appear contrary to the expectation if the Wolf-Rayet's stellar wind is spherically symmetric, but may be understood if the Wolf-Rayet star's stellar wind is significantly distorted due to the rapid orbital motion near the periastron.


title: Placement and Resource Allocation of Wireless-Powered Multiantenna UAV for Energy-Efficient Multiuser NOMA

abstract: This paper investigates a new downlink nonorthogonal multiple access (NOMA) system, where a multiantenna unmanned aerial vehicle (UAV) is powered by wireless power transfer (WPT) and serves as the base station for multiple pairs of ground users (GUs) running NOMA in each pair. An energy efficiency (EE) maximization problem is formulated to jointly optimize the WPT time and the placement for the UAV, and the allocation of the UAV's transmit power between different NOMA user pairs and within each pair. To efficiently solve this nonconvex problem, we decompose the problem into three subproblems using block coordinate descent. For the subproblem of intra-pair power allocation within each NOMA user pair, we construct a supermodular game with confirmed convergence to a Nash equilibrium. Given the intra-pair power allocation, successive convex approximation is applied to convexify and solve the subproblem of WPT time allocation and inter-pair power allocation between the user pairs. Finally, we solve the subproblem of UAV placement by using the Lagrange multiplier method. Simulations show that our approach can substantially outperform its alternatives that do not use NOMA and WPT techniques or that do not optimize the UAV location.


title: Sub-Riemannian Landmark Matching and its interpretation as residual neural networks

abstract: The problem of finding a time-dependent vector field which warps an initial set of points to a target set is common in shape analysis. It is an example of a problem in the diffeomorphic shape matching regime, and can be thought of as a spatial discretization of diffeomorphic image matching. In this paper, we consider landmark matching modified by restricting the set of available vector fields in the sense that vector fields are parametrized by a set of controls. We determine the geometric setting of the problem, referred to as sub-Riemannian landmark matching, and derive the equations of motion for the controls. We provide two computational algorithms and demonstrate them in numerical examples. In particular, the experiments highlight the importance of the regularization term. A strong motivation is that sub-Riemannian landmark matching have connections with neural networks, in particular the interpretation of residual neural networks as time discretizations of continuous control problems. It allows shape analysis practitioners to think about neural networks in terms of diffeomorphic landmark matching, thereby providing a bridge between the two fields.


title: Differentiable Collision Avoidance Using Collision Primitives

abstract: A central aspect of robotic motion planning is collision avoidance, where a multitude of different approaches are currently in use. Optimization-based motion planning is one method, that often heavily relies on distance computations between robots and obstacles. These computations can easily become a bottleneck, as they do not scale well with the complexity of the robots or the environment. To improve performance, many different methods suggested to use collision primitives, i.e. simple shapes that approximate the more complex rigid bodies, and that are simpler to compute distances to and from. However, each pair of primitives requires its own specialized code, and certain pairs are known to suffer from numerical issues. In this paper, we propose an easy-to-use, unified treatment of a wide variety of primitives. We formulate distance computation as a minimization problem, which we solve iteratively. We show how to take derivatives of this minimization problem, allowing it to be seamlessly integrated into a trajectory optimization method. Our experiments show that our method performs favourably, both in terms of timing and the quality of the trajectory. The source code of our implementation will be released upon acceptance.


title: Analyzing the Impact of Undersampling on the Benchmarking and Configuration of Evolutionary Algorithms

abstract: The stochastic nature of iterative optimization heuristics leads to inherently noisy performance measurements. Since these measurements are often gathered once and then used repeatedly, the number of collected samples will have a significant impact on the reliability of algorithm comparisons. We show that care should be taken when making decisions based on limited data. Particularly, we show that the number of runs used in many benchmarking studies, e.g., the default value of 15 suggested by the COCO environment, can be insufficient to reliably rank algorithms on well-known numerical optimization benchmarks. Additionally, methods for automated algorithm configuration are sensitive to insufficient sample sizes. This may result in the configurator choosing a `lucky' but poor-performing configuration despite exploring better ones. We show that relying on mean performance values, as many configurators do, can require a large number of runs to provide accurate comparisons between the considered configurations. Common statistical tests can greatly improve the situation in most cases but not always. We show examples of performance losses of more than 20%, even when using statistical races to dynamically adjust the number of runs, as done by irace. Our results underline the importance of appropriately considering the statistical distribution of performance values.


title: Concatenation of dishonest Feller processes, exit laws, and limit theorems on graphs

abstract: We provide a rather explicit formula for the resolvent of a~concatenation of $N$ processes in terms of their exit laws and certain probability measures characterizing the way the processes are concatenated. As an application, we prove an averaging principle saying that by concatenating asymptotically splittable processes one can approximate Markov chains.


title: Non-Geometric Cospectral Mates of Line Graphs with a Linear Representation

abstract: For an incidence geometry $\mathcal{G} = (\mathcal{P}, \mathcal{L}, \text{I})$ with a linear representation $\mathcal{T}_n^*(\mathcal{K})$, we apply WQH switching to construct a non-geometric graph $\Gamma'$ cospectral with the line graph $\Gamma$ of $\mathcal{G}$. As an application, we show that for $h \geq 2$ and $0 < m < h$, there are strongly regular graphs with parameters $(v, k, \lambda, \mu) = (2^{2h} (2^{m+h}+2^m-2^h), 2^h (2^h+1)(2^m-1), 2^h (2^{m+1}-3), 2^h (2^m-1))$ which are not point graphs of partial geometries of order $(s,t,\alpha) = ((2^h+1)(2^m-1), 2^h-1, 2^m-1)$.


title: Identifiability for mixtures of centered Gaussians and sums of powers of quadratics

abstract: We consider the inverse problem for the polynomial map which sends an $m$-tuple of quadratic forms in $n$ variables to the sum of their $d$-th powers. This map captures the moment problem for mixtures of $m$ centered $n$-variate Gaussians. In the first non-trivial case $d = 3$, we show that for any $ n\in \mathbb N $, this map is generically one-to-one (up to permutations of $ q_1,\ldots, q_m $ and third roots of unity) in two ranges: $m\le {n\choose 2} + 1 $ for $n \leq 16$ and $ m\le {n+5 \choose 6}/{n+1 \choose 2}-{n+1 \choose 2}-1$ for $n > 16$, thus proving generic identifiability for mixtures of centered Gaussians from their (exact) moments of degree at most $ 6 $. The first result is obtained by studying the explicit geometry of the tangential contact locus of the variety of sums of cubes of quadratic forms at concrete points, while the second result is accomplished using a link between secant non-defectivity with identifiability. The latter approach generalizes also to sums of $ d $-th powers of $k$-forms for $d \geq 3$ and $k \geq 2$.


title: Random monotone factorisations of the cycle

abstract: In this article we study decreasing and increasing factorisations of the cycle, which are decompositions of the cycle $(1~2\dots n)$ into a product of $n-1$ transpositions satisfying monotonicity conditions. We explicit a bijection between such factorisations and plane trees with $n$ vertices. This will allow us to study some of their combinatorial properties, as well as a geometric representation in terms of laminations, which are non-crossing line segments in the unit disk.


title: Generative or Contrastive? Phrase Reconstruction for Better Sentence Representation Learning

abstract: Though offering amazing contextualized token-level representations, current pre-trained language models actually take less attention on acquiring sentence-level representation during its self-supervised pre-training. If self-supervised learning can be distinguished into two subcategories, generative and contrastive, then most existing studies show that sentence representation learning may more benefit from the contrastive methods but not the generative methods. However, contrastive learning cannot be well compatible with the common token-level generative self-supervised learning, and does not guarantee good performance on downstream semantic retrieval tasks. Thus, to alleviate such obvious inconveniences, we instead propose a novel generative self-supervised learning objective based on phrase reconstruction. Empirical studies show that our generative learning may yield powerful enough sentence representation and achieve performance in Sentence Textual Similarity (STS) tasks on par with contrastive learning. Further, in terms of unsupervised setting, our generative method outperforms previous state-of-the-art SimCSE on the benchmark of downstream semantic retrieval tasks.


title: On the implementation of Adaptive and Filtered MHE

abstract: Optimisation-based algorithms known as Moving Horizon Estimator (MHE) have been developed through the years. This paper illustrates the implementation of the policy introduced in the companion paper submitted to the 18th IFAC Workshop on Control Applications of Optimization [Oliva and Carnevale, 2022], in which we propose two techniques to reduce the computational cost of MHEs. These solutions mainly rely on output filtering and adaptive sampling. The use of filters reduces the total amount of data used by MHE, shortening the length of the moving window (buffer) and consequently decreasing the time consumption for plant dynamics integration. Meanwhile, the proposed adaptive sampling policy discards those sampled data that do not allow a sensible improvement of the estimation error. Algorithms and numerical simulations are provided to show the effectiveness of the proposed strategies.


title: Multi-Component Imaging of the Fermi Gamma-ray Sky in the Spatio-spectral Domain

abstract: We perform two distinct spatio-spectral reconstructions of the gamma-ray sky in the range of 0.56-316 GeV based on Fermi Large Area Telescope (LAT) data. Both describe the sky brightness to be composed of a diffuse-emission and a point-source component. The first model requires minimal assumptions and provides a template-free reconstruction as a reference. It makes use of spatial and spectral correlations to distinguish between the different components. The second model is physics-informed and further differentiates between diffuse emission of hadronic and leptonic origin. For this, we assume parametric, but spatially varying energy spectra to distinguish between the processes and use thermal Galactic dust observations to indicate the preferred sites of hadronic interactions. To account for instrumental effects we model the point-spread, the energy dispersion, and the exposure of the telescope throughout the observation. The reconstruction problem is formulated as a Bayesian inference task, that is solved by variational inference. We show decompositions of the Gamma-ray flux into diffuse and point-like emissions, and of the diffuse emissions into multiple physically motivated components. The diffuse decomposition provides an unprecedented view of the Galactic leptonic diffuse emission. It shows the Fermi bubbles and their spectral variations in high fidelity and other areas exhibiting strong cosmic ray electron contents, such as a thick disk in the inner Galaxy and outflow regions. Furthermore, we report a hard spectrum gamma ray arc in the northern outer bubble co-spatial with the reported X-ray arc by the eROSITA collaboration. All our spatio-spectral sky reconstructions and their uncertainty quantification are publicly available.


title: Lefschetz properties for jacobian rings of cubic fourfolds and other Artinian algebras

abstract: In this paper, we exploit some geometric-differential techniques to prove the strong Lefschetz property in degree $1$ for a complete intersection standard Artinian Gorenstein algebra of codimension $6$ presented by quadrics. We prove also some strong Lefschetz properties for the same kind of Artinian algebras in higher codimensions. Moreover, we analyze some loci that come naturally into the picture of "special" Artinian algebras: for them, we give some geometric descriptions and show a connection between the non emptiness of the so-called non-Lefschetz locus in degree $1$ and the "lifting" of a weak Lefschetz property to an algebra from one of its quotients.


title: Wind power predictions from nowcasts to 4-hour forecasts: a learning approach with variable selection

abstract: We study short-term prediction of wind speed and wind power (every 10 minutes up to 4 hours ahead). Accurate forecasts for these quantities are crucial to mitigate the negative effects of wind farms' intermittent production on energy systems and markets. We use machine learning to combine outputs from numerical weather prediction models with local observations. The former provide valuable information on higher scales dynamics while the latter gives the model fresher and location-specific data. So as to make the results usable for practitioners, we focus on well-known methods which can handle a high volume of data. We study first variable selection using both a linear technique and a nonlinear one. Then we exploit these results to forecast wind speed and wind power still with an emphasis on linear models versus nonlinear ones. For the wind power prediction, we also compare the indirect approach (wind speed predictions passed through a power curve) and the indirect one (directly predict wind power).


title: Aritm\'etica, Grupos y An\'alisis (AGRA II, Cusco, Per\'u)

abstract: These are lecture notes for the AGRA II school, which took place in August 2015 at Universidad de San Antonio Abad del Cusco (Per\'u). They are geared towards graduate students and young researchers. I. Modular forms and Shimura curves (R. J. Miatello, G. Tornar\'ia, A. Pacetti, M. Harris) II. Additive combinatorics (J. Ru\'e, J. Wolf, J. Cilleruelo, P. Candela) III. Introduction to elliptic curves (M. Rebolledo and M. Hindry) IV. Growth in groups and expanders (H. A. Helfgott, M. Belolipetsky) V. Analysis and geometry in groups (A. Zuk) VI. Equidistribution and Diophantine analysis (R. Menares)


title: High resolution X-ray study of supernova remnant J0453.6$-$6829 with unusually high forbidden-to-resonance ratio

abstract: Recent high-resolution X-ray spectroscopy has revealed that several supernova remnants (SNRs) in the Large Magellanic Cloud (LMC) show unusually high forbidden-to-resonance ($f/r$) line ratios. While their origin is still uncertain and debated, most of these SNRs have asymmetric morphology and/or show evidence of interaction with dense material, which may hint at the true nature of the anomalous $f/r$ ratios. Here we report on a detailed spectral analysis of an LMC SNR J0453.6$-$6829 with the Reflection Grating Spectrometer (RGS) onboard XMM-Newton. We find that the $f/r$ ratio of O$~$VII ($=1.06^{+0.09}_{-0.10}$) is significantly higher than expected from the previously-reported thermal model. The spectrum is fairly explained by taking into account a charge exchange (CX) emission in addition to the thermal component. Analyzing archival ATCA & Parkes radio data, we also reveal that H$~$I cloud is possibly interacting with J0453.6$-$6829. These results support the presence of CX in J0453.6$-$6829, as the origin of the obtained high $f/r$ ratio. Although a contribution of the resonance scattering (RS) cannot be ruled out at this time, we conclude that CX seems more likely than RS considering the relatively symmetric morphology of this remnant.


title: A Construction for Variable Dimension Strong Non-Overlapping Matrices

abstract: We propose a method for the construction of sets of variable dimension strong non-overlapping matrices basing on any strong non-overlapping set of strings.


title: Analyzing the Intensity of Complaints on Social Media

abstract: Complaining is a speech act that expresses a negative inconsistency between reality and human expectations. While prior studies mostly focus on identifying the existence or the type of complaints, in this work, we present the first study in computational linguistics of measuring the intensity of complaints from text. Analyzing complaints from such perspective is particularly useful, as complaints of certain degrees may cause severe consequences for companies or organizations. We create the first Chinese dataset containing 3,103 posts about complaints from Weibo, a popular Chinese social media platform. These posts are then annotated with complaints intensity scores using Best-Worst Scaling (BWS) method. We show that complaints intensity can be accurately estimated by computational models with the best mean square error achieving 0.11. Furthermore, we conduct a comprehensive linguistic analysis around complaints, including the connections between complaints and sentiment, and a cross-lingual comparison for complaints expressions used by Chinese and English speakers. We finally show that our complaints intensity scores can be incorporated for better estimating the popularity of posts on social media.


title: Gravitational waveform model based on photon motion for spinning black holes

abstract: The waveforms from binary black hole mergers include inspiral, merger, and ringdown parts. Usually, the inspiral waveform can be obtained by calibrating from post-Newtonian approximation; The merger and ringdown ones can be gotten from the quasinormal modes with black hole perturbation theory. However, for more general black holes, the calculation of the quasinormal modes is not trivial. In this paper we use the photon sphere to get the quasinormal modes of spinning black holes. Then we connect the ringdown wave with the inspiral part to get full waveforms and compare with the ones from numerical relativity. We find that they match with each other very well. In principle this method can be extended to some general compact objects. As an example, the ringdown waveforms from parametrized axisymmetric black holes are obtained. We also use this method to get the ringdown signals of the accelerating final black hole; this is due to gravitational recoil during the merger. Even for the extreme cases, the acceleration due to the recoil cannot produce detectable effects.


title: BugListener: Identifying and Synthesizing Bug Reports from Collaborative Live Chats

abstract: In community-based software development, developers frequently rely on live-chatting to discuss emergent bugs/errors they encounter in daily development tasks. However, it remains a challenging task to accurately record such knowledge due to the noisy nature of interleaved dialogs in live chat data. In this paper, we first formulate the task of identifying and synthesizing bug reports from community live chats, and propose a novel approach, named BugListener, to address the challenges. Specifically, BugListener automates three sub-tasks: 1) Disentangle the dialogs from massive chat logs by using a Feed-Forward neural network; 2) Identify the bug-report dialogs from separated dialogs by modeling the original dialog to the graph-structured dialog and leveraging the graph neural network to learn the contextual information; 3) Synthesize the bug reports by utilizing the TextCNN model and Transfer Learning network to classify the sentences into three groups: observed behaviors (OB), expected behaviors (EB), and steps to reproduce the bug (SR). BugListener is evaluated on six open source projects. The results show that: for bug report identification, BugListener achieves the average F1 of 74.21%, improving the best baseline by 10.37%; and for bug report synthesis task, BugListener could classify the OB, EB, and SR sentences with the F1 of 67.37%, 87.14%, and 65.03%, improving the best baselines by 7.21%, 7.38%, 5.30%, respectively. A human evaluation also confirms the effectiveness of BugListener in generating relevant and accurate bug reports. These demonstrate the significant potential of applying BugListener in community-based software development, for promoting bug discovery and quality improvement.


title: A Variational Autoencoder for Heterogeneous Temporal and Longitudinal Data

abstract: The variational autoencoder (VAE) is a popular deep latent variable model used to analyse high-dimensional datasets by learning a low-dimensional latent representation of the data. It simultaneously learns a generative model and an inference network to perform approximate posterior inference. Recently proposed extensions to VAEs that can handle temporal and longitudinal data have applications in healthcare, behavioural modelling, and predictive maintenance. However, these extensions do not account for heterogeneous data (i.e., data comprising of continuous and discrete attributes), which is common in many real-life applications. In this work, we propose the heterogeneous longitudinal VAE (HL-VAE) that extends the existing temporal and longitudinal VAEs to heterogeneous data. HL-VAE provides efficient inference for high-dimensional datasets and includes likelihood models for continuous, count, categorical, and ordinal data while accounting for missing observations. We demonstrate our model's efficacy through simulated as well as clinical datasets, and show that our proposed model achieves competitive performance in missing value imputation and predictive accuracy.


title: Multi-Level Interaction Reranking with User Behavior History

abstract: As the final stage of the multi-stage recommender system (MRS), reranking directly affects users' experience and satisfaction, thus playing a critical role in MRS. Despite the improvement achieved in the existing work, three issues are yet to be solved. First, users' historical behaviors contain rich preference information, such as users' long and short-term interests, but are not fully exploited in reranking. Previous work typically treats items in history equally important, neglecting the dynamic interaction between the history and candidate items. Second, existing reranking models focus on learning interactions at the item level while ignoring the fine-grained feature-level interactions. Lastly, estimating the reranking score on the ordered initial list before reranking may lead to the early scoring problem, thereby yielding suboptimal reranking performance. To address the above issues, we propose a framework named Multi-level Interaction Reranking (MIR). MIR combines low-level cross-item interaction and high-level set-to-list interaction, where we view the candidate items to be reranked as a set and the users' behavior history in chronological order as a list. We design a novel SLAttention structure for modeling the set-to-list interactions with personalized long-short term interests. Moreover, feature-level interactions are incorporated to capture the fine-grained influence among items. We design MIR in such a way that any permutation of the input items would not change the output ranking, and we theoretically prove it. Extensive experiments on three public and proprietary datasets show that MIR significantly outperforms the state-of-the-art models using various ranking and utility metrics.


title: Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification

abstract: Incorrect labels in training data occur when human annotators make mistakes or when the data is generated via weak or distant supervision. It has been shown that complex noise-handling techniques - by modeling, cleaning or filtering the noisy instances - are required to prevent models from fitting this label noise. However, we show in this work that, for text classification tasks with modern NLP models like BERT, over a variety of noise types, existing noisehandling methods do not always improve its performance, and may even deteriorate it, suggesting the need for further investigation. We also back our observations with a comprehensive analysis.


title: Constructions of Polyphase Golay Complementary Arrays

abstract: Golay complementary matrices (GCM) have recently drawn considerable attentions owing to its potential applications in omnidirectional precoding. In this paper we generalize the GCM to multi-dimensional Golay complementary arrays (GCA) and propose new constructions of GCA pairs and GCA quads. These constructions are facilitated by introducing a set of identities over a commutative ring. We prove that a quaternary GCA pair is feasible if the product of the array sizes in all dimensions is a quaternary Golay number with an additional constraint on the factorization of the product. For the binary GCM quads, we conjecture that the feasible sizes are arbitrary, and verify for sizes within 78 $\times$ 78 and other less densely distributed sizes. For the quaternary GCM quads, all the positive integers within 1000 can be covered for the size in one dimension.