title: Contextual Expressive Text-to-Speech

abstract: The goal of expressive Text-to-speech (TTS) is to synthesize natural speech with desired content, prosody, emotion, or timbre, in high expressiveness. Most of previous studies attempt to generate speech from given labels of styles and emotions, which over-simplifies the problem by classifying styles and emotions into a fixed number of pre-defined categories. In this paper, we introduce a new task setting, Contextual TTS (CTTS). The main idea of CTTS is that how a person speaks depends on the particular context she is in, where the context can typically be represented as text. Thus, in the CTTS task, we propose to utilize such context to guide the speech synthesis process instead of relying on explicit labels of styles and emotions. To achieve this task, we construct a synthetic dataset and develop an effective framework. Experiments show that our framework can generate high-quality expressive speech based on the given context both in synthetic datasets and real-world scenarios.


title: Multi-indexed poly-Bernoulli numbers

abstract: As properties of poly-Bernoulli numbers, a number of formulas such as the duality formula, explicit formula using the Stirling numbers of the second kind and periodicity for negative upper-index have been established. For the multi-indexed poly-Bernoulli numbers generalized by Kaneko-Tsumura, among such properties only the duality formula was obtained. In this paper, we restrict the double-indexed poly-Bernoulli numbers and show the explicit formula using the Stirling numbers of the second kind and periodicity for negative upper-index for them. Further, we define the variant of multiple-indexed poly-Bernoulli numbers using the star-version of multiple-indexed logarithms and obtain the relation between this kind of double and triple-indexed poly-Bernoulli numbers with multi-indexed poly-Bernoulli numbers ahead.


title: Toward nuclear physics from lattice QCD on quantum computers

abstract: One of the ultimate missions of lattice QCD is to simulate atomic nuclei from the first principle of the strong interaction. This is an extremely hard task for the current computational technology, but might be reachable in coming quantum computing era. In this paper, we discuss the computational complexities of classical and quantum simulations of lattice QCD. It is shown that the quantum simulation scales better as a function of a nucleon number and thus will outperform for large nuclei.


title: The criterion on the Propulsive Balance of Oblique Detonation Engine

abstract: The oblique detonation engine (ODE) has established a clear superiority for hypersonic flight because of its high thermal efficiency and compact structure. It has become the research hot spot all over the world in recent years. The aim of this study is to derive a criterion on the propulsive balance of ODE, from which we can find the key parameters governing the propulsive performance explicitly. A physical model of ODE is put forth, which consists of the inlet, the constant cross-section combustor and the divergent nozzle. The mathematical equations to calculate the thrust generated by the divergent nozzle and the pressure drag produced by the inlet are deduced. The net thrust of ODE is then obtained. The criterion shows clearly that the static temperature at the engine inlet exit is a very important parameter. The lower the inlet exit temperature is, the higher the specific impulse will be. The specific impulse of ODE with stoichiometric H2/air mixture and hydrocarbon/air mixture are calculated by using these equations. The results show that ODE can obtain positive net thrust from Ma8 to Ma15.


title: Cross-Field Transformer for Diabetic Retinopathy Grading on Two-field Fundus Images

abstract: Automatic diabetic retinopathy (DR) grading based on fundus photography has been widely explored to benefit the routine screening and early treatment. Existing researches generally focus on single-field fundus images, which have limited field of view for precise eye examinations. In clinical applications, ophthalmologists adopt two-field fundus photography as the dominating tool, where the information from each field (i.e.,macula-centric and optic disc-centric) is highly correlated and complementary, and benefits comprehensive decisions. However, automatic DR grading based on two-field fundus photography remains a challenging task due to the lack of publicly available datasets and effective fusion strategies. In this work, we first construct a new benchmark dataset (DRTiD) for DR grading, consisting of 3,100 two-field fundus images. To the best of our knowledge, it is the largest public DR dataset with diverse and high-quality two-field images. Then, we propose a novel DR grading approach, namely Cross-Field Transformer (CrossFiT), to capture the correspondence between two fields as well as the long-range spatial correlations within each field. Considering the inherent two-field geometric constraints, we particularly define aligned position embeddings to preserve relative consistent position in fundus. Besides, we perform masked cross-field attention during interaction to flter the noisy relations between fields. Extensive experiments on our DRTiD dataset and a public DeepDRiD dataset demonstrate the effectiveness of our CrossFiT network. The new dataset and the source code of CrossFiT will be publicly available at https://github.com/FDU-VTS/DRTiD.


title: A Remote Baby Surveillance System with RFID and GPS Tracking

abstract: In the 21st century, sending babies or children to daycare centres has become more and more common among young guardians. The balance between full-time work and child care is increasingly challenging nowadays. In Malaysia, thousands of child abuse cases have been reported from babysitting centres every year, which indeed triggers the anxiety and stress of the guardians. Hence, this paper proposes to construct a remote baby surveillance system with radio-frequency identification (RFID) and global positioning system (GPS) tracking. With the incorporation of the Internet of Things (IoT), a sensor-based microcontroller is used to detect the conditions of the baby as well as the surrounding environment and then display the real-time data as well as notifications to alert the guardians via a mobile application. These conditions include the crying and waking of the baby, as well as temperature, the mattress's wetness, and moving objects around the baby. In addition, RFID and GPS location tracking are implemented to ensure the safety of the baby, while white noise is used to increase the comfort of the baby. In the end, a prototype has been successfully developed for functionality and reliability testing. Several experiments have been conducted to measure the efficiency of the mattress's wetness detection, the RFID transmission range, the frequency spectrum of white noise, and also the output power of the solar panel. The proposed system is expected to assist guardians in ensuring the safety and comfort of their babies remotely, as well as prevent any occurrence of child abuse.


title: DynaGAN: Dynamic Few-shot Adaptation of GANs to Multiple Domains

abstract: Few-shot domain adaptation to multiple domains aims to learn a complex image distribution across multiple domains from a few training images. A na\"ive solution here is to train a separate model for each domain using few-shot domain adaptation methods. Unfortunately, this approach mandates linearly-scaled computational resources both in memory and computation time and, more importantly, such separate models cannot exploit the shared knowledge between target domains. In this paper, we propose DynaGAN, a novel few-shot domain-adaptation method for multiple target domains. DynaGAN has an adaptation module, which is a hyper-network that dynamically adapts a pretrained GAN model into the multiple target domains. Hence, we can fully exploit the shared knowledge across target domains and avoid the linearly-scaled computational requirements. As it is still computationally challenging to adapt a large-size GAN model, we design our adaptation module light-weight using the rank-1 tensor decomposition. Lastly, we propose a contrastive-adaptation loss suitable for multi-domain few-shot adaptation. We validate the effectiveness of our method through extensive qualitative and quantitative evaluations.


title: Distribution Free Prediction Sets for Node Classification

abstract: Graph Neural Networks (GNNs) are able to achieve high classification accuracy on many important real world datasets, but provide no rigorous notion of predictive uncertainty. Quantifying the confidence of GNN models is difficult due to the dependence between datapoints induced by the graph structure. We leverage recent advances in conformal prediction to construct prediction sets for node classification in inductive learning scenarios. We do this by taking an existing approach for conformal classification that relies on \textit{exchangeable} data and modifying it by appropriately weighting the conformal scores to reflect the network structure. We show through experiments on standard benchmark datasets using popular GNN models that our approach provides tighter and better calibrated prediction sets than a naive application of conformal prediction.


title: Multiple imputation for logistic regression models: incorporating an interaction

abstract: Background: Multiple imputation is often used to reduce bias and gain efficiency when there is missing data. The most appropriate imputation method depends on the model the analyst is interested in fitting. Several imputation approaches have been proposed for when this model is a logistic regression model with an interaction term that contains a binary partially observed variable; however, it is not clear which performs best under certain parameter settings. Methods: Using 1000 simulations, each with 10,000 observations, under six data-generating mechanisms (DGM), we investigate the performance of four methods: (i) 'passive imputation', (ii) 'just another variable' (JAV), (iii) 'stratify-impute-append' (SIA), and (iv) 'substantive model compatible fully conditional specifica-tion' (SMCFCS). The application of each method is shown in an empirical example using England-based cancer registry data. Results: SMCFCS and SIA showed the least biased estimate of the coefficients for the fully, and partially, observed variable and the interaction term. SMCFCS and SIA showed good coverage and low relative error for all DGMs. SMCFCS had a large bias when there was a low prevalence of the fully observed variable in the interaction. SIA performed poorly when the fully observed variable in the interaction had a continuous underlying form. Conclusion: SMCFCS and SIA give consistent estimation for logistic regression models with an interaction term when data are missing at random, and either can be used in most analyses. SMCFCS performed better than SIA when the fully observed variable in the interaction had an underlying continuous form. Researchers should be cautious when using SMCFCS when there is a low prevalence of the fully observed variable in the interaction.


title: CMC v2: Towards More Accurate COVID-19 Detection with Discriminative Video Priors

abstract: This paper presents our solution for the 2nd COVID-19 Competition, occurring in the framework of the AIMIA Workshop at the European Conference on Computer Vision (ECCV 2022). In our approach, we employ the winning solution last year which uses a strong 3D Contrastive Mixup Classifcation network (CMC v1) as the baseline method, composed of contrastive representation learning and mixup classification. In this paper, we propose CMC v2 by introducing natural video priors to COVID-19 diagnosis. Specifcally, we adapt a pre-trained (on video dataset) video transformer backbone to COVID-19 detection. Moreover, advanced training strategies, including hybrid mixup and cutmix, slicelevel augmentation, and small resolution training are also utilized to boost the robustness and the generalization ability of the model. Among 14 participating teams, CMC v2 ranked 1st in the 2nd COVID-19 Competition with an average Macro F1 Score of 89.11%.


title: Toward Universal Text-to-Music Retrieval

abstract: This paper introduces effective design choices for text-to-music retrieval systems. An ideal text-based retrieval system would support various input queries such as pre-defined tags, unseen tags, and sentence-level descriptions. In reality, most previous works mainly focused on a single query type (tag or sentence) which may not generalize to another input type. Hence, we review recent text-based music retrieval systems using our proposed benchmark in two main aspects: input text representation and training objectives. Our findings enable a universal text-to-music retrieval system that achieves comparable retrieval performances in both tag- and sentence-level inputs. Furthermore, the proposed multimodal representation generalizes to 9 different downstream music classification tasks. We present the code and demo online.


title: Boosting COVID-19 Severity Detection with Infection-aware Contrastive Mixup Classification

abstract: This paper presents our solution for the 2nd COVID-19 Severity Detection Competition. This task aims to distinguish the Mild, Moderate, Severe, and Critical grades in COVID-19 chest CT images. In our approach, we devise a novel infection-aware 3D Contrastive Mixup Classification network for severity grading. Specifcally, we train two segmentation networks to first extract the lung region and then the inner lesion region. The lesion segmentation mask serves as complementary information for the original CT slices. To relieve the issue of imbalanced data distribution, we further improve the advanced Contrastive Mixup Classification network by weighted cross-entropy loss. On the COVID-19 severity detection leaderboard, our approach won the first place with a Macro F1 Score of 51.76%. It significantly outperforms the baseline method by over 11.46%.


title: A dynamic multi-region MFD model for ride-sourcing with ridesplitting

abstract: Dynamic network-level models directly addressing ride-sourcing services can support the development of efficient strategies for both congestion alleviation and promotion of more sustainable mobility. Recent developments presented models focusing on ride-hailing (solo rides), but no work addressed ridesplitting (shared rides) in dynamic contexts. Here, we sought to develop a dynamic aggregated traffic network model capable of representing ride-sourcing services and background traffic in a macroscopic multi-region urban network. We combined the Macroscopic Fundamental Diagram (MFD) with detailed state-space and transition descriptions of background traffic and ride-sourcing vehicles in their activities to formulate mass conservation equations. Accumulation-based MFD models might experience additional errors due to the variation profile of trip lengths, e.g., when vehicles cruise for passengers. We integrate the so-called M-model that utilizes the total remaining distance to capture dynamics of regional and inter-regional flows and accumulations for different vehicle (private or ride-sourcing) states. This aggregated model is capable to reproduce the dynamics of complex systems without using resource-expensive simulations. We also show that the model can accurately forecast the vehicles' conditions in near-future predictions. Later, a comparison with benchmark models showed lower errors in the proposed model in all states. Finally, we evaluated the model's robustness to noises in its inputs, and forecast errors remained below 15% even where inputs were 20% off the actual values for ride-sourcing vehicles. The development of such a model prepares the path for developing real-time feedback-based management policies such as priority-based perimeter control or repositioning strategies for idle ride-sourcing vehicles and developing regulations over ride-sourcing in congested areas.


title: Quantum Speed Limit From Tighter Uncertainty Relation

abstract: The quantum speed limit provides a fundamental bound on how fast a quantum system can evolve between the initial and the final states under any physical operation. The celebrated Mandelstam-Tamm (MT) bound has been widely studied for various quantum systems undergoing unitary time evolution. Here, we prove a new quantum speed limit using the tighter uncertainty relations for pure quantum systems undergoing arbitrary unitary evolution. We also derive a tighter uncertainty relation for mixed quantum states and then derive a new quantum speed limit for mixed quantum states from it such that it reduces to that of the pure quantum states derived from tighter uncertainty relations. We show that the MT bound is a special case of the tighter quantum speed limit derived here. We also show that this bound can be improved when optimized over many different sets of basis vectors. We illustrate the tighter speed limit for pure states with examples using random Hamiltonians and show that the new quantum speed limit outperforms the MT bound.


title: Helicity amplitudes in light-cone and Feynman-diagram gauges

abstract: Recently proposed Feynman-diagram (FD) gauge propagator for massless and massive gauge bosons is obtained from a light-cone (LC) gauge propagator, by choosing the gauge vector along the opposite direction of the gauge boson three-momentum. We implement a general LC gauge propagator for all the gauge bosons of the Standard Model (SM) in the HELicity Amplitude Subroutines (HELAS) codes, such that all the SM helicity amplitudes can be evaluated at the tree level in the LC gauge by using MadGraph. We confirm that our numerical codes produce physical helicity amplitudes which are consistent among all gauge choices. We then study interference patterns among Feynman amplitudes, for a few $2\to3$ scattering processes in QED and QCD, and the process $\gamma\gamma\to W^+W^-$ followed by the $W^\pm$ decays. We find that in a generic LC gauge, where all the gauge boson propagators share a common gauge vector, we cannot remove the off-shell current components which grow with their energy systematically from all the Feynman amplitudes in $2\to3$ processes. On the other hand, the $5\times5$ LC gauge propagator for the weak bosons removes components which grow with energy due to the longitudinal polarization mode of the external bi-fermion currents, and hence can give $2\to2$ weak boson scattering amplitudes which are free from subtle cancellation at high energies. The particular choice of the FD gauge vector has advantages over generic LC gauge, not only because all the terms which grow with energy of off-shell and on-shell currents are removed systematically from all the diagrams, but also because no artificial gauge vector direction dependence of individual amplitudes appears.


title: Who are you referring to? Coreference resolution in image narrations

abstract: Coreference resolution aims to identify words and phrases which refer to same entity in a text, a core task in natural language processing. In this paper, we extend this task to resolving coreferences in long-form narrations of visual scenes. First we introduce a new dataset with annotated coreference chains and their bounding boxes, as most existing image-text datasets only contain short sentences without coreferring expressions or labeled chains. We propose a new technique that learns to identify coreference chains using weak supervision, only from image-text pairs and a regularization using prior linguistic knowledge. Our model yields large performance gains over several strong baselines in resolving coreferences. We also show that coreference resolution helps improving grounding narratives in images.


title: Siamese Object Tracking for Vision-Based UAM Approaching with Pairwise Scale-Channel Attention

abstract: Although the manipulating of the unmanned aerial manipulator (UAM) has been widely studied, vision-based UAM approaching, which is crucial to the subsequent manipulating, generally lacks effective design. The key to the visual UAM approaching lies in object tracking, while current UAM tracking typically relies on costly model-based methods. Besides, UAM approaching often confronts more severe object scale variation issues, which makes it inappropriate to directly employ state-of-the-art model-free Siamese-based methods from the object tracking field. To address the above problems, this work proposes a novel Siamese network with pairwise scale-channel attention (SiamSA) for vision-based UAM approaching. Specifically, SiamSA consists of a pairwise scale-channel attention network (PSAN) and a scale-aware anchor proposal network (SA-APN). PSAN acquires valuable scale information for feature processing, while SA-APN mainly attaches scale awareness to anchor proposing. Moreover, a new tracking benchmark for UAM approaching, namely UAMT100, is recorded with 35K frames on a flying UAM platform for evaluation. Exhaustive experiments on the benchmarks and real-world tests validate the efficiency and practicality of SiamSA with a promising speed. Both the code and UAMT100 benchmark are now available at https://github.com/vision4robotics/SiamSA.


title: On the Joint Estimation of Phase Noise and Time-Varying Channels for OFDM under High-Mobility Conditions

abstract: The combination of the effects of Doppler frequency shifts (due to mobility) and phase noise (due to the imperfections of oscillators operating at a high carrier frequency) poses serious challenges to Orthogonal Frequency Division Multiplexing (OFDM) wireless transmissions in terms of channel estimation and phase noise tracking performance and the associated pilot overhead required for that estimation and tracking. In this paper, we use separate sets of Basis Expansion Model (BEM) coefficients for modelling the time variation over intervals of several OFDM symbols of the channel paths and the phase noise process. Based on this model, an efficient solution approximating the maximum-likelihood joint estimation of these BEM coefficients is derived and shown to outperform state-of-the-art phase noise compensation methods


title: Poly-meromorphic It\^o-Hermite functions associated with a singular potential vector on the punctured complex plane

abstract: We provide a theoretical study of a new family of orthogonal functions on the punctured complex plane solving the eigenvalue problems for some magnetic Laplacian perturbed by a singular vector potential with zero magnetic field modeling the Aharonov-Bohm effect. The functions are defined by their $\beta$-modified Rodrigues type formula and extend the poly-analytic It\^o--Hermite polynomials to the poly-meromorphic setting. Mainly, we derive their different operational representations and give their explicit expressions in terms of special functions. Different generating functions and integral representations are obtained.


title: Valid and efficient imprecise-probabilistic inference with partial priors, II. General framework

abstract: Bayesian inference requires specification of a single, precise prior distribution, whereas frequentist inference only accommodates a vacuous prior. Since virtually every real-world application falls somewhere in between these two extremes, a new approach is needed. This series of papers develops a new framework that provides valid and efficient statistical inference, prediction, etc., while accommodating partial prior information and imprecisely-specified models more generally. This paper fleshes out a general inferential model construction that not only yields tests, confidence intervals, etc.~with desirable error rate control guarantees, but also facilitates valid probabilistic reasoning with de~Finetti-style no-sure-loss guarantees. The key technical novelty here is a so-called outer consonant approximation of a general imprecise probability which returns a data- and partial prior-dependent possibility measure to be used for inference and prediction. Despite some potentially unfamiliar imprecise-probabilistic concepts in the development, the result is an intuitive, likelihood-driven framework that will, as expected, agree with the familiar Bayesian and frequentist solutions in the respective extreme cases. More importantly, the proposed framework accommodates partial prior information where available and, therefore, leads to new solutions that were previously out of reach for both Bayesians and frequentists. Details are presented here for a wide range of examples, with more practical details to come in later installments.


title: BeGin: Extensive Benchmark Scenarios and An Easy-to-use Framework for Graph Continual Learning

abstract: Continual Learning (CL) is the process of learning ceaselessly a sequence of tasks. Most existing CL methods deal with independent data (e.g., images and text) for which many benchmark frameworks and results under standard experimental settings are available. Compared to them, however, CL methods for graph data (graph CL) are relatively underexplored because of (a) the lack of standard experimental settings, especially regarding how to deal with the dependency between instances, (b) the lack of benchmark datasets and scenarios, and (c) high complexity in implementation and evaluation due to the dependency. In this paper, regarding (a) we define four standard incremental settings (task-, class-, domain-, and time-incremental) for node-, link-, and graph-level problems, extending the previously explored scope. Regarding (b), we provide 31 benchmark scenarios based on 20 real-world graphs. Regarding (c), we develop BeGin, an easy and fool-proof framework for graph CL. BeGin is easily extended since it is modularized with reusable modules for data processing, algorithm design, and evaluation. Especially, the evaluation module is completely separated from user code to eliminate potential mistakes. Regarding benchmark results, we cover 3X more combinations of incremental settings and levels of problems than the latest benchmark. All assets for the benchmark framework are publicly available at https://github.com/ShinhwanKang/BeGin.


title: Online Optimization in Power Systems with High Penetration of Renewable Generation: Advances and Prospects

abstract: Traditionally, offline optimization of power systems is acceptable due to the largely predictable loads and reliable generation. The increasing penetration of fluctuating renewable generation and Internet-of-Things devices allowing for fine-grained controllability of loads have led to the diminishing applicability of offline optimization in the power systems domain, and have redirected attention to online optimization methods. However, online optimization is a broad topic that can be applied in and motivated by different settings, operated on different time scales, and built on different theoretical foundations. This paper reviews the various types of online optimization techniques used in the power systems domain and aims to make clear the distinction between the most common techniques used. In particular, we introduce and compare four distinct techniques used covering the breadth of online optimization techniques used in the power systems domain, i.e., optimization-guided dynamic control, feedback optimization for single-period problems, Lyapunov-based optimization, and online convex optimization techniques for multi-period problems. Lastly, we recommend some potential future directions for online optimization in the power systems domain.


title: The Role of In-House Procurement According to Finnish Municipalities' Purchase Invoice Data

abstract: Public sector is a large consumer of ICT systems and services, used for various public services. Tendering for such systems is governed by laws aimed at eliminating unfair advantages and offering all possible parties equal opportunities to participate in the tendering process. In this article, we study in-house rpocurement, where the acquiring organization is an owner of the subcontractor that delivers the system or the service. Municipalities' purchase invoice data is used to determine how much municipalities in Finland depend on in-house procurement. In conclusion, the understanding if included municipalities have ICT service and development units within the organizations needs closer examination, as in-house companies may offer municipalities with limited resources divided costs in the public procurement process.


title: Complexity of the variable-free fragment of the weak Grzegorczyk logic

abstract: The paper proves PSPACE-hardness of variable-free fragments of all logics between K and wGrz.


title: Identifying a 3-vertex strongly biconnected directed subgraph with minimum number of edges

abstract: A strongly connected graph is strongly biconnected if after ignoring the direction of its edges we have an undirected graph with no articulation points. A 3-vertex strongly biconnected graph is a strongly biconnected digraph that has the property that deleting any two vertices in this graph leaves a strongly binconnected subgraph. Jaberi [11] presented approximation algorithms for minimum cardinality 2-vertex strongly biconnected directed subgraph problem. We will focus in this paper on polynomial time algorithms which we have implemented for producing spanning subgraphs that are 3-vertex strongly biconnected.


title: Deep Curvilinear Editing: Commutative and Nonlinear Image Manipulation for Pretrained Deep Generative Model

abstract: Semantic editing of images is the fundamental goal of computer vision. Although deep learning methods, such as generative adversarial networks (GANs), are capable of producing high-quality images, they often do not have an inherent way of editing generated images semantically. Recent studies have investigated a way of manipulating the latent variable to determine the images to be generated. However, methods that assume linear semantic arithmetic have certain limitations in terms of the quality of image editing, whereas methods that discover nonlinear semantic pathways provide non-commutative editing, which is inconsistent when applied in different orders. This study proposes a novel method called deep curvilinear editing (DeCurvEd) to determine semantic commuting vector fields on the latent space. We theoretically demonstrate that owing to commutativity, the editing of multiple attributes depends only on the quantities and not on the order. Furthermore, we experimentally demonstrate that compared to previous methods, the nonlinear and commutative nature of DeCurvEd facilitates the disentanglement of image attributes and provides higher-quality editing.


title: Very High-Order A-stable Stiffly Accurate Diagonally Implicit Runge-Kutta Methods with Error Estimators

abstract: A numerical search approach is used to design high-order diagonally implicit Runge-Kutta (DIRK) schemes equipped with embedded error estimators, some of which have identical diagonal elements (SDIRK) and explicit first stage (ESDIRK). In each of these classes, we present new A-stable schemes of order six (the highest order of previously known A-stable DIRK-type schemes) up to order eight. For each order, we include one scheme that is only A-stable as well as schemes that are L-stable, stiffly accurate, and/or have stage order two. The latter types require more stages, but give better convergence rates for differential-algebraic equations (DAEs), and those which have stage order two give better accuracy for moderately stiff problems. The development of the eighth-order schemes requires, in addition to imposing A-stability, finding highly accurate numerical solutions for a system of 200 equations in over 100 variables, which is accomplished via a combination of global and local optimization strategies. The accuracy, stability, and adaptive stepsize control of the schemes are demonstrated on diverse problems.


title: Efficient Video Prediction via Sparsely Conditioned Flow Matching

abstract: We introduce a novel generative model for video prediction based on latent flow matching, an efficient alternative to diffusion-based models. In contrast to prior work, we keep the high costs of modeling the past during training and inference at bay by conditioning only on a small random set of past frames at each integration step of the image generation process. Moreover, to enable the generation of high-resolution videos and to speed up the training, we work in the latent space of a pretrained VQGAN. Finally, we propose to approximate the initial condition of the flow ODE with the previous noisy frame. This allows to reduce the number of integration steps and hence, speed up the sampling at inference time. We call our model Random frame conditioned flow Integration for VidEo pRediction, or, in short, RIVER. We show that RIVER achieves superior or on par performance compared to prior work on common video prediction benchmarks, while requiring an order of magnitude fewer computational resources.


title: CFNet: Conditional Filter Learning with Dynamic Noise Estimation for Real Image Denoising

abstract: A mainstream type of the state of the arts (SOTAs) based on convolutional neural network (CNN) for real image denoising contains two sub-problems, i.e., noise estimation and non-blind denoising. This paper considers real noise approximated by heteroscedastic Gaussian/Poisson Gaussian distributions with in-camera signal processing pipelines. The related works always exploit the estimated noise prior via channel-wise concatenation followed by a convolutional layer with spatially sharing kernels. Due to the variable modes of noise strength and frequency details of all feature positions, this design cannot adaptively tune the corresponding denoising patterns. To address this problem, we propose a novel conditional filter in which the optimal kernels for different feature positions can be adaptively inferred by local features from the image and the noise map. Also, we bring the thought that alternatively performs noise estimation and non-blind denoising into CNN structure, which continuously updates noise prior to guide the iterative feature denoising. In addition, according to the property of heteroscedastic Gaussian distribution, a novel affine transform block is designed to predict the stationary noise component and the signal-dependent noise component. Compared with SOTAs, extensive experiments are conducted on five synthetic datasets and three real datasets, which shows the improvement of the proposed CFNet.


title: Distribution estimation and change-point estimation for time series via DNN-based GANs

abstract: The generative adversarial networks (GANs) have recently been applied to estimating the distribution of independent and identically distributed data, and have attracted a lot of research attention. In this paper, we use the blocking technique to demonstrate the effectiveness of GANs for estimating the distribution of stationary time series. Theoretically, we derive a non-asymptotic error bound for the Deep Neural Network (DNN)-based GANs estimator for the stationary distribution of the time series. Based on our theoretical analysis, we propose an algorithm for estimating the change point in time series distribution. The two main results are verified by two Monte Carlo experiments respectively, one is to estimate the joint stationary distribution of $5$-tuple samples of a 20 dimensional AR(3) model, the other is about estimating the change point at the combination of two different stationary time series. A real world empirical application to the human activity recognition dataset highlights the potential of the proposed methods.


title: Estimation and inference for transfer learning with high-dimensional quantile regression

abstract: Transfer learning has become an essential technique to exploit information from the source domain to boost performance of the target task. Despite the prevalence in high-dimensional data, heterogeneity and heavy tails are insufficiently accounted for by current transfer learning approaches and thus may undermine the resulting performance. We propose a transfer learning procedure in the framework of high-dimensional quantile regression models to accommodate heterogeneity and heavy tails in the source and target domains. We establish error bounds of transfer learning estimator based on delicately selected transferable source domains, showing that lower error bounds can be achieved for critical selection criterion and larger sample size of source tasks. We further propose valid confidence interval and hypothesis test procedures for individual component of high-dimensional quantile regression coefficients by advocating a double transfer learning estimator, which is one-step debiased estimator for the transfer learning estimator wherein the technique of transfer learning is designed again. By adopting data-splitting technique, we advocate a transferability detection approach that guarantees to circumvent negative transfer and identify transferable sources with high probability. Simulation results demonstrate that the proposed method exhibits some favorable and compelling performances and the practical utility is further illustrated by analyzing a real example.


title: Conformal Scattering of Maxwell Potentials

abstract: We construct a complete conformal scattering theory for finite energy Maxwell potentials on a class of curved, asymptotically flat spacetimes with prescribed smoothness of null infinity and a non-zero ADM mass. In order to define the full set of scattering data, we construct a Lorenz-like gauge which makes the field equations hyperbolic and non-singular up to null infinity, and reduces to an intrinsically solvable ODE on null infinity. We develop a method to solve the characteristic Cauchy problem from this scattering data based on a theorem of H\"ormander. In the case of Minkowski space, we further investigate an alternative formulation of the scattering theory by using the Morawetz vector field instead of the usual timelike Killing vector field.


title: On Gorenstein algebras of finite Cohen-Macaulay type: dimer tree algebras and their skew group algebras

abstract: Dimer tree algebras are a class of non-commutative Gorenstein algebras of Gorenstein dimension 1. In previous work we showed that the stable category of Cohen-Macaulay modules of a dimer tree algebra $A$ is a 2-cluster category of Dynkin type $\mathbb{A}$. Here we show that, if $A$ has an admissible action by the group $G$ with two elements, then the stable Cohen-Macaulay category of the skew group algebra $AG$ is a 2-cluster category of Dynkin type $\mathbb{D}$. This result is reminiscent of and inspired by a result by Reiten and Riedtmann, who showed that for an admissible $G$-action on the path algebra of type $\mathbb{A}$ the resulting skew group algebra is of type $\mathbb{D}$. Moreover, we provide a geometric model of the syzygy category of $AG$ in terms of a punctured polygon $\mathcal{P}$ with a checkerboard pattern in its interior, such that the 2-arcs in $\mathcal{P}$ correspond to indecomposable syzygies in $AG$ and 2-pivots correspond to morphisms. In particular, the dimer tree algebras and their skew group algebras are Gorenstein algebras of finite Cohen-Macaulay type $\mathbb{A}$ and $\mathbb{D}$ respectively. We also provide examples of types $\mathbb{E}_6,\mathbb{E}_7,$ and $\mathbb{E}_8$.


title: The number of multiplicity-free primitive ideals associated with the rigid nilpotent orbits

abstract: In this paper we describe the number of multiplicity-free primitive ideals associated with the rigid nilpotent orbits in finite-dimensional simple Lie algebras. Thanks to the results obtained earlier we need to solve the problem for the two largest rigid nilpotent orbits in Lie algebras of type ${\rm E}_8$. As a corollary we compute the number of small modules in the corresponding reduced enveloping algebras over algebraically closed fields of characteristic $p>5$.


title: Demystifying Bitcoin Address Behavior via Graph Neural Networks

abstract: Bitcoin is one of the decentralized cryptocurrencies powered by a peer-to-peer blockchain network. Parties who trade in the bitcoin network are not required to disclose any personal information. Such property of anonymity, however, precipitates potential malicious transactions to a certain extent. Indeed, various illegal activities such as money laundering, dark network trading, and gambling in the bitcoin network are nothing new now. While a proliferation of work has been developed to identify malicious bitcoin transactions, the behavior analysis and classification of bitcoin addresses are largely overlooked by existing tools. In this paper, we propose BAClassifier, a tool that can automatically classify bitcoin addresses based on their behaviors. Technically, we come up with the following three key designs. First, we consider casting the transactions of the bitcoin address into an address graph structure, of which we introduce a graph node compression technique and a graph structure augmentation method to characterize a unified graph representation. Furthermore, we leverage a graph feature network to learn the graph representations of each address and generate the graph embeddings. Finally, we aggregate all graph embeddings of an address into the address-level representation, and engage in a classification model to give the address behavior classification. As a side contribution, we construct and release a large-scale annotated dataset that consists of over 2 million real-world bitcoin addresses and concerns 4 types of address behaviors. Experimental results demonstrate that our proposed framework outperforms state-of-the-art bitcoin address classifiers and existing classification models, where the precision and F1-score are 96% and 95%, respectively. Our implementation and dataset are released, hoping to inspire others.


title: Object Transport by a Confined Active Suspension

abstract: Numerical simulations in two space dimensions are used to examine the dynamics, transport, and equilibrium behaviors of a neutrally buoyant circular object immersed in an active suspension within a larger closed circular container. The continuum model of Gao et al. (Phys. Rev. Fluids, 2017) represents the suspension of non-interacting, immotile, extensor-type microscopic agents that have a direction and strength and align in response to strain rate. Such a suspension is well known to be unstable above an activity strength threshold, which depends upon the length scale of the confinement. Introducing the object leads to additional phenomenology. It can confine fluid between it and the container wall, which suppresses local suspension activity. However, its motion also correlates strain rates near its surface with a concomitant correlated active-stress response. Depending on the suspension activity strength, these mechanisms lead to either an attraction toward or repulsion away from the container wall. In addition, a persistent propagating behavior is found for modest activity strength, which provides a mechanism for long-range transport. When activity is so weak that the mobility of the object is essential to support suspension instability and sustain flow, the object essentially parks and all flow terminates when its mobility is diminished as it nears the container wall. Together these mechanisms illustrate potential for performing relatively complex tasks with simple active agents, especially if activity strength is scheduled in time.


title: Intermediate $\beta$-shifts as greedy $\beta$-shifts with a hole

abstract: We show that every intermediate $\beta$-transformation is topologically conjugate to a greedy $\beta$-transformation with a hole at zero, and provide a counterexample illustrating that the correspondence is not one-to-one. This characterisation is employed to (1) build a Krieger embedding theorem for intermediate $\beta$-transformation, complementing the result of Li, Sahlsten, Samuel and Steiner [2019], and (2) obtain new metric and topological results on survivor sets of intermediate $\beta$-transformations with a hole at zero, extending the work of Kalle, Kong, Langeveld and Li [2020]. Further, we derive a method to calculate the Hausdorff dimension of such survivor sets as well as results on certain bifurcation sets. Moreover, by taking unions of survivor sets of intermediate $\beta$-transformations one obtains an important class of sets arising in metric number theory, namely sets of badly approximable numbers in non-integer bases. We prove, under the assumption that the underlying symbolic space is of finite type, that these sets of badly approximable numbers are winning in the sense of Schmidt games, and hence have the countable intersection property, extending the results of Hu and Yu [2014], Tseng [2009] and F\"{a}rm, Persson and Schmeling [2010].


title: Safety Verification of Declarative Smart Contracts

abstract: Smart contracts manage a large number of digital assets nowadays. Bugs in these contracts have led to significant financial loss. Verifying the correctness of smart contracts is, therefore, an important task. This paper presents an automated safety verification tool, DCV, that targets declarative smart contracts written in DeCon, a logic-based domain-specific language for smart contract implementation and specification. DCV proves safety properties by mathematical induction and can automatically infer inductive invariants using heuristic patterns, without annotations from the developer. Our evaluation on 20 benchmark contracts shows that DCV is effective in verifying smart contracts adapted from public repositories, and can verify contracts not supported by other tools. Furthermore, DCV significantly outperforms baseline tools in verification time.


title: Quantum emulation of the transient dynamics in the multistate Landau-Zener model

abstract: Quantum simulation is one of the most promising near term applications of quantum computing. Especially, systems with a large Hilbert space are hard to solve for classical computers and thus ideal targets for a simulation with quantum hardware. In this work, we study experimentally the transient dynamics in the multistate Landau-Zener model as a function of the Landau-Zener velocity. The underlying Hamiltonian is emulated by superconducting quantum circuit, where a tunable transmon qubit is coupled to a bosonic mode ensemble comprising four lumped element microwave resonators. We investigate the model for different initial states: Due to our circuit design, we are not limited to merely exciting the qubit, but can also pump the harmonic modes via a dedicated drive line. Here, the nature of the transient dynamics depends on the average photon number in the excited resonator. The greater effective coupling strength between qubit and higher Fock states results in a quasi-adiabatic transition, where coherent quantum oscillations are suppressed without the introduction of additional loss channels. Our experiments pave the way for more complex simulations with qubits coupled to an engineered bosonic mode spectrum.


title: Light higgsino scenario confronted with muon g-2

abstract: Light higgsinos below several hundred GeV are favored or required by the naturalness of low energy supersymmetry. If only higgsinos are light while other sparticles are sufficiently heavy, we have the so-called light higgsino scenario. Confronted with the muon $g-2$ data, this scenario is examined in this work. Since in this scenario the LSP (lightest sparticle) is higgsino-like, we need to also consider the dark matter constraints. Assuming a light higgsino mass parameter $\mu$ in the range of 100-400 GeV while gaugino mass parameters above TeV, we explore the parameter space under the muon $g-2$ data and the dark matter constraints. We find that, to explain the muon $g-2$ anomaly at $2\sigma$, the winos and sleptons are respectively upper bounded by 3 TeV and 800 GeV. In this case, we find that the light higgsino-like dark matter can sizably scatter with nucleon and thus the allowed parameter space can be covered almost fully by the future LZ dark matter detection project. We also perform a Monte Carlo simulation to figure out the potential of HL-LHC to detect the light sleptons in this scenario. It turns out that compared with the current LHC limits, the HL-LHC can further cover a part of the parameter space.


title: Dense-separable groups and its applications in $d$-independence

abstract: A topological space is called {\it dense-separable} if each dense subset of its is separable. Therefore, each dense-separable space is separable. We establish some basic properties of dense-separable topological groups. We prove that each separable space with a countable tightness is dense-separable, and give a dense-separable topological group which is not hereditarily separable. We also prove that, for a Hausdorff locally compact group , it is locally dense-separable iff it is metrizable. Moreover, we study dense-subgroup-separable topological groups. We prove that, for each compact torsion (or divisible, or torsion-free, or totally disconnected) abelian group, it is dense-subgroup-separable iff it is dense-separable iff it is metrizable. Finally, we discuss some applications in $d$-independent topological groups and related structures. We prove that each regular dense-subgroup-separable abelian semitopological group with $r_{0}(G)\geq\mathfrak{c}$ is $d$-independent. We also prove that, for each regular dense-subgroup-separable bounded paratopological abelian group $G$ with $|G|>1$, it is $d$-independent iff it is a nontrivial $M$-group iff each nontrivial primary component $G_{p}$ of $G$ is $d$-independent. Apply this result, we prove that a separable metrizable almost torsion-free paratopological abelian group $G$ with $|G|=\mathfrak{c}$ is $d$-independent. Further, we prove that each dense-subgroup-separable MAP abelian group with a nontrivial connected component is also $d$-independent.


title: AvatarGen: A 3D Generative Model for Animatable Human Avatars

abstract: Unsupervised generation of 3D-aware clothed humans with various appearances and controllable geometries is important for creating virtual human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not generative and thus unable to generate high-quality virtual humans and animate them. In this work, we propose AvatarGen, the first method that enables not only geometry-aware clothed human synthesis with high-fidelity appearances but also disentangled human animation controllability, while only requiring 2D images for training. Specifically, we decompose the generative 3D human synthesis into pose-guided mapping and canonical representation with predefined human pose and shape, such that the canonical representation can be explicitly driven to different poses and shapes with the guidance of a 3D parametric human model SMPL. AvatarGen further introduces a deformation network to learn non-rigid deformations for modeling fine-grained geometric details and pose-dependent dynamics. To improve the geometry quality of the generated human avatars, it leverages the signed distance field as geometric proxy, which allows more direct regularization from the 3D geometric priors of SMPL. Benefiting from these designs, our method can generate animatable 3D human avatars with high-quality appearance and geometry modeling, significantly outperforming previous 3D GANs. Furthermore, it is competent for many applications, e.g., single-view reconstruction, re-animation, and text-guided synthesis/editing. Code and pre-trained model will be available at http://jeff95.me/projects/avatargen.html.


title: An Analytical Fourier-Transformation Model for the Production of Hard and Soft X-Ray Time Lags in AGNs: Application to 1H 0707-495

abstract: The variability of the X-ray emission from active galactic nuclei is often characterized using time lags observed between soft and hard energy bands in the detector. The time lags are usually computed using the complex cross spectrum, which is based on the Fourier transforms of the hard and soft time series data. It has been noted that some active galactic nuclei display soft X-ray time lags, in addition to the more ubiquitous hard lags. Hard time lags are thought to be produced via propagating fluctuations, spatial reverberation, or via the thermal Comptonization of soft seed photons injected into a hot electron cloud. The physical origin of the soft lags has been a subject of debate over the last decade. Currently, the reverberation interpretation is recognized as a leading theory. In this paper, we explore the alternative possibility that the soft X-ray time lags result partially from the thermal and bulk Comptonization of monochromatic seed photons, which in the case of the narrow-line Seyfert 1 galaxy 1H 0707-495, may correlate with fluorescence of iron L-line emission. In our model, the seed photons are injected into a hot, quasi-spherical corona in the inner region of the accretion flow. We develop an exact, time-dependent analytical model for the thermal and bulk Comptonization of the seed photons based on a Fourier-transformed radiation transport equation, and we demonstrate that the model successfully reproduces both the hard and soft time lags observed from 1H 0707-495.


title: A Survey of Text Representation Methods and Their Genealogy

abstract: In recent years, with the advent of highly scalable artificial-neural-network-based text representation methods the field of natural language processing has seen unprecedented growth and sophistication. It has become possible to distill complex linguistic information of text into multidimensional dense numeric vectors with the use of the distributional hypothesis. As a consequence, text representation methods have been evolving at such a quick pace that the research community is struggling to retain knowledge of the methods and their interrelations. We contribute threefold to this lack of compilation, composition, and systematization by providing a survey of current approaches, by arranging them in a genealogy, and by conceptualizing a taxonomy of text representation methods to examine and explain the state-of-the-art. Our research is a valuable guide and reference for artificial intelligence researchers and practitioners interested in natural language processing applications such as recommender systems, chatbots, and sentiment analysis.


title: An Efficient Black-Box Support of Advanced Coverage Criteria for Klee

abstract: Dynamic symbolic execution (DSE) is a powerful test generation approach based on an exploration of the path space of the program under test. Well-adapted for path coverage, this approach is however less efficient for conditions, decisions, advanced coverage criteria (such as multiple conditions, weak mutations, boundary testing) or user-provided test objectives. While theoretical solutions to adapt DSE to a large set of criteria have been proposed, they have never been integrated into publicly available testing tools. This paper presents a first integration of an optimized test generation strategy for advanced coverage criteria into a popular open-source testing tool based on DSE, namely, Klee. The integration is performed in a fully black-box manner, and can therefore inspire an easy integration into other similar tools. The resulting version of the tool, named Klee4labels, is publicly available. We present the design of the proposed technique and evaluate it on several benchmarks. Our results confirm the benefits of the proposed tool for advanced coverage criteria.


title: Fast method and convergence analysis of fractional magnetohydrodynamic coupled flow and heat transfer model for generalized second-grade fluid

abstract: In this paper, we first establish a new fractional magnetohydrodynamic (MHD) coupled flow and heat transfer model for a generalized second-grade fluid. This coupled model consists of a fractional momentum equation and a heat conduction equation with a generalized form of Fourier law. The second-order fractional backward difference formula is applied to the temporal discretization and the Legendre spectral method is used for the spatial discretization. The fully discrete scheme is proved to be stable and convergent with an accuracy of $O(\tau^2+N^{-r})$, where $\tau$ is the time step size and $N$ is the polynomial degree. To reduce the memory requirements and computational cost, a fast method is developed, which is based on a globally uniform approximation of the trapezoidal rule for integrals on the real line. And the strict convergence of the numerical scheme with this fast method is proved. We present the results of several numerical experiments to verify the effectiveness of the proposed method. Finally, we simulate the unsteady fractional MHD flow and heat transfer of the generalized second-grade fluid through a porous medium. The effects of the relevant parameters on the velocity and temperature are presented and analyzed in detail.


title: Direct-Effect Risk Minimization for Domain Generalization

abstract: We study the problem of out-of-distribution (o.o.d.) generalization where spurious correlations of attributes vary across training and test domains. This is known as the problem of correlation shift and has posed concerns on the reliability of machine learning. In this work, we introduce the concepts of direct and indirect effects from causal inference to the domain generalization problem. We argue that models that learn direct effects minimize the worst-case risk across correlation-shifted domains. To eliminate the indirect effects, our algorithm consists of two stages: in the first stage, we learn an indirect-effect representation by minimizing the prediction error of domain labels using the representation and the class labels; in the second stage, we remove the indirect effects learned in the first stage by matching each data with another data of similar indirect-effect representation but of different class labels in the training and validation phase. Our approach is shown to be compatible with existing methods and improve the generalization performance of them on correlation-shifted datasets. Experiments on 5 correlation-shifted datasets and the DomainBed benchmark verify the effectiveness of our approach.


title: Tube-based Distributionally Robust Model Predictive Control for Nonlinear Process Systems via Linearization

abstract: Model predictive control (MPC) is an effective approach to control multivariable dynamic systems with constraints. Most real dynamic models are however affected by plant-model mismatch and process uncertainties, which can lead to closed-loop performance deterioration and constraint violations. Methods such as stochastic MPC (SMPC) have been proposed to alleviate these problems; however, the resulting closed-loop state trajectory might still significantly violate the prescribed constraints if the real system deviates from the assumed disturbance distributions made during the controller design. In this work we propose a novel data-driven distributionally robust MPC scheme for nonlinear systems. Unlike SMPC, which requires the exact knowledge of the disturbance distribution, our scheme decides the control action with respect to the worst distribution from a distribution ambiguity set. This ambiguity set is defined as a Wasserstein ball centered at the empirical distribution. Due to the potential model errors that cause off-sets, the scheme is also extended by leveraging an offset-free method. The favorable results of this control scheme are demonstrated and empirically verified with a nonlinear mass spring system and a nonlinear CSTR case study.


title: 1st Place Solution to NeurIPS 2022 Challenge on Visual Domain Adaptation

abstract: The Visual Domain Adaptation(VisDA) 2022 Challenge calls for an unsupervised domain adaptive model in semantic segmentation tasks for industrial waste sorting. In this paper, we introduce the SIA_Adapt method, which incorporates several methods for domain adaptive models. The core of our method in the transferable representation from large-scale pre-training. In this process, we choose a network architecture that differs from the state-of-the-art for domain adaptation. After that, self-training using pseudo-labels helps to make the initial adaptation model more adaptable to the target domain. Finally, the model soup scheme helped to improve the generalization performance in the target domain. Our method SIA_Adapt achieves 1st place in the VisDA2022 challenge. The code is available on https: //github.com/DaehanKim-Korea/VisDA2022_Winner_Solution.


title: Temperature dependence of the energy band gap in ZrTe$_5$: implications for the topological phase

abstract: Using Landau level spectroscopy, we determine the temperature dependence of the energy band gap in zirconium pentatelluride (ZrTe$_5$). We find that the band gap reaches $E_g=(5 \pm 1)$ meV at low temperatures and increases monotonously when the temperature is raised. This implies that ZrTe$_5$ is a weak topological insulator, with non-inverted ordering of electronic bands in the center of the Brillouin zone. Our magneto-transport experiments performed in parallel show that the resistivity anomaly in ZrTe$_5$ is not connected with the temperature dependence of the band gap.


title: On powers of countably pracompact groups

abstract: In 1990, Comfort asked: is there, for every cardinal number $\alpha \leq 2^{\mathfrak{c}}$, a topological group $G$ such that $G^\gamma$ is countably compact for all cardinals $\gamma<\alpha$, but $G^\alpha$ is not countably compact? A similar question can also be asked for countably pracompact groups: for which cardinals $\alpha$ is there a topological group $G$ such that $G^{\gamma}$ is countably pracompact for all cardinals $\gamma < \alpha$, but $G^{\alpha}$ is not countably pracompact? In this paper we construct such group in the case $\alpha = \omega$, assuming the existence of $\mathfrak{c}$ incomparable selective ultrafilters, and in the case $\alpha = \kappa^{+}$, with $\omega \leq \kappa \leq 2^{\mathfrak{c}}$, assuming the existence of $2^{\mathfrak{c}}$ incomparable selective ultrafilters. In particular, under the second assumption, there exists a topological group $G$ so that $G^{2^\mathfrak{c}}$ is countably pracompact, but $G^{(2^{\mathfrak{c}})^{+}}$ is not countably pracompact, unlike the countably compact case.


title: Condensed Gradient Boosting

abstract: This paper presents a computationally efficient variant of gradient boosting for multi-class classification and multi-output regression tasks. Standard gradient boosting uses a 1-vs-all strategy for classifications tasks with more than two classes. This strategy translates in that one tree per class and iteration has to be trained. In this work, we propose the use of multi-output regressors as base models to handle the multi-class problem as a single task. In addition, the proposed modification allows the model to learn multi-output regression problems. An extensive comparison with other multi-ouptut based gradient boosting methods is carried out in terms of generalization and computational efficiency. The proposed method showed the best trade-off between generalization ability and training and predictions speeds.


title: Positive model theory of interpretations

abstract: We prove analogues of model theory results for $\mathcal{C}\to \mathcal{D}$ coherent functors, including variants of the omitting types theorem and some results on ultraproduct constructions. We introduce a distributive lattice valued invariant of $\mathcal{C}\to \mathbf{Set}$ coherent functors that vanishes precisely on positively closed models, then we study its functorial properties.


title: Affine characters at negative level and elliptic genera of non-critical strings

abstract: We study the elliptic genera of the non-critical strings of six dimensional superconformal field theories from the point of view of the strings' worldsheet theory. We formulate a general ansatz for these in terms of characters of the affine Lie algebra associated to the 6d gauge group at negative level, and provide ample evidence for the validity of this ansatz for 6d theories obtained via F-theory compactification on elliptically fibered Calabi-Yau manifolds over a Hirzebruch base. We obtain novel closed form results for many elliptic genera in terms of our ansatz, and show that our results specialize consistently when moving along Higgsing trees.


title: A historical view on the maximum entropy

abstract: How to find unknown distributions is questioned in many pieces of research. There are several ways to figure them out, but the main question is which acts more reasonably than others. In this paper, we focus on the maximum entropy principle as a suitable method of discovering the unknown distribution, which recommends some prior information based on the available data set. We explain its features by reviewing some papers. Furthermore, we recommend some articles to study around the generalized maximum entropy issue, which is more suitable when autocorrelation data exists. Then, we list the beneficial features of the maximum entropy as a result. Finally, some disadvantages of entropy are expressed to have a complete look at the maximum entropy principle, and we list its drawbacks as the final step.


title: Analysis of Molecule Harvesting by Heterogeneous Receptors on MC Transmitters

abstract: This paper designs a molecule harvesting transmitter (TX) model, where the surface of a spherical TX is covered by heterogeneous receptors with different sizes and arbitrary locations. If molecules hit any receptor, they are absorbed by the TX immediately. Within the TX, molecules are stored in vesicles that are continuously generated and released by the TX via the membrane fusion process. Considering a transparent receiver (RX) and molecular degradation during the propagation from the TX to the RX, we derive the molecule release rate and the fraction of molecules absorbed by the TX as well as the received signal at the RX. Notably, this analytical result is applicable for different numbers, sizes, and locations of receptors, and its accuracy is verified via particle-based simulations. Numerical results show that different vesicle generation rates result in the same number of molecules absorbed by the TX, but different peak received signals at the RX.


title: Reduced Representation of Deformation Fields for Effective Non-rigid Shape Matching

abstract: In this work we present a novel approach for computing correspondences between non-rigid objects, by exploiting a reduced representation of deformation fields. Different from existing works that represent deformation fields by training a general-purpose neural network, we advocate for an approximation based on mesh-free methods. By letting the network learn deformation parameters at a sparse set of positions in space (nodes), we reconstruct the continuous deformation field in a closed-form with guaranteed smoothness. With this reduction in degrees of freedom, we show significant improvement in terms of data-efficiency thus enabling limited supervision. Furthermore, our approximation provides direct access to first-order derivatives of deformation fields, which facilitates enforcing desirable regularization effectively. Our resulting model has high expressive power and is able to capture complex deformations. We illustrate its effectiveness through state-of-the-art results across multiple deformable shape matching benchmarks. Our code and data are publicly available at: https://github.com/Sentient07/DeformationBasis.


title: Looking at the posterior: accuracy and uncertainty of neural-network predictions

abstract: Bayesian inference can quantify uncertainty in the predictions of neural networks using posterior distributions for model parameters and network output. By looking at these posterior distributions, one can separate the origin of uncertainty into aleatoric and epistemic contributions. One goal of uncertainty quantification is to inform on prediction accuracy. Here we show that prediction accuracy depends on both epistemic and aleatoric uncertainty in an intricate fashion that cannot be understood in terms of marginalized uncertainty distributions alone. How the accuracy relates to epistemic and aleatoric uncertainties depends not only on the model architecture, but also on the properties of the dataset. We discuss the significance of these results for active learning and introduce a novel acquisition function that outperforms common uncertainty-based methods. To arrive at our results, we approximated the posteriors using deep ensembles, for fully-connected, convolutional and attention-based neural networks.


title: A molecular reconstruction theorem for $H^{p(\cdot)}_{\omega}(\mathbb{R}^{n})$

abstract: In this article we give a molecular reconstruction theorem for $H_{\omega}^{p(\cdot)}(\mathbb{R}^{n})$. As an application of this result and the atomic decomposition developed in [5] we show that classical singular integrals can be extended to bounded operators on $H_{\omega}^{p(\cdot)}(\mathbb{R}^{n})$. We also prove, for certain exponents $q(\cdot)$ and certain weights $\omega$, that Riesz potential $I_{\alpha}$, with $0 < \alpha < n$, can be extended to a bounded operator from $H^{p(\cdot)}_{\omega}(\mathbb{R}^{n})$ into $H^{q(\cdot)}_{\omega}(\mathbb{R}^{n})$, for $\frac{1}{p(\cdot)} := \frac{1}{q(\cdot)} + \frac{\alpha}{n}$.


title: Sketch2FullStack: Generating Skeleton Code of Full Stack Website and Application from Sketch using Deep Learning and Computer Vision

abstract: For a full-stack web or app development, it requires a software firm or more specifically a team of experienced developers to contribute a large portion of their time and resources to design the website and then convert it to code. As a result, the efficiency of the development team is significantly reduced when it comes to converting UI wireframes and database schemas into an actual working system. It would save valuable resources and fasten the overall workflow if the clients or developers can automate this process of converting the pre-made full-stack website design to get a partially working if not fully working code. In this paper, we present a novel approach of generating the skeleton code from sketched images using Deep Learning and Computer Vision approaches. The dataset for training are first-hand sketched images of low fidelity wireframes, database schemas and class diagrams. The approach consists of three parts. First, the front-end or UI elements detection and extraction from custom-made UI wireframes. Second, individual database table creation from schema designs and lastly, creating a class file from class diagrams.


title: EEGLog: Lifelogging EEG Data When You Listen to Music

abstract: Self-tracking has been long discussed, which can monitor daily activities and help users to recall previous experiences. Such data-capturing technique is no longer limited to photos, text messages, or personal diaries in recent years. With the development of wearable EEG devices, we introduce a novel modality of logging EEG data while listening to music, and bring up the idea of the neural-centric way of life with the designed data analysis application named EEGLog. Four consumer-grade wearable EEG devices are explored by collecting EEG data from 24 participants. Three modules are introduced in EEGLog, including the summary module of EEG data, emotion reports, music listening activities, and memorial moments, the emotion detection module, and the music recommendation module. Feedback from interviews about using EEG devices and EEGLog were obtained and analyzed for future EEG logging development.


title: BEAMERS: Brain-Engaged, Active Music-based Emotion Regulation System

abstract: With the increasing demands of emotion comprehension and regulation in our daily life, a customized music-based emotion regulation system is introduced by employing current EEG information and song features, which predicts users' emotion variation in the valence-arousal model before recommending music. The work shows that: (1) a novel music-based emotion regulation system with a commercial EEG device is designed without employing deterministic emotion recognition models for daily usage; (2) the system considers users' variant emotions towards the same song, and by which calculate user's emotion instability and it is in accordance with Big Five Personality Test; (3) the system supports different emotion regulation styles with users' designation of desired emotion variation, and achieves an accuracy of over $0.85$ with 2-seconds EEG data; (4) people feel easier to report their emotion variation comparing with absolute emotional states, and would accept a more delicate music recommendation system for emotion regulation according to the questionnaire.


title: Positive intermediate Ricci curvature on fibre bundles

abstract: We prove a canonical variation-type result for submersion metrics with positive intermediate Ricci curvatures. This can then be used in conjunction with surgery techniques to establish the existence of metrics with positive intermediate Ricci curvatures on a wide range of examples which had previously only been known to admit positive Ricci curvature, such as highly connected manifolds and exotic spheres. Further, we extend results of the second author on the moduli space of metrics with positive Ricci curvature to positive intermediate Ricci curvatures.


title: The Principles of Data-Centric AI (DCAI)

abstract: Data is a crucial infrastructure to how artificial intelligence (AI) systems learn. However, these systems to date have been largely model-centric, putting a premium on the model at the expense of the data quality. Data quality issues beset the performance of AI systems, particularly in downstream deployments and in real-world applications. Data-centric AI (DCAI) as an emerging concept brings data, its quality and its dynamism to the forefront in considerations of AI systems through an iterative and systematic approach. As one of the first overviews, this article brings together data-centric perspectives and concepts to outline the foundations of DCAI. It specifically formulates six guiding principles for researchers and practitioners and gives direction for future advancement of DCAI.


title: Optimal control related to weak solutions of a chemotaxis-consumption model

abstract: In the present work we investigate an optimal control problem related to the following chemotaxis-consumption model in a bounded domain $\Omega\subset \mathbb{R}^3$: $$\partial_t u - \Delta u = - \nabla \cdot (u \nabla v), \quad \partial_t v - \Delta v = - u^s v + f \,v\, 1_{\Omega_c},$$ with $s \geq 1$, endowed with isolated boundary conditions and initial conditions for $(u,v)$, being $u$ the cell density, $v$ the chemical concentration and $f$ the control acting in the $v$-equation through the bilinear term $f \,v\, 1_{\Omega_c}$, in a subdomain $\Omega_c \subset \Omega$. We address the existence of optimal control restricted to a weak solution setting, where, in particular, uniqueness of state $(u,v)$ given a control $f$ is not clear. Then by considering weak solutions satisfying an adequate energy inequality, we prove the existence of optimal control subject to uniformly bounded controls. Finally, we discuss the relation between the considered control problem and two other related ones, where the existence of optimal solution can not be proved.


title: Some Remarks on Almost Periodic Sequences and Languages

abstract: Almost periodicity has been considered in Formal Language Theory in connection with some topics in Symbolic Dynamics. In (P\u{a}un and Marcus, Bulletin of EATCS 53 (1994)) some problems concerning this property are raised. For instance it is asked whether there exists some almost periodic word $\alpha$ such that $Sub(\alpha)$, the set of its finite factors, is context-free non-regular. We answer negatively (even in a stronger form) this question, as well as discussing other related topics.


title: Uniform Estimates of Resolvents in Homogenization Theory of Elliptic Systems

abstract: In this paper, we study the estimates of resolvents $ R(\lambda,\mathcal{L}_{\varepsilon})=(\mathcal{L}_{\varepsilon}-\lambda I)^{-1} $, where $$ \mathcal{L}_{\varepsilon}=-\operatorname{div}(A(x/\varepsilon)\nabla) $$ is a family of second elliptic operators with symmetric, periodic and oscillating coefficients defined on a bounded domain $ \Omega $ with $ \varepsilon>0 $. For $ 1<p<\infty $, we will establish uniform $ L^p\to L^p $, $ L^p\to W_0^{1,p} $, $ W^{-1,p}\to L^p $ and $ W^{-1,p}\to W_0^{1,p} $ estimates by using the real variable method. Meanwhile, we use Green functions for operators $ \mathcal{L}_{\varepsilon}-\lambda I $ to study the asymptotic behavior of $ R(\lambda,\mathcal{L}_{\varepsilon}) $ and obtain convergence estimates in $ L^p\to L^p $, $ L^p\to W_0^{1,p} $ norm.


title: Measures of string similarities based on the Hamming distance

abstract: In this paper we consider measures of similarity between two sets of strings built up using the Hamming distance and tools of persistence homology as a basis. First we describe the construction of the \v Cech filtration adjoined to the set of strings, the persistence module corresponding to this filtration and its barcode structure. Using these means, we introduce a novel similarity measure for two sets of strings, based on a comparison of bars within their barcodes of the same dimension. Our idea is to look for a comparison that will take under consideration not only the overlap of bars, but also ensure that observed bars are qualitatively matched, in the sense that they represent similar homological features. To make this idea happen, we developed a method called the separation of simplex radii technique.


title: Weighted Sobolev Space and Hyperbolic Laplacian Equations I

abstract: In this paper, the following problem in the hyperbolic space $\mathbb{B}^N$ will be considered \begin{equation*} -\Delta_{\mathbb{B}^N} u=f(x,u), \mathrm{in} \ \mathbb{B}^N.\eqno{(1)} \end{equation*} where, $\Delta_{\mathbb{B}^N}$ denotes the Laplace Beltrami operator on $\mathbb{B}^N$. And this problem can be converted into the following Euclidean problem \begin{equation*} \begin{cases} -\operatorname{div}(K(x) \nabla u)=4 K(x)^{\frac{N}{N-2}}f(x,u), &\mathrm{in} \ \mathbb{B}^N, \\ u(0)=0, &\mathrm{on}\ \partial\mathbb{B}^N, \end{cases}\eqno{(2)} \end{equation*} where, $K(x):=1/\left(1-|x|^2\right)^{N-2}.$ Then, the existence of solution of problem (1) can be obtained by studying the existence of solution of problem (2). We will equip problem (2) with a weighted Sobolev space and prove the compact embedding theorem and the concentration compactness principle for the weighted Sobolev space. And we will prove that the maximum principle holds for the operator $-\operatorname{div}(K(x) \nabla u)$. When $f(x,u)=|u|^{2^*-2} u+\lambda u^{q-2}u$, $\lambda>0$, $1<q<2^{\ast}$, using the variational method, the compact embedding theorem, the concentration compactness principle and the maximum principle, the existence of nonradial solutions of problem (2) will be obtained.


title: Mixture of Decision Trees for Interpretable Machine Learning

abstract: This work introduces a novel interpretable machine learning method called Mixture of Decision Trees (MoDT). It constitutes a special case of the Mixture of Experts ensemble architecture, which utilizes a linear model as gating function and decision trees as experts. Our proposed method is ideally suited for problems that cannot be satisfactorily learned by a single decision tree, but which can alternatively be divided into subproblems. Each subproblem can then be learned well from a single decision tree. Therefore, MoDT can be considered as a method that improves performance while maintaining interpretability by making each of its decisions understandable and traceable to humans. Our work is accompanied by a Python implementation, which uses an interpretable gating function, a fast learning algorithm, and a direct interface to fine-tuned interpretable visualization methods. The experiments confirm that the implementation works and, more importantly, show the superiority of our approach compared to single decision trees and random forests of similar complexity.


title: Sharp quantitative stability of Struwe's decomposition of the Poincar\'e-Sobolev inequalities on the hyperbolic space: Part I

abstract: A classical result owing to Mancini and Sandeep [Ann. Sc. Norm. Super. Pisa Cl. Sci. 7 (2008)] asserts that all positive solutions of the Poincar\'e-Sobolev equation on the hyperbolic space $$ -\Delta_{\mathbb{B}^n} u-\lambda u = |u|^{p-1}u, \quad u\in H^1(\mathbb{B}^n), $$ are unique up to hyperbolic isometries where $n \geq 3,$ $1 < p \leq \frac{n+2}{n-2} $ and $\lambda \leq \frac{(n-1)^2}{4}.$ We prove under certain bounds on $\|\nabla u \|_{L^2(\mathbb{B}^n)}$ the inequality $$ \delta(u) \lesssim \|\Delta_{\mathbb{B}^n} u+ \lambda u + u^{p}\|_{H^{-1}}, $$ holds whenever $p >2$ and hence forcing the dimensional restriction $3 \leq n \leq 5,$ where $\delta(u)$ denotes the $H^1$ distance of $u$ from the manifold of sums of hyperbolic bubbles. Moreover, it fails for any $n \geq 3$ and $p \in (1,2].$ This strengthens the phenomenon observed in the Euclidean case that the (linear) quantitative stability estimate depends only on whether the exponent $p$ is $>2$ or $\leq 2$. In the critical case, our dimensional constraint coincides with the seminal result of Figalli and Glaudo [Arch. Ration. Mech. Anal, 237 (2020)] but we notice a striking dependence on the exponent $p$ in the subcritical regime as well which is not present in the flat case. Our technique is an amalgamation of Figalli and Glaudo's method and builds upon a series of new and novel estimates on the interaction of hyperbolic bubbles and their derivatives and improved eigenfunction integrability estimates. Since the conformal group coincides with the isometry group of the hyperbolic space, we perceive a remarkable distinction in arguments and techniques to achieve our main results compared to that of the Euclidean case.


title: A Quantum Approach Towards the Adaptive Prediction of Cloud Workloads

abstract: This work presents a novel Evolutionary Quantum Neural Network (EQNN) based workload prediction model for Cloud datacenter. It exploits the computational efficiency of quantum computing by encoding workload information into qubits and propagating this information through the network to estimate the workload or resource demands with enhanced accuracy proactively. The rotation and reverse rotation effects of the Controlled-NOT (C-NOT) gate serve activation function at the hidden and output layers to adjust the qubit weights. In addition, a Self Balanced Adaptive Differential Evolution (SB-ADE) algorithm is developed to optimize qubit network weights. The accuracy of the EQNN prediction model is extensively evaluated and compared with seven state-of-the-art methods using eight real world benchmark datasets of three different categories. Experimental results reveal that the use of the quantum approach to evolutionary neural network substantially improves the prediction accuracy up to 91.6% over the existing approaches.


title: The distribution of syntactic dependency distances

abstract: The syntactic structure of a sentence can be represented as a graph where vertices are words and edges indicate syntactic dependencies between them. In this setting, the distance between two syntactically linked words can be defined as the difference between their positions. Here we want to contribute to the characterization of the actual distribution of syntactic dependency distances, and unveil its relationship with short-term memory limitations. We propose a new double-exponential model in which decay in probability is allowed to change after a break-point. This transition could mirror the transition from the processing of words chunks to higher-level structures. We find that a two-regime model -- where the first regime follows either an exponential or a power-law decay -- is the most likely one in all 20 languages we considered, independently of sentence length and annotation style. Moreover, the break-point is fairly stable across languages and averages values of 4-5 words, suggesting that the amount of words that can be simultaneously processed abstracts from the specific language to a high degree. Finally, we give an account of the relation between the best estimated model and the closeness of syntactic dependencies, as measured by a recently introduced optimality score.


title: Pairs in discrete lattice orbits with applications to Veech surfaces

abstract: Let $\Lambda_1$, $\Lambda_2$ be two discrete orbits under the linear action of a lattice $\Gamma<\mathrm{SL}_2(\mathbb{R})$ on the Euclidean plane. We prove a Siegel$-$Veech-type integral formula for the averages $$ \sum_{\mathbf{x}\in\Lambda_1} \sum_{\mathbf{y}\in\Lambda_2} f(\mathbf{x}, \mathbf{y}) $$ from which we derive new results for the set $S_M$ of holonomy vectors of saddle connections of a Veech surface $M$. This includes an effective count for generic Borel sets with respect to linear transformations, and upper bounds on the number of pairs in $S_M$ with bounded determinant and on the number of pairs in $S_M$ with bounded distance. This last estimate is used in the appendix to prove that for almost every $(\theta,\psi)\in S^1\times S^1$ the translations flows $F_\theta^t$ and $F_\psi^t$ on any Veech surface $M$ are disjoint.


title: Caffarelli-Kohn-Nirenberg identities, inequalities and their stabilities

abstract: We set up a one-parameter family of inequalities that contains both the Hardy inequalities (when the parameter is 1) and the Caffarelli-Kohn-Nirenberg inequalities (when the parameter is optimal). Moreover, we study these results with the exact remainders to provide direct understandings to the sharp constants, as well as the existence and non-existence of the optimizers of the Hardy inequalities and Caffarelli-Kohn-Nirenberg inequalities. As an application of our identities, we establish some sharp versions with optimal constants and theirs attainability of the stability of the Heisenberg Uncertainty Principle and several stability results of the Caffarelli-Kohn-Nirenberg inequalities.


title: Multi-channel quantum noise suppression and phase-sensitive modulation in a hybrid optical resonant cavity system

abstract: Quantum noise suppression and phase-sensitive modulation of continuously variable in vacuum and squeezed fields in a hybrid resonant cavity system are investigated theoretically. Multiple dark windows similar to electromagnetic induction transparency (EIT) are observed in quantum noise fluctuation curve. The effects of pumping light on both suppression of quantum noise and control the widths of dark windows are carefully analyzed, and the saturation point of pumping light for nonlinear crystal conversion is obtained. We find that the noise suppression effect is strongly sensitive to the pumping light power. The degree of noise suppression can be up to 13.9 dB when the pumping light power is 6.5 Beta_th. Moreover, a phase-sensitive modulation scheme is demonstrated, which well fills the gap that multi-channel quantum noise suppression is difficult to realize at the quadrature amplitude of squeezed field. Our result is meaningful for various applications in precise measurement physics, quantum information processing and quantum communications of system-on-a-chip.


title: Concept of an achromatic stellar coronagraph and its application for detecting extrasolar planets

abstract: Imaging the planets that orbit around other stars requires blocking the host star which is usually 8-10 orders of magnitude brighter than the planets. This is achieved with the help of a stellar coronagraph. In the current work, a concept of a new type of stellar coronagraph is introduced where the star light is blocked by a linear polarizer in the collimated beam. It is based on differential rotation between the linear polarization state of planet light and that of star light. This is achieved with the help of a set of thick birefringent crystals in the collimated beam of a telescope where the planet light is made to travel extra optical path length compared to star light. By adjusting the orientation and thickness of the crystal, the optical path length can be made to cause a phase difference of {\pi}, just enough to rotate the initial plane of polarization by 90{\deg} for planet-light without affecting the star light. Theoretical calculations involving the phase difference due to birefringent crystals are presented here along with the basic configuration and design. It is shown that the design blocks the star light identically at all wavelengths. Application of this concept for detecting Earth-like extrasolar planet is discussed using a one-meter class telescope.


title: On the logarithmic derivative of characteristic polynomials for random unitary matrices

abstract: Let $U\in U(N)$ be a random unitary matrix of size $N$, distributed with respect to the Haar measure on $U(N)$. Let $P(z)=P_U(z)$ be the characteristic polynomial of $U$. We prove that for $z$ close to the unit circle, $ \frac{P'}{P}(z) $ can be approximated using zeros of $P$ very close to $z$, with a typically controllable error term. This is an analogue of a result of Selberg for the Riemann zeta-function. We also prove a mesoscopic central limit theorem for $ \frac{P'}{P}(z) $ away from the unit circle, and this is an analogue of a result of Lester for zeta.


title: Spontaneous superconducting diode effect in non-magnetic Nb/Ru/Sr$_2$RuO$_4$ topological junctions

abstract: Non-reciprocal electronic transport in a material occurs if both time reversal and inversion symmetries are broken. The superconducting diode effect (SDE) is an exotic manifestation of this type of behavior where the critical current for positive and negative currents are mismatched, as recently observed in some non-centrosymmetric superconductors with a magnetic field. Here, we demonstrate a SDE in non-magnetic Nb/Ru/Sr$_2$RuO$_4$ Josephson junctions without applying an external magnetic field. The cooling history dependence of the SDE suggests that time-reversal symmetry is intrinsically broken by the superconducting phase of Sr$_2$RuO$_4$. Applied magnetic fields modify the SDE dynamically by randomly changing the sign of the non-reciprocity. We propose a model for such a topological junction with a conventional superconductor surrounded by a chiral superconductor with broken time reversal symmetry.


title: Where to Pay Attention in Sparse Training for Feature Selection?

abstract: A new line of research for feature selection based on neural networks has recently emerged. Despite its superiority to classical methods, it requires many training iterations to converge and detect informative features. The computational time becomes prohibitively long for datasets with a large number of samples or a very high dimensional feature space. In this paper, we present a new efficient unsupervised method for feature selection based on sparse autoencoders. In particular, we propose a new sparse training algorithm that optimizes a model's sparse topology during training to pay attention to informative features quickly. The attention-based adaptation of the sparse topology enables fast detection of informative features after a few training iterations. We performed extensive experiments on 10 datasets of different types, including image, speech, text, artificial, and biological. They cover a wide range of characteristics, such as low and high-dimensional feature spaces, and few and large training samples. Our proposed approach outperforms the state-of-the-art methods in terms of selecting informative features while reducing training iterations and computational costs substantially. Moreover, the experiments show the robustness of our method in extremely noisy environments.


title: Invariant Keisler measures for omega-categorical structures

abstract: A recent article of Chernikov, Hrushovski, Kruckman, Krupinski, Moconja, Pillay and Ramsey finds the first examples of simple structures with formulas which do not fork over $\emptyset$ but are universally measure zero. In this article we give the first known simple $\omega$-categorical counterexamples. These happen to be various $\omega$-categorical Hrushovski constructions. Using a probabilistic independence theorem from Jahel and Tsankov, we show how simple $\omega$-categorical structures where the forking ideal and the universally measure zero ideal coincide must satisfy a stronger version of the independence theorem.


title: Distribution of shifted discrete random walk generated by distinct random variables and applications in ruin theory

abstract: In this paper, we set up the distribution function $$ \varphi(u)=\mathbb{P}\left(\sup_{n\geqslant 1}\sum_{i=1}^{n}\left(X_i-\kappa\right)<u\right), $$ and the generating function of $\varphi(u+1)$, where $u\in\mathbb{N}_0$, $\kappa\in\mathbb{N}$, the random walk $\left\{\sum_{i=1}^{n}X_i, n\in\mathbb{N}\right\},$ consists of $N\in\mathbb{N}$ periodically occurring distributions, and the integer-valued and non-negative random variables $X_1,\,X_2,\,\ldots$ are independent. This research generalizes two recent works where $\{\kappa=1,\,N\in\mathbb{N}\}$ and $\{\kappa\in\mathbb{N},\,N=1\}$ were considered respectively. The provided sequence of sums $\left\{\sum_{i=1}^{n}\left(X_i-\kappa\right),\,n\in\mathbb{N}\right\}$ generates so-called multi-seasonal discrete-time risk model with arbitrary natural premium and its known distribution enables to calculate the ultimate time ruin probability $1-\varphi(u)$ or survival probability $\varphi(u)$. Verifying obtained theoretical statements we demonstrate several computational examples for survival probability $\varphi(u)$ and its generating function when $\{\kappa=2,\,N=2\}$, $\{\kappa=3,\,N=2\}$, $\{\kappa=5,\,N=10\}$ and $X_i$ admits Poisson and some other distributions. We also conjecture the non-singularity of certain matrices.


title: Symplectic polarity and Mahler's conjecture

abstract: We state a conjecture about volumes of symplectically self-polar convex bodies, show that it is equivalent to Mahler's conjecture about volumes of a convex body and its Euclidean polar, prove lower and upper bounds on symplectic capacities of symplectically self-polar bodies, and make other relevant observations.


title: Searching for Discriminative Words in Multidimensional Continuous Feature Space

abstract: Word feature vectors have been proven to improve many NLP tasks. With recent advances in unsupervised learning of these feature vectors, it became possible to train it with much more data, which also resulted in better quality of learned features. Since it learns joint probability of latent features of words, it has the advantage that we can train it without any prior knowledge about the goal task we want to solve. We aim to evaluate the universal applicability property of feature vectors, which has been already proven to hold for many standard NLP tasks like part-of-speech tagging or syntactic parsing. In our case, we want to understand the topical focus of text documents and design an efficient representation suitable for discriminating different topics. The discriminativeness can be evaluated adequately on text categorisation task. We propose a novel method to extract discriminative keywords from documents. We utilise word feature vectors to understand the relations between words better and also understand the latent topics which are discussed in the text and not mentioned directly but inferred logically. We also present a simple way to calculate document feature vectors out of extracted discriminative words. We evaluate our method on the four most popular datasets for text categorisation. We show how different discriminative metrics influence the overall results. We demonstrate the effectiveness of our approach by achieving state-of-the-art results on text categorisation task using just a small number of extracted keywords. We prove that word feature vectors can substantially improve the topical inference of documents' meaning. We conclude that distributed representation of words can be used to build higher levels of abstraction as we demonstrate and build feature vectors of documents.


title: Why Neural Networks Work

abstract: We argue that many properties of fully-connected feedforward neural networks (FCNNs), also called multi-layer perceptrons (MLPs), are explainable from the analysis of a single pair of operations, namely a random projection into a higher-dimensional space than the input, followed by a sparsification operation. For convenience, we call this pair of successive operations expand-and-sparsify following the terminology of Dasgupta. We show how expand-and-sparsify can explain the observed phenomena that have been discussed in the literature, such as the so-called Lottery Ticket Hypothesis, the surprisingly good performance of randomly-initialized untrained neural networks, the efficacy of Dropout in training and most importantly, the mysterious generalization ability of overparameterized models, first highlighted by Zhang et al. and subsequently identified even in non-neural network models by Belkin et al.


title: A Contextual Master-Slave Framework on Urban Region Graph for Urban Village Detection

abstract: Urban villages (UVs) refer to the underdeveloped informal settlement falling behind the rapid urbanization in a city. Since there are high levels of social inequality and social risks in these UVs, it is critical for city managers to discover all UVs for making appropriate renovation policies. Existing approaches to detecting UVs are labor-intensive or have not fully addressed the unique challenges in UV detection such as the scarcity of labeled UVs and the diverse urban patterns in different regions. To this end, we first build an urban region graph (URG) to model the urban area in a hierarchically structured way. Then, we design a novel contextual master-slave framework to effectively detect the urban village from the URG. The core idea of such a framework is to firstly pre-train a basis (or master) model over the URG, and then to adaptively derive specific (or slave) models from the basis model for different regions. The proposed framework can learn to balance the generality and specificity for UV detection in an urban area. Finally, we conduct extensive experiments in three cities to demonstrate the effectiveness of our approach.