title: Equivalence between Sobolev spaces of first-order dominating mixed smoothness and unanchored ANOVA spaces on $\mathbb{R}^d$

abstract: We prove that a variant of the classical Sobolev space of first-order dominating mixed smoothness is equivalent (under a certain condition) to the unanchored ANOVA space on $\mathbb{R}^d$, for $d \geq 1$. Both spaces are Hilbert spaces involving weight functions, which determine the behaviour as different variables tend to $\pm \infty$, and weight parameters, which represent the influence of different subsets of variables. The unanchored ANOVA space on $\mathbb{R}^d$ was initially introduced by Nichols & Kuo in 2014 to analyse the error of quasi-Monte Carlo (QMC) approximations for integrals on unbounded domains; whereas the classical Sobolev space of dominating mixed smoothness was used as the setting in a series of papers by Griebel, Kuo & Sloan on the smoothing effect of integration, in an effort to develop a rigorous theory on why QMC methods work so well for certain non-smooth integrands with kinks or jumps coming from option pricing problems. In this same setting, Griewank, Kuo, Le\"ovey & Sloan in 2018 subsequently extended these ideas by developing a practical smoothing by preintegration technique to approximate integrals of such functions with kinks or jumps. We first prove the equivalence in one dimension (itself a non-trivial task), before following a similar, but more complicated, strategy to prove the equivalence for general dimensions. As a consequence of this equivalence, we analyse applying QMC combined with a preintegration step to approximate the fair price of an Asian option, and prove that the error of such an approximation using $N$ points converges at a rate close to $1/N$.


title: Face Forensics in the Wild

abstract: On existing public benchmarks, face forgery detection techniques have achieved great success. However, when used in multi-person videos, which often contain many people active in the scene with only a small subset having been manipulated, their performance remains far from being satisfactory. To take face forgery detection to a new level, we construct a novel large-scale dataset, called FFIW-10K, which comprises 10,000 high-quality forgery videos, with an average of three human faces in each frame. The manipulation procedure is fully automatic, controlled by a domain-adversarial quality assessment network, making our dataset highly scalable with low human cost. In addition, we propose a novel algorithm to tackle the task of multi-person face forgery detection. Supervised by only video-level label, the algorithm explores multiple instance learning and learns to automatically attend to tampered faces. Our algorithm outperforms representative approaches for both forgery classification and localization on FFIW-10K, and also shows high generalization ability on existing benchmarks. We hope that our dataset and study will help the community to explore this new field in more depth.


title: Parameterized discrete uniformization theorems and curvature flows for polyhedral surfaces, II

abstract: This paper investigates the combinatorial $\alpha$-curvature for vertex scaling of piecewise hyperbolic metrics on polyhedral surfaces, which is a parameterized generalization of the classical combinatorial curvature. A discrete uniformization theorem for combinatorial $\alpha$-curvature is established, which generalizes Gu-Guo-Luo-Sun-Wu's discrete uniformization theorem for classical combinatorial curvature. We further introduce combinatorial $\alpha$-Yamabe flow and combinatorial $\alpha$-Calabi flow for vertex scaling to find piecewise hyperbolic metrics with prescribed combinatorial $\alpha$-curvatures. To handle the potential singularities along the combinatorial curvature flows, we do surgery along the flows by edge flipping. Using the discrete conformal theory established by Gu-Guo-Luo-Sun-Wu, we prove the longtime existence and convergence of combinatorial $\alpha$-Yamabe flow and combinatorial $\alpha$-Calabi flow with surgery, which provide effective algorithms for finding piecewise hyperbolic metrics with prescribed combinatorial $\alpha$-curvatures.


title: Simplicial complexes which are minimal Cohen-Macaulay

abstract: Let $\D$ be a $(d-1)$-dimensional pure $f$-simplicial complex over vertex set $[n]$. In this paper, it is proved that $n=2d$ holds true if $\D$ is minimal Cohen-Macaulay. It is also indicated that the recent work of \cite{Dao2020} implies that shellable condition on a pure simplicial complex $\D$ is identical with CM properties of a full series of subcomplexes of $\D$.


title: Environmental sound analysis with mixup based multitask learning and cross-task fusion

abstract: Environmental sound analysis is currently getting more and more attentions. In the domain, acoustic scene classification and acoustic event classification are two closely related tasks. In this letter, a two-stage method is proposed for the above tasks. In the first stage, a mixup based MTL solution is proposed to classify both tasks in one single convolutional neural network. Artificial multi-label samples are used in the training of the MTL model, which are mixed up using existing single-task datasets. The multi-task model obtained can effectively recognize both the acoustic scenes and events. Compared with other methods such as re-annotation or synthesis, the mixup based MTL is low-cost, flexible and effective. In the second stage, the MTL model is modified into a single-task model which is fine-tuned using the original dataset corresponding to the specific task. By controlling the frozen layers carefully, the task-specific high level features are fused and the performance of the single classification task is further improved. The proposed method has confirmed the complementary characteristics of acoustic scene and acoustic event classifications. Finally, enhanced by ensemble learning, a satisfactory accuracy of 84.5 percent on TUT acoustic scene 2017 dataset and an accuracy of 77.5 percent on ESC-50 dataset are achieved respectively.


title: Geometry of Program Synthesis

abstract: We re-evaluate universal computation based on the synthesis of Turing machines. This leads to a view of programs as singularities of analytic varieties or, equivalently, as phases of the Bayesian posterior of a synthesis problem. This new point of view reveals unexplored directions of research in program synthesis, of which neural networks are a subset, for example in relation to phase transitions, complexity and generalisation. We also lay the empirical foundations for these new directions by reporting on our implementation in code of some simple experiments.


title: A Graphical Calculus for Quantum Computing with Multiple Qudits using Generalized Clifford Algebras

abstract: In this work, we develop a graphical calculus for multi-qudit computations with generalized Clifford algebras, using the algebraic framework developed in a previous work. We build our graphical calculus out of a fixed set of graphical primitives defined by algebraic expressions constructed out of elements of a given generalized Clifford algebra, a graphical primitive corresponding to the ground state, and also graphical primitives corresponding to projections onto the ground state of each qudit. We establish many properties of the graphical calculus using purely algebraic methods, including a novel algebraic proof of a Yang-Baxter equation and a construction of a corresponding braid group representation. Our algebraic proof, which applies to arbitrary qudit dimension, also enables a resolution of an open problem of Cobanera and Ortiz on the construction of self-dual braid group representations for even qudit dimension. We also derive several new identities for the braid elements, which are key to our proofs. In terms of physics, we connect these braid identities to physics by showing the presence of a conserved charge. Furthermore, we demonstrate that in many cases, the verification of involved vector identities can be reduced to the combinatorial application of two basic vector identities. We show how to explicitly compute various vector states in an efficient manner using algebraic methods. Additionally, in terms of quantum computation, we demonstrate that it is feasible to envision implementing the braid operators for quantum computation, by showing that they are 2-local operators. In fact, these braid elements are almost Clifford gates, for they normalize the generalized Pauli group up to an extra factor $\zeta$, which is an appropriate square root of a primitive root of unity.


title: Optimal Stochastic Nonconvex Optimization with Bandit Feedback

abstract: In this paper, we analyze the continuous armed bandit problems for nonconvex cost functions under certain smoothness and sublevel set assumptions. We first derive an upper bound on the expected cumulative regret of a simple bin splitting method. We then propose an adaptive bin splitting method, which can significantly improve the performance. Furthermore, a minimax lower bound is derived, which shows that our new adaptive method achieves locally minimax optimal expected cumulative regret.


title: Fully Convolutional Scene Graph Generation

abstract: This paper presents a fully convolutional scene graph generation (FCSGG) model that detects objects and relations simultaneously. Most of the scene graph generation frameworks use a pre-trained two-stage object detector, like Faster R-CNN, and build scene graphs using bounding box features. Such pipeline usually has a large number of parameters and low inference speed. Unlike these approaches, FCSGG is a conceptually elegant and efficient bottom-up approach that encodes objects as bounding box center points, and relationships as 2D vector fields which are named as Relation Affinity Fields (RAFs). RAFs encode both semantic and spatial features, and explicitly represent the relationship between a pair of objects by the integral on a sub-region that points from subject to object. FCSGG only utilizes visual features and still generates strong results for scene graph generation. Comprehensive experiments on the Visual Genome dataset demonstrate the efficacy, efficiency, and generalizability of the proposed method. FCSGG achieves highly competitive results on recall and zero-shot recall with significantly reduced inference time.


title: Public Transport Planning: When Transit Network Connectivity Meets Commuting Demand

abstract: In this paper, we make a first attempt to incorporate both commuting demand and transit network connectivity in bus route planning (CT-Bus), and formulate it as a constrained optimization problem: planning a new bus route with k edges over an existing transit network without building new bus stops to maximize a linear aggregation of commuting demand and connectivity of the transit network. We prove the NP-hardness of CT-Bus and propose an expansion-based greedy algorithm that iteratively scans potential candidate paths in the network. To boost the efficiency of computing the connectivity of new networks with candidate paths, we convert it to a matrix trace estimation problem and employ a Lanczos method to estimate the natural connectivity of the transit network with a guaranteed error bound. Furthermore, we derive upper bounds on the objective values and use them to greedily select candidates for expansion. Our experiments conducted on real-world transit networks in New York City and Chicago verify the efficiency, effectiveness, and scalability of our algorithms.


title: A Taxonomy of Cyber Defence Strategies Against False Data Attacks in Smart Grid

abstract: Modern electric power grid, known as the Smart Grid, has fast transformed the isolated and centrally controlled power system to a fast and massively connected cyber-physical system that benefits from the revolutions happening in the communications and the fast adoption of Internet of Things devices. While the synergy of a vast number of cyber-physical entities has allowed the Smart Grid to be much more effective and sustainable in meeting the growing global energy challenges, it has also brought with it a large number of vulnerabilities resulting in breaches of data integrity, confidentiality and availability. False data injection (FDI) appears to be among the most critical cyberattacks and has been a focal point interest for both research and industry. To this end, this paper presents a comprehensive review in the recent advances of the defence countermeasures of the FDI attacks in the Smart Grid infrastructure. Relevant existing literature are evaluated and compared in terms of their theoretical and practical significance to the Smart Grid cybersecurity. In conclusion, a range of technical limitations of existing false data attack detection researches are identified, and a number of future research directions are recommended.


title: Dynamic Attention guided Multi-Trajectory Analysis for Single Object Tracking

abstract: Most of the existing single object trackers track the target in a unitary local search window, making them particularly vulnerable to challenging factors such as heavy occlusions and out-of-view movements. Despite the attempts to further incorporate global search, prevailing mechanisms that cooperate local and global search are relatively static, thus are still sub-optimal for improving tracking performance. By further studying the local and global search results, we raise a question: can we allow more dynamics for cooperating both results? In this paper, we propose to introduce more dynamics by devising a dynamic attention-guided multi-trajectory tracking strategy. In particular, we construct dynamic appearance model that contains multiple target templates, each of which provides its own attention for locating the target in the new frame. Guided by different attention, we maintain diversified tracking results for the target to build multi-trajectory tracking history, allowing more candidates to represent the true target trajectory. After spanning the whole sequence, we introduce a multi-trajectory selection network to find the best trajectory that delivers improved tracking performance. Extensive experimental results show that our proposed tracking strategy achieves compelling performance on various large-scale tracking benchmarks. The project page of this paper can be found at https://sites.google.com/view/mt-track/.


title: A truncated second main theorem for algebraic tori with moving targets and applications

abstract: We establish a second main theorem for algebraic tori with slow growth moving targets with truncation to level 1. As the first application of this result, we prove the Green-Griffith-Lang conjecture for projective spaces with $n+1$ components in the context of moving targets of slow growth. Then we discuss the integrability of the ring of exponential polynomials in the ring of entire functions as another application.


title: A fully nonlinear locally constrained anisotropic curvature flow

abstract: Given a smooth positive function $F\in C^{\infty}(\mathbb{S}^n)$ such that the square of its positive $1$-homogeneous extension on $\mathbb{R}^{n+1}\setminus \{0\}$ is uniformly convex, the Wulff shape $W_F$ is a smooth uniformly convex body in the Euclidean space $\mathbb{R}^{n+1}$ with $F$ being the support function of the boundary $\partial W_F$. In this paper, we introduce the fully nonlinear locally constrained anisotropic curvature flow \begin{equation*} \frac{\partial }{\partial t}X=(1-E_k^{1/k}\sigma_F)\nu_F,\quad k=2,\cdots,n \end{equation*} in the Euclidean space, where $E_k$ denotes the normalized $k$th anisotropic mean curvature with respect to the Wulff shape $W_F$, $\sigma_F$ the anisotropic support function and $\nu_F$ the outward anisotropic unit normal of the evolving hypersurface. We show that starting from a smooth, closed and strictly convex hypersurface in $\mathbb{R}^{n+1}$ ($n\geq 2$), the smooth solution of the flow exists for all positive time and converges smoothly and exponentially to a scaled Wulff shape. A nice feature of this flow is that it improves a certain isoperimetric ratio. Therefore by the smooth convergence of the above flow, we provide a new proof of a class of the Alexandrov--Fenchel inequalities for anisotropic mixed volumes of smooth convex domains in the Euclidean space.


title: Reinforcement learning for optimization of variational quantum circuit architectures

abstract: The study of Variational Quantum Eigensolvers (VQEs) has been in the spotlight in recent times as they may lead to real-world applications of near-term quantum devices. However, their performance depends on the structure of the used variational ansatz, which requires balancing the depth and expressivity of the corresponding circuit. In recent years, various methods for VQE structure optimization have been introduced but the capacities of machine learning to aid with this problem has not yet been fully investigated. In this work, we propose a reinforcement learning algorithm that autonomously explores the space of possible ans{\"a}tze, identifying economic circuits which still yield accurate ground energy estimates. The algorithm is intrinsically motivated, and it incrementally improves the accuracy of the result while minimizing the circuit depth. We showcase the performance of our algorithm on the problem of estimating the ground-state energy of lithium hydride (LiH). In this well-known benchmark problem, we achieve chemical accuracy, as well as state-of-the-art results in terms of circuit depth.


title: Generating and detecting entangled cat states in dissipatively coupled degenerate optical parametric oscillators

abstract: Non-Gaussian continuous variable states play a central role both in the foundations of quantum theory and for emergent quantum technologies. In particular, "cat states", i.e., two-component macroscopic quantum superpositions, embody quantum coherence in an accessible way and can be harnessed for fundamental tests and quantum information tasks alike. Degenerate optical parametric oscillators can naturally produce single-mode cat states and thus represent a promising platform for their realization and harnessing. We show that a dissipative coupling between degenerate optical parametric oscillators extends this to two-mode entangled cat states, i.e., two-mode entangled cat states are naturally produced under such dissipative coupling. While overcoming single-photon loss still represents a major challenge towards the realization of sufficiently pure single-mode cat states in degenerate optical parametric oscillators, we show that the generation of two-mode entangled cat states under such dissipative coupling can then be achieved without additional hurdles. We numerically explore the parameter regime for the successful generation of transient two-mode entangled cat states in two dissipatively coupled degenerate optical parametric oscillators. To certify the cat-state entanglement, we employ a tailored, variance-based entanglement criterion, which can robustly detect cat-state entanglement under realistic conditions.


title: Symbolic Music Generation with Diffusion Models

abstract: Score-based generative models and diffusion probabilistic models have been successful at generating high-quality samples in continuous domains such as images and audio. However, due to their Langevin-inspired sampling mechanisms, their application to discrete and sequential data has been limited. In this work, we present a technique for training diffusion models on sequential data by parameterizing the discrete domain in the continuous latent space of a pre-trained variational autoencoder. Our method is non-autoregressive and learns to generate sequences of latent embeddings through the reverse process and offers parallel generation with a constant number of iterative refinement steps. We apply this technique to modeling symbolic music and show strong unconditional generation and post-hoc conditional infilling results compared to autoregressive language models operating over the same continuous embeddings.


title: Inferring the Geometric Nullspace of Robot Skills from Human Demonstrations

abstract: In this paper we present a framework to learn skills from human demonstrations in the form of geometric nullspaces, which can be executed using a robot. We collect data of human demonstrations, fit geometric nullspaces to them, and also infer their corresponding geometric constraint models. These geometric constraints provide a powerful mathematical model as well as an intuitive representation of the skill in terms of the involved objects. To execute the skill using a robot, we combine this geometric skill description with the robot's kinematics and other environmental constraints, from which poses can be sampled for the robot's execution. The result of our framework is a system that takes the human demonstrations as input, learns the underlying skill model, and executes the learnt skill with different robots in different dynamic environments. We evaluate our approach on a simulated industrial robot, and execute the final task on the iCub humanoid robot.


title: Graph kernels encoding features of all subgraphs by quantum superposition

abstract: Graph kernels are often used in bioinformatics and network applications to measure the similarity between graphs; therefore, they may be used to construct efficient graph classifiers. Many graph kernels have been developed thus far, but to the best of our knowledge there is no existing graph kernel that considers all subgraphs to measure similarity. We propose a novel graph kernel that applies a quantum computer to measure the graph similarity taking all subgraphs into account by fully exploiting the power of quantum superposition to encode every subgraph into a feature. For the construction of the quantum kernel, we develop an efficient protocol that removes the index information of subgraphs encoded in the quantum state. We also prove that the quantum computer requires less query complexity to construct the feature vector than the classical sampler used to approximate the same vector. A detailed numerical simulation of a bioinformatics problem is presented to demonstrate that, in many cases, the proposed quantum kernel achieves better classification accuracy than existing graph kernels.


title: Flavor symmetries of six-dimensional ${\cal N}=(1,0)$ theories from AdS/CFT correspondence

abstract: We calculate the superconformal indices of a class of six-dimensional ${\cal N}=(1,0)$ superconformal field theories realized on M5-branes at $\mathbb{C}^2/\mathbb{Z}_k$ singularity by using the method developed in previous works of the authors and collaborators. We use the AdS/CFT correspondence, and finite $N$ corrections are included as the contribution of M2-branes wrapped on two-cycles in $S^4/\mathbb{Z}_k$. We confirm that the indices are consistent with the expected flavor symmetries.


title: Reconstructing Interactive 3D Scenes by Panoptic Mapping and CAD Model Alignments

abstract: In this paper, we rethink the problem of scene reconstruction from an embodied agent's perspective: While the classic view focuses on the reconstruction accuracy, our new perspective emphasizes the underlying functions and constraints such that the reconstructed scenes provide \em{actionable} information for simulating \em{interactions} with agents. Here, we address this challenging problem by reconstructing an interactive scene using RGB-D data stream, which captures (i) the semantics and geometry of objects and layouts by a 3D volumetric panoptic mapping module, and (ii) object affordance and contextual relations by reasoning over physical common sense among objects, organized by a graph-based scene representation. Crucially, this reconstructed scene replaces the object meshes in the dense panoptic map with part-based articulated CAD models for finer-grained robot interactions. In the experiments, we demonstrate that (i) our panoptic mapping module outperforms previous state-of-the-art methods, (ii) a high-performant physical reasoning procedure that matches, aligns, and replaces objects' meshes with best-fitted CAD models, and (iii) reconstructed scenes are physically plausible and naturally afford actionable interactions; without any manual labeling, they are seamlessly imported to ROS-based simulators and virtual environments for complex robot task executions.


title: Gaia EDR3 Parallax Zero-point Offset based on W Ursae Majoris-type Eclipsing Binaries

abstract: We independently determine the zero-point offset of the Gaia early Data Release-3 (EDR3) parallaxes based on $\sim 110,000$ W Ursae Majoris (EW)-type eclipsing binary systems. EWs cover almost the entire sky and are characterized by a relatively complete coverage in magnitude and color. They are an excellent proxy for Galactic main-sequence stars. We derive a $W1$-band Period-Luminosity relation with a distance accuracy of $7.4\%$, which we use to anchor the Gaia parallax zero-point. The final, global parallax offsets are $-28.6\pm0.6$ $\mu$as and $-25.4\pm4.0$ $\mu$as (before correction) and $4.2\pm0.5$ $\mu$as and $4.6\pm3.7$ $\mu$as (after correction) for the five- and six-parameter solutions, respectively. The total systematic uncertainty is $1.8$ $\mu$as. The spatial distribution of the parallax offsets shows that the bias in the corrected Gaia EDR3 parallaxes is less than 10 $\mu$as across $40\%$ of the sky. Only $15\%$ of the sky is characterized by a parallax offset greater than 30 $\mu$as. Thus, we have provided independent evidence that the parallax zero-point correction provided by the Gaia team significantly reduces the prevailing bias. Combined with literature data, we find that the overall Gaia EDR3 parallax offsets for Galactic stars are $[-20, -30]$ $\mu$as and 4-10 $\mu$as, respectively, before and after correction. For specific regions, an additional deviation of about 10 $\mu$as is found.


title: Quantum Capacitance Induced Non-Local Electrostatic Gating Effect in Graphene

abstract: Electrostatic gating lies in the heart of modern FET-based integrated circuits. Usually, the gate electrode has to be placed very close to the conduction channel, typically a few nanometers, in order to achieve efficient tunability. However, remote control of a FET device through a gate electrode placed far away is always highly desired, because it not only reduces the complexity of device fabrication, but also enables designing novel devices with new functionalities. Here, a non-local gating effect in graphene using both near-field optical nano-imaging and electrical transport measurement is reported. With assistance of absorbed water molecules, the charge density of graphene can be efficiently tuned by a local-gate placed over 30 {\mu}m away. The observed non-local gating effect is initially driven by an in-plane electric field established between graphene regions with different charge densities due to the quantum capacitance near the Dirac point in graphene. The nonlocality is further amplified and largely enhanced by absorbed water molecules through screening the in-plane electric field and expending the transition length. This research reveals novel non-local phenomenon of Dirac electrons, and paves the way for designing electronic devices with remote-control using 2D materials with small density of states.


title: Interpretable machine-learning identification of the crossover from subradiance to superradiance in an atomic array

abstract: Light-matter interacting quantum systems manifest strong correlations that lead to distinct cooperative spontaneous emissions of subradiance or superradiance. To demonstrate the essence of long-range correlations in such systems, we consider an atomic array under the resonant dipole-dipole interactions (RDDI) and apply an interpretable machine learning with the integrated gradients to identify the crossover between the subradiant and superradiant sectors. The machine shows that the next nearest-neighbor couplings in RDDI play as much as the roles of nearest-neighbor ones in determining the whole eigenspectrum within the training sets. Our results present the advantage of machine learning approach with explainable ability to reveal the underlying mechanism of correlations in quantum optical systems, which can be potentially applied to investigate many other strongly interacting quantum many-body systems.


title: DeepWORD: A GCN-based Approach for Owner-Member Relationship Detection in Autonomous Driving

abstract: It's worth noting that the owner-member relationship between wheels and vehicles has an significant contribution to the 3D perception of vehicles, especially in the embedded environment. However, there are currently two main challenges about the above relationship prediction: i) The traditional heuristic methods based on IoU can hardly deal with the traffic jam scenarios for the occlusion. ii) It is difficult to establish an efficient applicable solution for the vehicle-mounted system. To address these issues, we propose an innovative relationship prediction method, namely DeepWORD, by designing a graph convolution network (GCN). Specifically, we utilize the feature maps with local correlation as the input of nodes to improve the information richness. Besides, we introduce the graph attention network (GAT) to dynamically amend the prior estimation deviation. Furthermore, we establish an annotated owner-member relationship dataset called WORD as a large-scale benchmark, which will be available soon. The experiments demonstrate that our solution achieves state-of-the-art accuracy and real-time in practice.


title: Reputation and Pricing Dynamics in Online Markets

abstract: We study the economic interactions among sellers and buyers in online markets. In such markets, buyers have limited information about the product quality, but can observe the sellers' reputations which depend on their past transaction histories and ratings from past buyers. Sellers compete in the same market through pricing, while considering the impact of their heterogeneous reputations. We consider sellers with limited as well as unlimited capacities, which correspond to different practical market scenarios. In the unlimited seller capacity scenario, buyers prefer the seller with the highest reputation-price ratio. If the gap between the highest and second highest seller reputation levels is large enough, then the highest reputation seller dominates the market as a monopoly. If sellers' reputation levels are relatively close to each other, then those sellers with relatively high reputations will survive at the equilibrium, while the remaining relatively low reputation sellers will get zero market share. In the limited seller capacity scenario, we further consider two different cases. If each seller can only serve one buyer, then it is possible for sellers to set their monopoly prices at the equilibrium while all sellers gain positive market shares; if each seller can serve multiple buyers, then it is possible for sellers to set maximum prices at the equilibrium. Simulation results show that the dynamics of reputations and prices in the longer-term interactions will converge to stable states, and the initial buyer ratings of the sellers play the critical role in determining sellers' reputations and prices at the stable state.


title: Large Scale Autonomous Driving Scenarios Clustering with Self-supervised Feature Extraction

abstract: The clustering of autonomous driving scenario data can substantially benefit the autonomous driving validation and simulation systems by improving the simulation tests' completeness and fidelity. This article proposes a comprehensive data clustering framework for a large set of vehicle driving data. Existing algorithms utilize handcrafted features whose quality relies on the judgments of human experts. Additionally, the related feature compression methods are not scalable for a large data-set. Our approach thoroughly considers the traffic elements, including both in-traffic agent objects and map information. Meanwhile, we proposed a self-supervised deep learning approach for spatial and temporal feature extraction to avoid biased data representation. With the newly designed driving data clustering evaluation metrics based on data-augmentation, the accuracy assessment does not require a human-labeled data-set, which is subject to human bias. Via such unprejudiced evaluation metrics, we have shown our approach surpasses the existing methods that rely on handcrafted feature extractions.


title: XRJL-HKUST at SemEval-2021 Task 4: WordNet-Enhanced Dual Multi-head Co-Attention for Reading Comprehension of Abstract Meaning

abstract: This paper presents our submitted system to SemEval 2021 Task 4: Reading Comprehension of Abstract Meaning. Our system uses a large pre-trained language model as the encoder and an additional dual multi-head co-attention layer to strengthen the relationship between passages and question-answer pairs, following the current state-of-the-art model DUMA. The main difference is that we stack the passage-question and question-passage attention modules instead of calculating parallelly to simulate re-considering process. We also add a layer normalization module to improve the performance of our model. Furthermore, to incorporate our known knowledge about abstract concepts, we retrieve the definitions of candidate answers from WordNet and feed them to the model as extra inputs. Our system, called WordNet-enhanced DUal Multi-head Co-Attention (WN-DUMA), achieves 86.67% and 89.99% accuracy on the official blind test set of subtask 1 and subtask 2 respectively.


title: Local Collaborative Autoencoders

abstract: Top-N recommendation is a challenging problem because complex and sparse user-item interactions should be adequately addressed to achieve high-quality recommendation results. The local latent factor approach has been successfully used with multiple local models to capture diverse user preferences with different sub-communities. However, previous studies have not fully explored the potential of local models, and failed to identify many small and coherent sub-communities. In this paper, we present Local Collaborative Autoencoders (LOCA), a generalized local latent factor framework. Specifically, LOCA adopts different neighborhood ranges at the training and inference stages. Besides, LOCA uses a novel sub-community discovery method, maximizing the coverage of a union of local models and employing a large number of diverse local models. By adopting autoencoders as the base model, LOCA captures latent non-linear patterns representing meaningful user-item interactions within sub-communities. Our experimental results demonstrate that LOCA is scalable and outperforms state-of-the-art models on several public benchmarks, by 2.99~4.70% in Recall and 1.02~7.95% in NDCG, respectively.


title: Session-aware Linear Item-Item Models for Session-based Recommendation

abstract: Session-based recommendation aims at predicting the next item given a sequence of previous items consumed in the session, e.g., on e-commerce or multimedia streaming services. Specifically, session data exhibits some unique characteristics, i.e., session consistency and sequential dependency over items within the session, repeated item consumption, and session timeliness. In this paper, we propose simple-yet-effective linear models for considering the holistic aspects of the sessions. The comprehensive nature of our models helps improve the quality of session-based recommendation. More importantly, it provides a generalized framework for reflecting different perspectives of session data. Furthermore, since our models can be solved by closed-form solutions, they are highly scalable. Experimental results demonstrate that the proposed linear models show competitive or state-of-the-art performance in various metrics on several real-world datasets.


title: Expected-Cost Analysis for Probabilistic Programs and Semantics-Level Adaption of Optional Stopping Theorems

abstract: In this article, we present a semantics-level adaption of the Optional Stopping Theorem, sketch an expected-cost analysis as its application, and survey different variants of the Optional Stopping Theorem that have been used in static analysis of probabilistic programs.


title: Deep Learning and Machine Vision for Food Processing: A Survey

abstract: The quality and safety of food is an important issue to the whole society, since it is at the basis of human health, social development and stability. Ensuring food quality and safety is a complex process, and all stages of food processing must be considered, from cultivating, harvesting and storage to preparation and consumption. However, these processes are often labour-intensive. Nowadays, the development of machine vision can greatly assist researchers and industries in improving the efficiency of food processing. As a result, machine vision has been widely used in all aspects of food processing. At the same time, image processing is an important component of machine vision. Image processing can take advantage of machine learning and deep learning models to effectively identify the type and quality of food. Subsequently, follow-up design in the machine vision system can address tasks such as food grading, detecting locations of defective spots or foreign objects, and removing impurities. In this paper, we provide an overview on the traditional machine learning and deep learning methods, as well as the machine vision techniques that can be applied to the field of food processing. We present the current approaches and challenges, and the future trends.


title: Large Scale Visual Food Recognition

abstract: Food recognition plays an important role in food choice and intake, which is essential to the health and well-being of humans. It is thus of importance to the computer vision community, and can further support many food-oriented vision and multimodal tasks. Unfortunately, we have witnessed remarkable advancements in generic visual recognition for released large-scale datasets, yet largely lags in the food domain. In this paper, we introduce Food2K, which is the largest food recognition dataset with 2,000 categories and over 1 million images.Compared with existing food recognition datasets, Food2K bypasses them in both categories and images by one order of magnitude, and thus establishes a new challenging benchmark to develop advanced models for food visual representation learning. Furthermore, we propose a deep progressive region enhancement network for food recognition, which mainly consists of two components, namely progressive local feature learning and region feature enhancement. The former adopts improved progressive training to learn diverse and complementary local features, while the latter utilizes self-attention to incorporate richer context with multiple scales into local features for further local feature enhancement. Extensive experiments on Food2K demonstrate the effectiveness of our proposed method. More importantly, we have verified better generalization ability of Food2K in various tasks, including food recognition, food image retrieval, cross-modal recipe retrieval, food detection and segmentation. Food2K can be further explored to benefit more food-relevant tasks including emerging and more complex ones (e.g., nutritional understanding of food), and the trained models on Food2K can be expected as backbones to improve the performance of more food-relevant tasks. We also hope Food2K can serve as a large scale fine-grained visual recognition benchmark.


title: Predicting Landfall's Location and Time of a Tropical Cyclone Using Reanalysis Data

abstract: Landfall of a tropical cyclone is the event when it moves over the land after crossing the coast of the ocean. It is important to know the characteristics of the landfall in terms of location and time, well advance in time to take preventive measures timely. In this article, we develop a deep learning model based on the combination of a Convolutional Neural network and a Long Short-Term memory network to predict the landfall's location and time of a tropical cyclone in six ocean basins of the world with high accuracy. We have used high-resolution spacial reanalysis data, ERA5, maintained by European Center for Medium-Range Weather Forecasting (ECMWF). The model takes any 9 hours, 15 hours, or 21 hours of data, during the progress of a tropical cyclone and predicts its landfall's location in terms of latitude and longitude and time in hours. For 21 hours of data, we achieve mean absolute error for landfall's location prediction in the range of 66.18 - 158.92 kilometers and for landfall's time prediction in the range of 4.71 - 8.20 hours across all six ocean basins. The model can be trained in just 30 to 45 minutes (based on ocean basin) and can predict the landfall's location and time in a few seconds, which makes it suitable for real time prediction.


title: A new view of the solar interface region from the Interface Region Imaging Spectrograph (IRIS)

abstract: The Interface Region Imaging Spectrograph (IRIS) has been obtaining near- and far-ultraviolet images and spectra of the solar atmosphere since July 2013. The unique combination of near and far-ultraviolet spectra and images at subarcsecond resolution and high cadence allows the tracing of mass and energy through the critical interface between the solar surface and the corona or solar wind. IRIS has enabled research into the fundamental physical processes thought to play a role in the low solar atmosphere such as ion-neutral interactions, magnetic reconnection, the generation, propagation, and dissipation of various types of waves, the acceleration of non-thermal particles, and various small-scale instabilities. These new findings have helped provide novel insights into a wide range of phenomena including the discovery of non-thermal particles in coronal nanoflares, the formation and impact of spicules and other jets, resonant absorption and dissipation of Alfvenic waves, energy release associated with braiding of magnetic field lines, the thermal instability in the chromosphere-corona mass and energy cycle, the contribution of waves, turbulence, and non-thermal particles in the energy deposition during flares and smaller-scale events such as UV bursts, and the role of flux ropes and other mechanisms in triggering CMEs. IRIS observations have also advanced studies of the connections between solar and stellar physics. Advances in numerical modeling, inversion codes, and machine learning techniques have played a key role in driving these new insights. With the advent of exciting new instrumentation both on the ground (e.g., DKIST, ALMA) and space-based (e.g., Parker Solar Probe, Solar Orbiter), we aim to review new insights based on IRIS observations or related modeling, and highlight some of the outstanding challenges that have been brought to the fore.


title: Kaleido-BERT: Vision-Language Pre-training on Fashion Domain

abstract: We present a new vision-language (VL) pre-training model dubbed Kaleido-BERT, which introduces a novel kaleido strategy for fashion cross-modality representations from transformers. In contrast to random masking strategy of recent VL models, we design alignment guided masking to jointly focus more on image-text semantic relations. To this end, we carry out five novel tasks, i.e., rotation, jigsaw, camouflage, grey-to-color, and blank-to-color for self-supervised VL pre-training at patches of different scale. Kaleido-BERT is conceptually simple and easy to extend to the existing BERT framework, it attains new state-of-the-art results by large margins on four downstream tasks, including text retrieval (R@1: 4.03% absolute improvement), image retrieval (R@1: 7.13% abs imv.), category recognition (ACC: 3.28% abs imv.), and fashion captioning (Bleu4: 1.2 abs imv.). We validate the efficiency of Kaleido-BERT on a wide range of e-commerical websites, demonstrating its broader potential in real-world applications.


title: A resource-efficient method for repeated HPO and NAS problems

abstract: In this work we consider the problem of repeated hyperparameter and neural architecture search (HNAS). We propose an extension of Successive Halving that is able to leverage information gained in previous HNAS problems with the goal of saving computational resources. We empirically demonstrate that our solution is able to drastically decrease costs while maintaining accuracy and being robust to negative transfer. Our method is significantly simpler than competing transfer learning approaches, setting a new baseline for transfer learning in HNAS.


title: Modelling cometary meteoroid stream traverses of the Martian Moons eXploration (MMX) spacecraft en route to Phobos

abstract: The Martian Moons Exploration (MMX) spacecraft is a JAXA mission to Mars and its moons Phobos and Deimos. MMX will carry the Circum-Martian Dust Monitor (CMDM) which is a newly developed light-weight ($\mathrm{650\,g}$) large area ($\mathrm{1\,m^2}$) dust impact detector. Cometary meteoroid streams (also referred to as trails) exist along the orbits of comets, forming fine structures of the interplanetary dust cloud. The streams consist predominantly of the largest cometary particles (with sizes of approximately $\mathrm{100\,\mu m}$ to 1~cm) which are ejected at low speeds and remain very close to the comet orbit for several revolutions around the Sun. The Interplanetary Meteoroid Environment for eXploration (IMEX) dust streams in space model is a new and recently published universal model for cometary meteoroid streams in the inner Solar System. We use IMEX to study the detection conditions of cometary dust stream particles with CMDM during the MMX mission in the time period 2024 to 2028. The model predicts traverses of 12 cometary meteoroid streams with fluxes of $\mathrm{100\,\mu m}$ and bigger particles of at least $\mathrm{10^{-3}\,m^{-2}\,day^{-1}}$ during a total time period of approximately 90~days. The highest flux of $\mathrm{0.15\,m^{-2}\,day^{-1}}$ is predicted for comet 114P/Wiseman-Skiff in October 2026. With its large detection area and high sensitivity CMDM will be able to detect cometary meteoroid streams en route to Phobos. Our simulation results for the Mars orbital phase of MMX also predict the occurrence of meteor showers in the Martian atmosphere which may be observable from the Martian surface with cameras on board landers or rovers. Finally, the IMEX model can be used to study the impact hazards imposed by meteoroid impacts on to large-area spacecraft structures that will be particularly necessary for crewed deep space missions.


title: Characterization of Shapiro steps in the presence of a 4{\pi}-periodic Josephson current

abstract: The Majorana zero-energy modes (MZMs) residing at the boundary of topological superconductors have attracted a great deal of interest recently, as they provide a platform to explore fundamental physics such as non-Abelian statistics, as well as fault-tolerant quantum computation. Period doubling of Shapiro steps in a Josephson junction under microwave irradiation has been regarded as strong evidence for the emergence of the MZMs at the junction edges. However, questions remain as to how the Shapiro steps respond to the presence of a 4{\pi}-periodic Josephson current. In this study, we investigated the characteristic features of Shapiro steps with respect to the ratio ({\alpha}) of the 4{\pi}-periodic current to the topologically trivial 2{\pi}-periodic one, as well as the reduced microwave frequency ({\Omega}) and McCumber parameter ({\beta}) of the junction. Our analysis reproduced Shapiro steps similar to those observed experimentally for specific parameter sets of {\alpha},{\Omega} ({\lesssim 0.1}), and {\beta} ({gtrsim 1.0}). Full suppression of the first lobe of the n=1 step guarantees the presence of a 4{\pi}-periodic Josephson current.In addition, we discuss the range of {\Omega} and {\beta} needed for full suppression of the first lobe of the {n=1} step, even for small {\alpha} ({<0.1}). To observe "period-doubled Shapiro steps", even with a small {\alpha}, the junction should have a large {I_c}{R_N} product and sufficiently large junction capacitance.


title: Variational approach to the existence of solutions for non-instantaneous impulsive differential equations with perturbation

abstract: In this paper, we study the existence of solutions for second-order non-instantaneous impulsive differential equations with a perturbation term. By variational approach, we obtain the problem has at least one solution under assumptions that the nonlinearities are super-quadratic at infinity, and sub-quadratic at the origin.


title: Two-Stage Monte Carlo Denoising with Adaptive Sampling and Kernel Pool

abstract: Monte Carlo path tracer renders noisy image sequences at low sampling counts. Although great progress has been made on denoising such sequences, existing methods still suffer from spatial and temporary artifacts. In this paper, we tackle the problems in Monte Carlo rendering by proposing a two-stage denoiser based on the adaptive sampling strategy. In the first stage, concurrent to adjusting samples per pixel (spp) on-the-fly, we reuse the computations to generate extra denoising kernels applying on the adaptively rendered image. Rather than a direct prediction of pixel-wise kernels, we save the overhead complexity by interpolating such kernels from a public kernel pool, which can be dynamically updated to fit input signals. In the second stage, we design the position-aware pooling and semantic alignment operators to improve spatial-temporal stability. Our method was first benchmarked on 10 synthesized scenes rendered from the Mitsuba renderer and then validated on 3 additional scenes rendered from our self-built RTX-based renderer. Our method outperforms state-of-the-art counterparts in terms of both numerical error and visual quality.


title: On the Dynamics of the Jet Wiping Process: Numerical Simulations and Modal Analysis

abstract: We analyze the flow of a planar gas jet impinging on a thin film, dragged by a vertical moving wall. In the coating industry, this configuration is known as jet wiping, a process in which impinging jets control the thickness of liquid coatings on flat plates withdrawn vertically from a coating bath. We present three-dimensional (3D) two-phase flow simulations combining Large Eddy Simulation (LES) and Volume of Fluid (VOF). Three wiping configurations are simulated and the results are validated with experimental data from previous works. Multiscale modal analysis is used to analyze the dynamic interaction between the gas flow and the liquid film. In particular, we present a combination of Multiscale Proper Orthogonal decomposition (mPOD) and correlation analysis. The mPOD is used to identify the dominant travelling wave pattern in the liquid film flow, and the temporal structures are used to determine the most correlated flow features in the gas jet. This allows for revealing a two-dimensional (2D) mechanism for wave formation in the liquid coat. Finally, we use the numerical results to analyze the validity of some of the critical assumptions underpinning the derivation of integral film models of jet wiping.


title: Connectivity and Collision Constrained Opportunistic Routing for Emergency Communication using UAV

abstract: Emergency communication is extremely important to aid rescue and search operation in the aftermath of any disaster. In such scenario, Unmanned Aerial Vehicle (UAV) networks may be used to complement the damaged cellular networks over large areas. However, in such UAV networks, routing is a challenge, owing to high UAV mobility, intermittent link quality between UAVs, dynamic three dimensional (3D) UAV topology and resource constraints. Though several UAV routing approaches have been proposed, none of them so far have addressed inter UAV coverage, collision and routing in an integrated manner. In this paper, we consider a scenario where network of UAVs, operating at different heights from ground, with inter UAV coverage and collision constraints, are sent on a mission to collect disaster surveillance data and route it to Terrestrial Base Station via multi-hop UAV path. Analytical expressions for coverage probability (Pcov) and collision probability (Pcoll) are derived and minimum (Rmin) and maximum (Rmax) distance between UAVs are empirically calculated. We then propose a novel Multi-hop Opportunistic 3D Routing (MO3DR) algorithm with inter UAV coverage and collision constraints such that at every hop expected progress of data packet is maximized. The numerical results obtained from closed form mathematical modelling are validated through extensive simulation and their trade-off with variation in network parameters such as path loss component, trajectory divergence etc. are demonstrated. Finally, we obtain empirical optimality condition for inter UAV distance for the given application requirement.


title: The Formation of Global Free Trade Agreement

abstract: We investigate the formation of Free Trade Agreement (FTA) in a competing importers framework with $n$ countries. We show that (i) FTA formation causes a negative externality to non-participants, (ii) a non-participant is willing to join an FTA, and (iii) new participation may decrease the welfare of incumbent participants. A unique subgame perfect equilibrium of a sequential FTA formation game does not achieve global free trade under an open-access rule where a new applicant needs consent of members for accession, currently employed by many open regionalism agreements including APEC. We further show that global FTA is a unique subgame perfect equilibrium under an open-access rule without consent.


title: Isovector spin susceptibility: Isotopic evolution of collectivity in spin response

abstract: Background: Response to spin-dependent operators has been investigated in the magnetic dipole and Gamow-Teller transitions, which provides magnetic properties of a nuclear system. Purpose: I investigate an isotopic dependence of the collectivity generated by the spin-dependent interactions in the Ca and Ni isotopes through the isovector (IV) spin-flip excitations. The responses in the neutral $(t_z)$ and charge-exchange $(t_{\pm})$ channels are considered in a unified way. Method: A nuclear energy-density functional approach is employed for calculating the response functions based on the Skyrme-Kohn-Sham-Bogoliubov method and the quasiparticle-random-phase approximation (QRPA). I adopt the like-particle QRPA and the proton-neutron QRPA for the neutral and charge-exchange channels, respectively. I consider the fluctuation of the proton-neutron pair fields. Results: The collective shift due to RPA correlations for the response in the neutral channel is explained by the occupation probability of neutrons in the $j_>=\ell+1/2$ orbital. Many particle-hole or two-quasiparticle excitations have a coherent contribution to form a giant resonance in neutron-rich nuclei for the charge-exchange channel. The IV spin susceptibility displays the isotopic evolution of the collectivity and the underlying shell structure. Conclusions: A repulsive character of the residual interaction in the spin-isospin channel diminishes the IV spin susceptibility due to the collectivity, while the dynamic ${}^{3}S$ pairing appearing in the charge-exchange channel opposes the reduction.


title: Mixed-precision for Linear Solvers in Global Geophysical Flows

abstract: Semi-implicit time-stepping schemes for atmosphere and ocean models require elliptic solvers that work efficiently on modern supercomputers. This paper reports our study of the potential computational savings when using mixed precision arithmetic in the elliptic solvers. The essential components of a representative elliptic solver are run at precision levels as low as half (16 bits), and accompanied with a detailed evaluation of the impact of reduced precision on the solver convergence and the solution quality. A detailed inquiry into reduced precision requires a model configuration that is meaningful but cheaper to run and easier to evaluate than full atmosphere/ocean models. This study is therefore conducted in the context of a novel semi-implicit shallow-water model on the sphere, purposely designed to mimic numerical intricacies of modern all-scale weather and climate (W&C) models with the numerical stability independent on celerity of all wave motions. The governing algorithm of the shallow-water model is based on the non-oscillatory MPDATA methods for geophysical flows, whereas the resulting elliptic problem employs a strongly preconditioned non-symmetric Krylov-subspace solver GCR, proven in advanced atmospheric applications. The classical longitude/latitude grid is deliberately chosen to retain the stiffness of global W&C models posed in thin spherical shells as well as to better understand the performance of reduced-precision arithmetic in the vicinity of grid singularities. Precision reduction is done on a software level, using an emulator. The reduced-precision experiments are conducted for established dynamical-core test-cases, like the Rossby-Haurwitz wave number 4 and a zonal orographic flow. The study shows that selected key components of the elliptic solver, most prominently the preconditioning, can be performed at the level of half precision.

categories: physics.comp-ph cs.CE cs.NA math.NA physics.ao-ph physics.flu-dyn


title: Quasi-potentials in the Nonequilibrium Stationary States or a method to get explicit solutions of Hamilton-Jacobi equations

abstract: We assume that a system at a mesoscopic scale is described by a field $\phi(x,t)$ that evolves by a Langevin equation with a white noise whose intensity is controlled by a parameter $1/\sqrt{\Omega}$. The system stationary state distribution in the small noise limit ($\Omega\rightarrow\infty$) is of the form $P_{st}[\phi]\simeq\exp(-\Omega V_0[\phi])$ where $V_0[\phi]$ is called the {\it quasipotential}. $V_0$ is the unknown of a Hamilton-Jacobi equation. Therefore, $V_0$ can be written as an action computed along a path that is the solution from Hamilton's equation that typically cannot be solved explicitly. This paper presents a theoretical scheme that builds a suitable canonical transformation that permits us to do such integration by deforming the original path into a straight line. We show that this can be done when a set of conditions on the canonical transformation and the model's dynamics are fulfilled. In such cases, we can get the quasipotential algebraically. We apply the scheme to several one-dimensional nonequilibrium models as the diffusive and reaction-diffusion systems.


title: Fast Synthesis for Symbolic Self-triggered Control under Right-recursive LTL Specifications

abstract: We extend previous work on symbolic self-triggered control for non-deterministic continuous-time nonlinear systems without stability assumptions to a larger class of specifications. Our goal is to synthesise a controller for two objectives: the first one is modelled as a right-recursive LTL formula, and the second one is to ensure that the average communication rate between the controller and the system stays below a given threshold. We translate the control problem to solving a mean-payoff parity game played on a discrete graph. Apart from extending the class of specifications, we propose a heuristic method to shorten the computation time. Finally, we illustrate our results on the example of a navigating nonholonomic robot with several specifications.


title: Fully automated spectroscopic ellipsometry analyses: Application to MoOx thin films

abstract: In spectroscopic ellipsometry, the optical properties of materials are obtained indirectly by generally assuming dielectric function and optical models. This ellipsometry analysis, which typically requires numerous model parameters, has essentially been performed by a try-and-error approach, making this method as a rather time-consuming characterization technique. Here, we propose a fully automated spectroscopic ellipsometry analysis method, which can be applied to obtain dielectric functions of light absorbing materials in a full measured energy range without any prior knowledge of model parameters. The developed method consists of a multiple-step grid search and the following non-linear regression analysis. Specifically, in our approach, the analyzed spectral region is gradually expanded toward higher energy while incorporating an additional optical transition peak whenever the root-mean-square error of the fitting analysis exceeds a critical value. In particular, we have established a unique algorithm that could be employed for the ellipsometry analyses of different types of optical materials. The proposed scheme has been applied successfully for the analyses of MoOx transparent oxides and the complex dielectric function of a MoOx layer that exhibits dual optical transitions due to band-edge and deep-level absorptions has been determined. The developed method can drastically reduce a time necessary for an ellipsometry analysis, eliminating a serious drawback of a traditional spectroscopic ellipsometry analysis method.


title: Generalized hypergeometric Bernoulli numbers

abstract: We introduce generalized hypergeometric Bernoulli numbers for Dirichlet characters. We study their properties, including relations, expressions and determinants. At the end in Appendix we derive first few expressions of these numbers.


title: Integration of presence-only data from several sources. A case study on dolphins' spatial distribution

abstract: Presence-only data are a typical occurrence in species distribution modeling. They include the presence locations and no information on the absence. Their modeling usually does not account for detection biases. In this work, we aim to merge three different sources of information to model the presence of marine mammals. The approach is fully general and it is applied to two species of dolphins in the Central Tyrrhenian Sea (Italy) as a case study. Data come from the Italian Environmental Protection Agency (ISPRA) and Sapienza University of Rome research campaigns, and from a careful selection of social media (SM) images and videos. We build a Log Gaussian Cox process where different detection functions describe each data source. For the SM data, we analyze several choices that allow accounting for detection biases. Our findings allow for a correct understanding of Stenella coeruleoalba and Tursiops truncatus distribution in the study area. The results prove that the proposed approach is broadly applicable, it can be widely used, and it is easily implemented in the R software using INLA and inlabru. We provide examples' code with simulated data in the supplementary materials.


title: Hamilton circuits of Cayley graphs of Weyl groupoids of generalized quantum groups

abstract: We study Hamilton circuits of the Cayley graphs of the Weyl groupoids of the generalized quantum groups, or the quantum double of the Nichols algebras of diagonal-type, with finite root systems. We prove the existence of a Hamilton circuit for any of them and explicitly draw one of them for rank 3 and 4 cases.


title: Spatial and Magnetic Confinement of Massless Dirac Fermions

abstract: The massless Dirac fermions and the ease to introduce spatial and magnetic confinement in graphene provide us unprecedented opportunity to explore confined relativistic matter in this condensed-matter system. Here we report the interplay between the confinement induced by external electric fields and magnetic fields of the massless Dirac fermions in graphene. When the magnetic length lB is larger than the characteristic length of the confined electric potential lV, the spatial confinement dominates and a relatively small critical magnetic field splits the spatial-confinement-induced atomic-like shell states by switching on a pi Berry phase of the quasiparticles. When the lB becomes smaller than the lV, the transition from spatial confinement to magnetic confinement occurs and the atomic-like shell states condense into Landau levels (LLs) of the Fock-Darwin states in graphene. Our experiment demonstrates that the spatial confinement dramatically changes the energy spacing between the LLs and generates large electron-hole asymmetry of the energy spacing between the LLs. These results shed light on puzzling observations in previous experiments, which hitherto remained unaddressed.


title: Inference of a competing risks model with partially observed failure causes under improved adaptive type-II progressive censoring

abstract: In this paper, a competing risks model is analyzed based on improved adaptive type-II progressive censored sample (IAT-II PCS). Two independent competing causes of failures are considered. It is assumed that lifetimes of the competing causes of failure follow exponential distributions with different means. Maximum likelihood estimators (MLEs) for the unknown model parameters are obtained. Using asymptotic normality property of MLE, the asymptotic confidence intervals are constructed. Existence and uniqueness properties of the MLEs are studied. Further, bootstrap confidence intervals are computed. The Bayes estimators are obtained under symmetric and asymmetric loss functions with non-informative and informative priors. For informative priors, independent gamma distributions are considered. Highest posterior density (HPD) credible intervals are obtained. A Monte Carlo simulation study is carried out to compare performance of the established estimates. Furthermore, three different optimality criteria are proposed to obtain the optimal censoring plan. Finally, a real-life data set is considered for illustrative purposes.


title: Self-Guided and Cross-Guided Learning for Few-Shot Segmentation

abstract: Few-shot segmentation has been attracting a lot of attention due to its effectiveness to segment unseen object classes with a few annotated samples. Most existing approaches use masked Global Average Pooling (GAP) to encode an annotated support image to a feature vector to facilitate query image segmentation. However, this pipeline unavoidably loses some discriminative information due to the average operation. In this paper, we propose a simple but effective self-guided learning approach, where the lost critical information is mined. Specifically, through making an initial prediction for the annotated support image, the covered and uncovered foreground regions are encoded to the primary and auxiliary support vectors using masked GAP, respectively. By aggregating both primary and auxiliary support vectors, better segmentation performances are obtained on query images. Enlightened by our self-guided module for 1-shot segmentation, we propose a cross-guided module for multiple shot segmentation, where the final mask is fused using predictions from multiple annotated samples with high-quality support vectors contributing more and vice versa. This module improves the final prediction in the inference stage without re-training. Extensive experiments show that our approach achieves new state-of-the-art performances on both PASCAL-5i and COCO-20i datasets.


title: Active Learning for Deep Object Detection via Probabilistic Modeling

abstract: Active learning aims to reduce labeling costs by selecting only the most informative samples on a dataset. Few existing works have addressed active learning for object detection. Most of these methods are based on multiple models or are straightforward extensions of classification methods, hence estimate an image's informativeness using only the classification head. In this paper, we propose a novel deep active learning approach for object detection. Our approach relies on mixture density networks that estimate a probabilistic distribution for each localization and classification head's output. We explicitly estimate the aleatoric and epistemic uncertainty in a single forward pass of a single model. Our method uses a scoring function that aggregates these two types of uncertainties for both heads to obtain every image's informativeness score. We demonstrate the efficacy of our approach in PASCAL VOC and MS-COCO datasets. Our approach outperforms single-model based methods and performs on par with multi-model based methods at a fraction of the computing cost.


title: Unitary Harish-Chandra representations of real supergroups

abstract: We give conditions for unitarizability of Harish-Chandra super modules for Lie supergroups and superalgebras.


title: Dichotomy of Electron-Phonon Coupling in Graphene Moir\'e Flat Bands

abstract: Graphene moire superlattices are outstanding platforms to study correlated electron physics and superconductivity with exceptional tunability. However, robust superconductivity has been measured only in magic-angle twisted bilayer graphene (MA-TBG) and magic-angle twisted trilayer graphene (MA-TTG). The absence of a superconducting phase in certain moire flat bands raises a question on the superconducting mechanism. In this work, we investigate electronic structure and electron-phonon coupling in graphene moire superlattices based on atomistic calculations. We show that electron-phonon coupling strength lambda is dramatically different among graphene moire flat bands. The total strength lambda is very large (lambda>1) for MA-TBG and MA-TTG, both of which display robust superconductivity in experiments. However, lambda is an order of magnitude smaller in twisted double bilayer graphene (TDBG) and twisted monolayer-bilayer graphene (TMBG) where superconductivity is reportedly rather weak or absent. We find that the Bernal-stacked layers in TDBG and TMBG induce sublattice polarization in the flat-band states, suppressing intersublattice electron-phonon matrix elements. We also obtain the nonadiabatic superconducting Tc that matches well with the experimental results. Our results clearly show a correlation between strong electron-phonon coupling and experimental observations of robust superconductivity.


title: An extension of a theorem of Bers and Finn on the removability of isolated singularities to the Euler-Lagrange equations related to general linear growth problems

abstract: A famous theorem of Bers and Finn states that isolated singularities of solutions to the non-parametric minimal surface equation are removable. We show that this result remains valid, if the area functional is replaced by a general functional of linear growth depending on the modulus of the gradient. We emphasize that Serrin ([1]) in fact proved the removability of singularities on sets of $(n-1)$-dimensional Hausdorff measure zero in an even more general setting. Our main interest is to generalize the comparison principles as outlined, for instance, in Section 10 of [2] without having the particular geometric structure of minimal surfaces. It turns out that generalized catenoids serve as an appropriate tool for proving our results.


title: On the bad points of positive semidefinite polynomials

abstract: A bad point of a positive semidefinite real polynomial f is a point at which a pole appears in all expressions of f as a sum of squares of rational functions. We show that quartic polynomials in three variables never have bad points. We give examples of positive semidefinite polynomials with a bad point at the origin, that are nevertheless sums of squares of formal power series, answering a question of Brumfiel. We also give an example of a positive semidefinite polynomial in three variables with a complex bad point that is not real, answering a question of Scheiderer.


title: KIDS density functional for deformed nuclei: Examples of the even-even Nd isotopes

abstract: Background: A global description of the ground-state properties of nuclei in a wide mass range in a unified manner is desirable not only for understanding exotic nuclei but for providing nuclear data for applications. Purpose: We demonstrate the KIDS functional describes the ground states appropriately with respect to the existing data and predictions for a possible application of the functional to all the nuclei by taking Nd isotopes as examples. Method: The Kohn-Sham-Bogoliubov equation is solved for the Nd isotopes with the neutron numbers ranging from 60 to 160 by employing the KIDS functionals constructed to satisfy both neutron-matter equation of state or neutron star observation and selected nuclear data. Results: Considering the nuclear deformation improves the description of the binding energies and radii. We find that the discrepancy from the experimental data is more significant for neutron-rich/deficient isotopes and this can be made isotope independent by changing the slope parameter of the symmetry energy. Conclusions: The KIDS functional is applied to the mid-shell nuclei for the first time. The onset and evolution of deformation are nicely described for the Nd isotopes. The KIDS functional is competent to a global fitting for a better description of nuclear properties in the nuclear chart.


title: Thermal annealing enhancement of Josephson critical currents in ferromagnetic CoFeB

abstract: The electrical and structural properties of Co40Fe40B20 (CoFeB) alloy are tunable with thermal annealing. This is key in the optimization of CoFeB-based spintronic devices, where the advantageously low magnetic coercivity, high spin polarization, and controllable magnetocrystalline anisotropy are utilised. So far, there has been no report on superconducting devices based on CoFeB. Here, we report Nb/CoFeB/Nb Josephson devices and demonstrate an enhancement of the critical current by up to 700% following thermal annealing due to increased structural ordering of the CoFeB. The results demonstrate that CoFeB is a promising material for the development of superconducting spintronic devices.


title: Impact of Local Energy Markets on the Distribution Systems: A Comprehensive Review

abstract: In recent years extensive research has been conducted on the development of different models that enable energy trading between prosumers and consumers due to expected high integration of distributed energy resources. Some of the most researched mechanisms include Peer-to-Peer energy trading, Community Self-Consumption and Transactive Energy Models. Here, we present an exhaustive review of existing research around Local Energy Market integration into distribution systems, in particular benefits and challenges that the power grid can expect from integrating these models. We also present a detailed overview of methods that are used to integrate physical network constraints into the market mechanisms, their advantages, drawbacks, and scaling potential. We find that financial energy transactions do not directly reflect the physical energy flows imposed by the constraints of the installed electrical infrastructure. Therefore, ensuring the stable and reliable delivery of electricity, it is vital to understand the impact of these transactions on the grid infrastructure, e.g., impacts on the control, operation, and planning of electricity distribution systems.


title: Free-space Realization of Tunable Pin-like Optical Vortex Beams

abstract: We demonstrate, both analytically and experimentally, free-space pin-like optical vortex beams (POVBs).Such angular-momentum-carrying beams feature tunable peak intensity and undergo robust anti-diffracting propagation, realized by judiciously modulating both the amplitude and the phase profile of a standard laser beam. Specifically, they are generated by superimposing a radially-symmetric power-law phase on a helical phase structure, which allows the inclusion of an orbital angular momentum term to the POVBs. During propagation in free-space, these POVBs initially exhibit autofocusing dynamics, and subsequently, their amplitude patterns morph into a high-order Bessel-like profile characterized by a hollow-core and an annular main-lobe with a constant or tunable width during propagation. In contrast with numerous previous endeavors on Bessel beams, our work represents the first demonstration of long-distance free-space generation of optical vortex 'pins', with their peak intensity evolution controlled by the impressed amplitude structure. Both the Poynting vectors and the optical radiation forces associated with these beams are also numerically analyzed, revealing novel properties that may be useful for a wide range of applications.


title: Enabling Homomorphically Encrypted Inference for Large DNN Models

abstract: The proliferation of machine learning services in the last few years has raised data privacy concerns. Homomorphic encryption (HE) enables inference using encrypted data but it incurs 100x-10,000x memory and runtime overheads. Secure deep neural network (DNN) inference using HE is currently limited by computing and memory resources, with frameworks requiring hundreds of gigabytes of DRAM to evaluate small models. To overcome these limitations, in this paper we explore the feasibility of leveraging hybrid memory systems comprised of DRAM and persistent memory. In particular, we explore the recently-released Intel Optane PMem technology and the Intel HE-Transformer nGraph to run large neural networks such as MobileNetV2 (in its largest variant) and ResNet-50 for the first time in the literature. We present an in-depth analysis of the efficiency of the executions with different hardware and software configurations. Our results conclude that DNN inference using HE incurs on friendly access patterns for this memory configuration, yielding efficient executions.


title: Fano 4-folds having a prime divisor of Picard number 1

abstract: We give a complete classification of smooth, complex projective Fano 4-folds of Picard number 3 having a prime divisor of Picard number 1. They form 28 distinct families, and we compute the main numerical invariants, study the base locus of the anticanonical divisor, and give a comment on rationality. Furthermore, we give an upper bound of both the dimension of the automorphism group and the dimension of the base of the Kuranishi family of a general member.


title: Structured Inverted-File k-Means Clustering for High-Dimensional Sparse Data

abstract: This paper presents an architecture-friendly k-means clustering algorithm called SIVF for a large-scale and high-dimensional sparse data set. Algorithm efficiency on time is often measured by the number of costly operations such as similarity calculations. In practice, however, it depends greatly on how the algorithm adapts to an architecture of the computer system which it is executed on. Our proposed SIVF employs invariant centroid-pair based filter (ICP) to decrease the number of similarity calculations between a data object and centroids of all the clusters. To maximize the ICP performance, SIVF exploits for a centroid set an inverted-file that is structured so as to reduce pipeline hazards. We demonstrate in our experiments on real large-scale document data sets that SIVF operates at higher speed and with lower memory consumption than existing algorithms. Our performance analysis reveals that SIVF achieves the higher speed by suppressing performance degradation factors of the number of cache misses and branch mispredictions rather than less similarity calculations.


title: Symbiotic Communications: Where Marconi Meets Darwin

abstract: With the proliferation of wireless applications, the electromagnetic (EM) space is becoming more and more crowded and complex. This makes it a challenging task to accommodate the growing number of radio systems with limited radio resources. In this paper, by considering the EM space as a radio ecosystem, and leveraging the analogy to the natural ecosystem in biology, a novel symbiotic communication (SC) paradigm is proposed through which the relevant radio systems, called symbiotic radios (SRs), in a radio ecosystem form a symbiotic relationship (e.g., mutualistic symbiosis) through intelligent resource/service exchange. Radio resources include, e.g., spectrum, energy, and infrastructure, while typical radio services are communicating, relaying, and computing. The symbiotic relationship can be realized via either symbiotic coevolution or symbiotic synthesis. In symbiotic coevolution, each SR is empowered with an evolutionary cycle alongside the multi-agent learning, while in symbiotic synthesis, the SRs ingeniously optimize their operating parameters and transmission protocols by solving a multi-objective optimization problem. Promisingly, the proposed SC paradigm breaks the boundary of radio systems, thus providing us a fresh perspective on radio resource management and new guidelines to design future wireless communication systems.


title: Analysis and Correlation of Visual Evidence in Campaigns of Malicious Office Documents

abstract: Many malware campaigns use Microsoft (MS) Office documents as droppers to download and execute their malicious payload. Such campaigns often use these documents because MS Office is installed in billions of devices and that these files allow the execution of arbitrary VBA code. Recent versions of MS Office prevent the automatic execution of VBA macros, so malware authors try to convince users into enabling the content via images that, e.g. forge system or technical errors. In this work, we leverage these visual elements to construct lightweight malware signatures that can be applied with minimal effort. We test and validate our approach using an extensive database of malware samples and identify correlations between different campaigns that illustrate that some campaigns are either using the same tools or that there is some collaboration between them.


title: The JCMT BISTRO Survey: The Distribution of Magnetic Field Strengths towards the OMC-1 Region

abstract: Measurement of magnetic field strengths in a molecular cloud is essential for determining the criticality of magnetic support against gravitational collapse. In this paper, as part of the JCMT BISTRO survey, we suggest a new application of the Davis-Chandrasekhar-Fermi (DCF) method to estimate the distribution of magnetic field strengths in the OMC-1 region. We use observations of dust polarization emission at 450 $\mu$m and 850 $\mu$m, and C$^{18}$O (3-2) spectral line data obtained with the JCMT. We estimate the volume density, the velocity dispersion and the polarization angle dispersion in a box, 40$''$ $\times$ 40$''$ (5$\times$5 pixels), which moves over the OMC-1 region. By substituting three quantities in each box to the DCF method, we get magnetic field strengths over the OMC-1 region. We note that there are very large uncertainties in inferred field strengths, as discussed in detail in this paper. The field strengths vary from 0.8 to 26.4 mG and their mean value is about 6 mG. Additionally, we obtain maps of the mass-to-flux ratio in units of a critical value and the Alfv$\acute{e}$n mach number. The central parts of the BN-KL and South (S) clumps in the OMC-1 region are magnetically supercritical, so the magnetic field cannot support the clumps against gravitational collapse. However, the outer parts of the region are magnetically subcritical. The mean Alfv$\acute{e}$n mach number is about 0.4 over the region, which implies that the magnetic pressure exceeds the turbulent pressure in the OMC 1 region.


title: Generic instability of the dynamics underlying the Belinski-Khalatnikov-Lifshitz scenario

abstract: A class of exact solutions to the Belinski-Khalatnikov-Lifshitz (BKL) scenario is derived and tested for their stability against small perturbations. These are the only regular solutions in the Painlev\'{e} sense. We prove that they are unstable in the vicinity of the cosmological singularity. Regularity of the dynamics is also examined with the dynamical systems method. Our results confirm the conjecture of BKL that the dynamics near the singularity becomes generically chaotic.


title: Diagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translation

abstract: One of the important research topics in image generative models is to disentangle the spatial contents and styles for their separate control. Although StyleGAN can generate content feature vectors from random noises, the resulting spatial content control is primarily intended for minor spatial variations, and the disentanglement of global content and styles is by no means complete. Inspired by a mathematical understanding of normalization and attention, here we present a novel hierarchical adaptive Diagonal spatial ATtention (DAT) layers to separately manipulate the spatial contents from styles in a hierarchical manner. Using DAT and AdaIN, our method enables coarse-to-fine level disentanglement of spatial contents and styles. In addition, our generator can be easily integrated into the GAN inversion framework so that the content and style of translated images from multi-domain image translation tasks can be flexibly controlled. By using various datasets, we confirm that the proposed method not only outperforms the existing models in disentanglement scores, but also provides more flexible control over spatial features in the generated images.


title: Topological phenomena demonstrated in photorefractive photonic lattices

abstract: Topological photonics has attracted widespread research attention in the past decade due to its fundamental interest and unique manner in controlling light propagation for advanced applications. Paradigmatic approaches have been proposed to achieve topological phases including topological insulators in a variety of photonic systems. In particular, photonic lattices composed of evanescently coupled waveguide arrays have been employed conveniently to explore and investigate topological physics. In this article, we review our recent work on demonstration of topological phenomena in reconfigurable photonic lattices established by site-to-site cw-laser-writing or multiple-beam optical induction in photorefractive nonlinear crystals. We focus on the study of topological states realized in the celebrated one-dimensional Su-Schrieffer-Heeger lattices, including nonlinear topological edge states and gap solitons, nonlinearity-induced coupling to topological edge states, and nonlinear control of non-Hermitian topological states. In the two-dimensional case, we discuss two typical examples: universal mapping of momentum-space topological singularities through Dirac-like photonic lattices and realization of real-space nontrivial loop states in flatband photonic lattices. Our work illustrates how photorefractive materials can be employed conveniently to build up various synthetic photonic microstructures for topological studies, which may prove relevant and inspiring for exploration of fundamental phenomena in topological systems beyond photonics.


title: Class-Aware Robust Adversarial Training for Object Detection

abstract: Object detection is an important computer vision task with plenty of real-world applications; therefore, how to enhance its robustness against adversarial attacks has emerged as a crucial issue. However, most of the previous defense methods focused on the classification task and had few analysis in the context of the object detection task. In this work, to address the issue, we present a novel class-aware robust adversarial training paradigm for the object detection task. For a given image, the proposed approach generates an universal adversarial perturbation to simultaneously attack all the occurred objects in the image through jointly maximizing the respective loss for each object. Meanwhile, instead of normalizing the total loss with the number of objects, the proposed approach decomposes the total loss into class-wise losses and normalizes each class loss using the number of objects for the class. The adversarial training based on the class weighted loss can not only balances the influence of each class but also effectively and evenly improves the adversarial robustness of trained models for all the object classes as compared with the previous defense methods. Furthermore, with the recent development of fast adversarial training, we provide a fast version of the proposed algorithm which can be trained faster than the traditional adversarial training while keeping comparable performance. With extensive experiments on the challenging PASCAL-VOC and MS-COCO datasets, the evaluation results demonstrate that the proposed defense methods can effectively enhance the robustness of the object detection models.


title: Time-domain Speech Enhancement with Generative Adversarial Learning

abstract: Speech enhancement aims to obtain speech signals with high intelligibility and quality from noisy speech. Recent work has demonstrated the excellent performance of time-domain deep learning methods, such as Conv-TasNet. However, these methods can be degraded by the arbitrary scales of the waveform induced by the scale-invariant signal-to-noise ratio (SI-SNR) loss. This paper proposes a new framework called Time-domain Speech Enhancement Generative Adversarial Network (TSEGAN), which is an extension of the generative adversarial network (GAN) in time-domain with metric evaluation to mitigate the scaling problem, and provide model training stability, thus achieving performance improvement. In addition, we provide a new method based on objective function mapping for the theoretical analysis of the performance of Metric GAN, and explain why it is better than the Wasserstein GAN. Experiments conducted demonstrate the effectiveness of our proposed method, and illustrate the advantage of Metric GAN.


title: FONTNET: On-Device Font Understanding and Prediction Pipeline

abstract: Fonts are one of the most basic and core design concepts. Numerous use cases can benefit from an in depth understanding of Fonts such as Text Customization which can change text in an image while maintaining the Font attributes like style, color, size. Currently, Text recognition solutions can group recognized text based on line breaks or paragraph breaks, if the Font attributes are known multiple text blocks can be combined based on context in a meaningful manner. In this paper, we propose two engines: Font Detection Engine, which identifies the font style, color and size attributes of text in an image and a Font Prediction Engine, which predicts similar fonts for a query font. Major contributions of this paper are three-fold: First, we developed a novel CNN architecture for identifying font style of text in images. Second, we designed a novel algorithm for predicting similar fonts for a given query font. Third, we have optimized and deployed the entire engine On-Device which ensures privacy and improves latency in real time applications such as instant messaging. We achieve a worst case On-Device inference time of 30ms and a model size of 4.5MB for both the engines.


title: Adversarially learned iterative reconstruction for imaging inverse problems

abstract: In numerous practical applications, especially in medical image reconstruction, it is often infeasible to obtain a large ensemble of ground-truth/measurement pairs for supervised learning. Therefore, it is imperative to develop unsupervised learning protocols that are competitive with supervised approaches in performance. Motivated by the maximum-likelihood principle, we propose an unsupervised learning framework for solving ill-posed inverse problems. Instead of seeking pixel-wise proximity between the reconstructed and the ground-truth images, the proposed approach learns an iterative reconstruction network whose output matches the ground-truth in distribution. Considering tomographic reconstruction as an application, we demonstrate that the proposed unsupervised approach not only performs on par with its supervised variant in terms of objective quality measures but also successfully circumvents the issue of over-smoothing that supervised approaches tend to suffer from. The improvement in reconstruction quality comes at the expense of higher training complexity, but, once trained, the reconstruction time remains the same as its supervised counterpart.


title: Singular Limit of Two Scale Stochastic Optimal Control Problems in Infinite Dimensions by Vanishing Noise Regularization

abstract: In this paper we study the limit of the value function for a two-scale, infinite-dimensional, stochastic controlled system with cylindrical noise and possibly degenerate diffusion. The limit is represented as the value function of a new reduced control problem (on a reduced state space). The presence of a cylindrical noise prevents representation of the limit by viscosity solutions of HJB equations, while degeneracy of diffusion coefficients prevents representation as a classical BSDE. We use a vanishing noise regularization technique.


title: Remote Virtual Showdown: A Collaborative Virtual Reality Game for People with Visual Impairments

abstract: Many researchers have developed VR systems for people with visual impairments by using various audio feedback techniques. However, there has been much less study of collaborative VR systems in which people with visual impairments and people with able-body can participate together. Therefore, we developed a VR showdown game which is similar to a real Showdown game in which two players can play together in the same virtual environment. We incorporate auditory distance perception using the HRTF (Head Related Transform Function) based on a spatial position in VR. We developed two modes in the showdown game. One is the PVA (Player vs. Agent) mode in which people with visual impairments can play alone and the PVP (Player vs. Player) mode in which people with visual impairments can play with another player in the network environment. We conducted our user studies by comparing the performances of people with visual impairments and people with able-body. The user study results show that people with visual impairments won 67.6% of the games when competing against people with able-body. This paper reports an example of a collaborative VR system for people with visual impairments and also design guideline for developing VR systems for people with visual impairments.


title: Convergence on a symmetric accelerated stochastic ADMM with larger stepsizes

abstract: In this paper, we develop a symmetric accelerated stochastic Alternating Direction Method of Multipliers (SAS-ADMM) for solving separable convex optimization problems with linear constraints. The objective function is the sum of a possibly nonsmooth convex function and an average function of many smooth convex functions. Our proposed algorithm combines both ideas of ADMM and the techniques of accelerated stochastic gradient methods possibly with variance reduction to solve the smooth subproblem. One main feature of SAS-ADMM is that its dual variable is symmetrically updated after each update of the separated primal variable, which would allow a more flexible and larger convergence region of the dual variable compared with that of standard deter-ministic or stochastic ADMM. This new stochastic optimization algorithm is shown to have ergodic converge in expectation with O(1/T) convergence rate, where T is the number of outer iterations. Our preliminary experiments indicate the proposed algorithm is very effective for solving separable optimization problems from big-data applications. Finally, 3-block extensions of the algorithm and its variant of an accelerated stochastic augmented Lagrangian method are discussed in the appendix.


title: Weakly Supervised Temporal Action Localization Through Learning Explicit Subspaces for Action and Context

abstract: Weakly-supervised Temporal Action Localization (WS-TAL) methods learn to localize temporal starts and ends of action instances in a video under only video-level supervision. Existing WS-TAL methods rely on deep features learned for action recognition. However, due to the mismatch between classification and localization, these features cannot distinguish the frequently co-occurring contextual background, i.e., the context, and the actual action instances. We term this challenge action-context confusion, and it will adversely affect the action localization accuracy. To address this challenge, we introduce a framework that learns two feature subspaces respectively for actions and their context. By explicitly accounting for action visual elements, the action instances can be localized more precisely without the distraction from the context. To facilitate the learning of these two feature subspaces with only video-level categorical labels, we leverage the predictions from both spatial and temporal streams for snippets grouping. In addition, an unsupervised learning task is introduced to make the proposed module focus on mining temporal information. The proposed approach outperforms state-of-the-art WS-TAL methods on three benchmarks, i.e., THUMOS14, ActivityNet v1.2 and v1.3 datasets.


title: Uniform Envelopes

abstract: In the author's PhD thesis (2019) universal envelopes were introduced as a tool for studying the continuously obtainable information on discontinuous functions. To any function $f \colon X \to Y$ between $\operatorname{qcb}_0$-spaces one can assign a so-called universal envelope which, in a well-defined sense, encodes all continuously obtainable information on the function. A universal envelope consists of two continuous functions $F \colon X \to L$ and $\xi_L \colon Y \to L$ with values in a $\Sigma$-split injective space $L$. Any continuous function with values in an injective space whose composition with the original function is again continuous factors through the universal envelope. However, it is not possible in general to uniformly compute this factorisation. In this paper we propose the notion of uniform envelopes. A uniform envelope is additionally endowed with a map $u_L \colon L \to \mathcal{O}^2(Y)$ that is compatible with the multiplication of the double powerspace monad $\mathcal{O}^2$ in a certain sense. This yields for every continuous map with values in an injective space a choice of uniformly computable extension. Under a suitable condition which we call uniform universality, this extension yields a uniformly computable solution for the above factorisation problem. Uniform envelopes can be endowed with a composition operation. We establish criteria that ensure that the composition of two uniformly universal envelopes is again uniformly universal. These criteria admit a partial converse and we provide evidence that they cannot be easily improved in general. Not every function admits a uniformly universal uniform envelope. We can however assign to every function a canonical envelope that is in some sense as close as possible to a uniform envelope. We obtain a composition theorem similar to the uniform case.