title: Attention-based Multi-hypothesis Fusion for Speech Summarization

abstract: Speech summarization, which generates a text summary from speech, can be achieved by combining automatic speech recognition (ASR) and text summarization (TS). With this cascade approach, we can exploit state-of-the-art models and large training datasets for both subtasks, i.e., Transformer for ASR and Bidirectional Encoder Representations from Transformers (BERT) for TS. However, ASR errors directly affect the quality of the output summary in the cascade approach. We propose a cascade speech summarization model that is robust to ASR errors and that exploits multiple hypotheses generated by ASR to attenuate the effect of ASR errors on the summary. We investigate several schemes to combine ASR hypotheses. First, we propose using the sum of sub-word embedding vectors weighted by their posterior values provided by an ASR system as an input to a BERT-based TS system. Then, we introduce a more general scheme that uses an attention-based fusion module added to a pre-trained BERT module to align and combine several ASR hypotheses. Finally, we perform speech summarization experiments on the How2 dataset and a newly assembled TED-based dataset that we will release with this paper. These experiments show that retraining the BERT-based TS system with these schemes can improve summarization performance and that the attention-based fusion module is particularly effective.


title: Learn Locally, Correct Globally: A Distributed Algorithm for Training Graph Neural Networks

abstract: Despite the recent success of Graph Neural Networks (GNNs), training GNNs on large graphs remains challenging. The limited resource capacities of the existing servers, the dependency between nodes in a graph, and the privacy concern due to the centralized storage and model learning have spurred the need to design an effective distributed algorithm for GNN training. However, existing distributed GNN training methods impose either excessive communication costs or large memory overheads that hinders their scalability. To overcome these issues, we propose a communication-efficient distributed GNN training technique named $\text{{Learn Locally, Correct Globally}}$ (LLCG). To reduce the communication and memory overhead, each local machine in LLCG first trains a GNN on its local data by ignoring the dependency between nodes among different machines, then sends the locally trained model to the server for periodic model averaging. However, ignoring node dependency could result in significant performance degradation. To solve the performance degradation, we propose to apply $\text{{Global Server Corrections}}$ on the server to refine the locally learned models. We rigorously analyze the convergence of distributed methods with periodic model averaging for training GNNs and show that naively applying periodic model averaging but ignoring the dependency between nodes will suffer from an irreducible residual error. However, this residual error can be eliminated by utilizing the proposed global corrections to entail fast convergence rate. Extensive experiments on real-world datasets show that LLCG can significantly improve the efficiency without hurting the performance.


title: Is CADP an Applicable Formal Method?

abstract: CADP is a comprehensive toolbox implementing results of concurrency theory. This paper addresses the question, whether CADP qualifies as an applicable formal method, based on the experience of the authors and feedback reported by users.


title: Developing a Prototype of a Mechanical Ventilator Controller from Requirements to Code with ASMETA

abstract: Rigorous development processes aim to be effective in developing critical systems, especially if failures can have catastrophic consequences for humans and the environment. Such processes generally rely on formal methods, which can guarantee, thanks to their mathematical foundation, model preciseness, and properties assurance. However, they are rarely adopted in practice. In this paper, we report our experience in using the Abstract State Machine formal method and the ASMETA framework in developing a prototype of the control software of the MVM (Mechanical Ventilator Milano), a mechanical lung ventilator that has been designed, successfully certified, and deployed during the COVID-19 pandemic. Due to time constraints and lack of skills, no formal method was applied for the MVM project. However, we here want to assess the feasibility of developing (part of) the ventilator by using a formal method-based approach. Our development process starts from a high-level formal specification of the system to describe the MVM main operation modes. Then, through a sequence of refined models, all the other requirements are captured, up to a level in which a C++ implementation of a prototype of the MVM controller is automatically generated from the model, and tested. Along the process, at each refinement level, different model validation and verification activities are performed, and each refined model is proved to be a correct refinement of the previous level. By means of the MVM case study, we evaluate the effectiveness and usability of our formal approach.


title: A Maude Implementation of Rewritable Petri Nets: a Feasible Model for Dynamically Reconfigurable Systems

abstract: Petri Nets (PN) are a central, theoretically sound model for concurrent or distributed systems but, at least in their classical definition, not expressive enough to represent dynamic reconfiguration capabilities. On the other side, Rewriting Logic has proved to be a natural semantic framework for several formal models of concurrent/distributed systems. We propose a compact, efficient Maude formalization of dynamically reconfigurable PT nets (with inhibitor arcs), using as a running example the specification of a simple, fault-tolerant manufacturing system. We discuss the advantages of such a combined approach, as well as some concerns that it raises.


title: JMSNAS: Joint Model Split and Neural Architecture Search for Learning over Mobile Edge Networks

abstract: The main challenge to deploy deep neural network (DNN) over a mobile edge network is how to split the DNN model so as to match the network architecture as well as all the nodes' computation and communication capacity. This essentially involves two highly coupled procedures: model generating and model splitting. In this paper, a joint model split and neural architecture search (JMSNAS) framework is proposed to automatically generate and deploy a DNN model over a mobile edge network. Considering both the computing and communication resource constraints, a computational graph search problem is formulated to find the multi-split points of the DNN model, and then the model is trained to meet some accuracy requirements. Moreover, the trade-off between model accuracy and completion latency is achieved through the proper design of the objective function. The experiment results confirm the superiority of the proposed framework over the state-of-the-art split machine learning design methods.


title: F-IDEs with Features and VCs Designed to Assist Human Reasoning When Verification Fails

abstract: This paper summarizes our efforts to aid human reasoning when verification fails through the use of two distinct Formalization Integrated Development Environments (F-IDEs) that we have developed. Both environments are modular and facilitate reasoning about the full behavior of object-based code. The first environment, referred to as the web-IDE, has been used for several years to teach aspects of formal specification and verification, including why and where verification conditions (VCs) arise and how to use them when verification fails. The second F-IDE, RESOLVE Studio, remains experimental, but is a more fully-fledged environment backed by a sequent-based VC generator that produces VCs with fewer extraneous givens. While the environments and VC generation techniques are necessarily language specific, the principles of alternative VC generation methods, F-IDE features, and observations about their impact on novices and experienced users are more generally applicable.


title: Experience Report: Teaching Code Analysis and Verification Using Frama-C

abstract: Formal methods provide systematic and rigorous techniques for software development. We strongly believe that they must be taught in computer science curricula. In this paper we present the pedagogic rationale and the concrete implementation of two courses on the use of formal methods, sharing some material. These courses promote the usage of formal verification to ensure safety and security of software, exemplified in the domain of the Internet of Things.


title: Exploring Usable Security to Improve the Impact of Formal Verification: A Research Agenda

abstract: As software becomes more complex and assumes an even greater role in our lives, formal verification is set to become the gold standard in securing software systems into the future, since it can guarantee the absence of errors and entire classes of attack. Recent advances in formal verification are being used to secure everything from unmanned drones to the internet. At the same time, the usable security research community has made huge progress in improving the usability of security products and end-users comprehension of security issues. However, there have been no human-centered studies focused on the impact of formal verification on the use and adoption of formally verified software products. We propose a research agenda to fill this gap and to contribute with the first collection of studies on people's mental models on formal verification and associated security and privacy guarantees and threats. The proposed research has the potential to increase the adoption of more secure products and it can be directly used by the security and formal methods communities to create more effective and secure software tools.


title: Meeting Summarization with Pre-training and Clustering Methods

abstract: Automatic meeting summarization is becoming increasingly popular these days. The ability to automatically summarize meetings and to extract key information could greatly increase the efficiency of our work and life. In this paper, we experiment with different approaches to improve the performance of query-based meeting summarization. We started with HMNet\cite{hmnet}, a hierarchical network that employs both a word-level transformer and a turn-level transformer, as the baseline. We explore the effectiveness of pre-training the model with a large news-summarization dataset. We investigate adding the embeddings of queries as a part of the input vectors for query-based summarization. Furthermore, we experiment with extending the locate-then-summarize approach of QMSum\cite{qmsum} with an intermediate clustering step. Lastly, we compare the performance of our baseline models with BART, a state-of-the-art language model that is effective for summarization. We achieved improved performance by adding query embeddings to the input of the model, by using BART as an alternative language model, and by using clustering methods to extract key information at utterance level before feeding the text into summarization models.


title: FedCG: Leverage Conditional GAN for Protecting Privacy and Maintaining Competitive Performance in Federated Learning

abstract: Federated learning (FL) aims to protect data privacy by enabling clients to build machine learning models collaboratively without sharing their private data. Recent works demonstrate that information exchanged during FL is subject to gradient-based privacy attacks and, consequently, a variety of privacy-preserving methods have been adopted to thwart such attacks. However, these defensive methods either introduce orders of magnitudes more computational and communication overheads (e.g., with homomorphic encryption) or incur substantial model performance losses in terms of prediction accuracy (e.g., with differential privacy). In this work, we propose $\textsc{FedCG}$, a novel federated learning method that leverages conditional generative adversarial networks to achieve high-level privacy protection while still maintaining competitive model performance. $\textsc{FedCG}$ decomposes each client's local network into a private extractor and a public classifier and keeps the extractor local to protect privacy. Instead of exposing extractors, $\textsc{FedCG}$ shares clients' generators with the server for aggregating clients' shared knowledge aiming to enhance the performance of each client's local networks. Extensive experiments demonstrate that $\textsc{FedCG}$ can achieve competitive model performance compared with FL baselines, and privacy analysis shows that $\textsc{FedCG}$ has a high-level privacy-preserving capability.


title: Higher topological type semiclassical states for fractional nonlinear elliptic equations

abstract: In this paper, we are concerned with semiclassical states to the following fractional nonlinear elliptic equation, \begin{align*} \eps^{2s}(-\Delta)^s u + V(x) u=\mathcal{N}(|u|)u \quad \mbox{in} \,\,\, \R^N, \end{align*} where $0<s <1$, $\eps>0$ is a small parameter, $N>2s$, $V \in C^1(\R^N, \R^+)$ and $\mathcal{N}\in C(\R, \R)$. The nonlinearity has Sobolev subcritical, critical or supercritical growth. The fractional Laplacian $(-\Delta)^s$ is characterized as $\mathcal{F}((-\Delta)^{s}u)(\xi)=|\xi|^{2s} \mathcal{F}(u)(\xi)$ for $\xi \in \R^N$, where $\mathcal{F}$ denotes the Fourier transform. We construct positive semiclassical states and an infinite sequence of sign-changing semiclassical states with higher energies clustering near the local minimum points of the potential $V$. The solutions are of higher topological type, which are obtained from a minimax characterization of higher dimensional symmetric linking structure via the symmetric mountain pass theorem. They correspond to critical points of the underlying energy functional at energy levels where compactness condition breaks down. The proofs are mainly based on penalization methods, s-harmonic extension theories and blow-up arguments along with local type Pohozaev identities.


title: Non-Hermitian skin effect and delocalized edge states in photonic crystals with anomalous parity-time symmetry

abstract: Non-Hermitian skin effect denotes the exponential localization of a large number of eigen-states in a non-Hermitian lattice under open boundary conditions. Such a non-Hermiticity-induced skin effect can offset the penetration depth of in-gap edge states, leading to counterintuitive delocalized edge modes, which have not been studied in a realistic photonic system such as photonic crystals. Here, we analytically reveal the non-Hermitian skin effect and the delocalized edge states in Maxwell's equations for non-Hermitian chiral photonic crystals with anomalous parity-time symmetry. Remarkably, we rigorously prove that the penetration depth of the edge states is inversely proportional to the frequency and the real part of the chirality. Our findings pave a way towards exploring novel non-Hermitian phenomena and applications in continuous Maxwell's equations.


title: Exploring Augmented Reality Games in Accessible Learning: A Systematic Review

abstract: Augmented Reality (AR) learning games, on average, have been shown to have a positive impact on student learning. However, the exploration of AR learning games in special education settings, where accessibility is a concern, has not been well explored. Thus, the purpose of this study is to explore the use of AR games in accessible learning applications and to provide a comprehensive understanding of its advantages over traditional learning approaches. In this paper, we present our systematic review of previous studies included in major databases in the past decade. We explored the characteristics of user evaluation, learning effects on students, and features of implemented systems mentioned in the literature. The results showed that AR game applications can promote students learning activities from three perspectives: cognitive, affective, and retention. We also found there were still several drawbacks to current AR learning game designs for special needs despite the positive effects associated with AR game use. Based on our findings, we propose potential design strategies for future AR learning games for accessible education.


title: Determination of the modular Jacobian varieties $J_1(M,MN)$ with the Mordell-Weil rank zero

abstract: In this paper, we determine all modular Jacobian varieties $J_1(M,MN)$ over the number field $\mathbb{Q}(\zeta_M)$ with the Mordell-Weil rank zero following the method of Derickx, Etropolski, van Hoeij, Morrow, and Zureick-Brown.


title: Second-order statistics of fermionic Gaussian states

abstract: We study the statistical behavior of entanglement in quantum bipartite systems over fermionic Gaussian states as measured by von Neumann entropy and entanglement capacity. The focus is on the variance of von Neumann entropy and the mean entanglement capacity that belong to the so-defined second-order statistics. The main results are the exact yet explicit formulas of the two considered second-order statistics for fixed subsystem dimension differences. We also conjecture the exact variance of von Neumann entropy valid for arbitrary subsystem dimensions. Based on the obtained results, we analytically study the numerically observed phenomena of Gaussianity of von Neumann entropy and linear growth of average capacity.

categories: math-ph cs.IT hep-th math.IT math.MP quant-ph


title: NatiDroid: Cross-Language Android Permission Specification

abstract: The Android system manages access to sensitive APIs by permission enforcement. An application (app) must declare proper permissions before invoking specific Android APIs. However, there is no official documentation providing the complete list of permission-protected APIs and the corresponding permissions to date. Researchers have spent significant efforts extracting such API protection mapping from the Android API framework, which leverages static code analysis to determine if specific permissions are required before accessing an API. Nevertheless, none of them has attempted to analyze the protection mapping in the native library (i.e., code written in C and C++), an essential component of the Android framework that handles communication with the lower-level hardware, such as cameras and sensors. While the protection mapping can be utilized to detect various security vulnerabilities in Android apps, such as permission over-privilege and component hijacking, imprecise mapping will lead to false results in detecting such security vulnerabilities. To fill this gap, we develop a prototype system, named NatiDroid, to facilitate the cross-language static analysis to benchmark against two state-of-the-art tools, termed Axplorer and Arcade. We evaluate NatiDroid on more than 11,000 Android apps, including system apps from custom Android ROMs and third-party apps from the Google Play. Our NatiDroid can identify up to 464 new API-permission mappings, in contrast to the worst-case results derived from both Axplorer and Arcade, where approximately 71% apps have at least one false positive in permission over-privilege and up to 3.6% apps have at least one false negative in component hijacking. Additionally, we identify that 24 components with at least one Native-triggered component hijacking vulnerability are misidentified by two benchmarks.


title: The tightest knot is not necessarily the smallest

abstract: In this note, we attempt to find counterexamples to the conjecture that the ideal form of a knot, that which minimizes its contour length while respecting a no-overlap constraint, also minimizes the volume of the knot, as determined by its convex hull. We measure the convex hull volume of knots during the length annealing process, identifying local minima in the hull volume that arise due to buckling and symmetry breaking. We use T(p,2) torus knots as an illustrative example of a family of knots whose locally minimal-length embeddings are not necessarily ordered by volume. We identify several knots whose central curve has a convex hull volume that is not minimized in the ideal configuration, and find that $8_{19}$ has a non-ideal global minimum in its convex hull volume even when the thickness of its tube is taken into account.


title: Exhaustion of hyperbolic complex manifolds and relations to the squeezing function

abstract: The purpose of this article is twofold. The first aim is to characterize an $n$-dimensional hyperbolic complex manifold $M$ exhausted by a sequence $\{\Omega_j\}$ of domains in $\mathbb C^n$ via an exhausting sequence $\{f_j\colon \Omega_j\to M\}$ such that $f_j^{-1}(a)$ converges to a boundary point $\xi_0 \in \partial \Omega$ for some point $a\in M$. Then, our second aim is to show that any spherically extreme boundary point must be strongly pseudoconvex.


title: QMC study of the chiral Heisenberg Gross-Neveu universality class

abstract: We investigate a quantum criticality of an antiferromagnetic phase transition in the Hubbard model on a square lattice with a $d$-wave pairing field by large-scale auxiliary-field quantum Monte Carlo simulations. Since the $d$-wave pairing filed induces Dirac cones in the non-interacting single-particle spectrum, the quantum criticality should correspond to the chiral Heisenberg universality class in terms of the Gross-Neveu theory, which is the same as those expected in the Hubbard model on the honeycomb lattice, despite the unit cells being different (e.g., they contain one and two sites, respectively). We show that both the two phase transitions, expected to occur on the square and on the honeycomb lattices, indeed have the same quantum criticality. We also argue that details of the models, i.e., the way of counting the total number $N$ of fermion components and the anisotropy of the Dirac cones, do not change the critical exponents.


title: Fairness-aware Online Price Discrimination with Nonparametric Demand Models

abstract: Price discrimination, which refers to the strategy of setting different prices for different customer groups, has been widely used in online retailing. Although it helps boost the collected revenue for online retailers, it might create serious concerns about fairness, which even violates the regulation and laws. This paper studies the problem of dynamic discriminatory pricing under fairness constraints. In particular, we consider a finite selling horizon of length $T$ for a single product with two groups of customers. Each group of customers has its unknown demand function that needs to be learned. For each selling period, the seller determines the price for each group and observes their purchase behavior. While existing literature mainly focuses on maximizing revenue, ensuring fairness among different customers has not been fully explored in the dynamic pricing literature. This work adopts the fairness notion from Cohen et al. (2022). For price fairness, we propose an optimal dynamic pricing policy regarding regret, which enforces the strict price fairness constraint. In contrast to the standard $\sqrt{T}$-type regret in online learning, we show that the optimal regret in our case is $\tilde{O}(T^{4/5})$. We further extend our algorithm to a more general notion of fairness, which includes demand fairness as a special case. To handle this general class, we propose a soft fairness constraint and develop a dynamic pricing policy that achieves $\tilde{O}(T^{4/5})$ regret. We also demonstrate that our algorithmic techniques can be adapted to more general scenarios such as fairness among multiple groups of customers.


title: Will We Trust What We Don't Understand? Impact of Model Interpretability and Outcome Feedback on Trust in AI

abstract: Despite AI's superhuman performance in a variety of domains, humans are often unwilling to adopt AI systems. The lack of interpretability inherent in many modern AI techniques is believed to be hurting their adoption, as users may not trust systems whose decision processes they do not understand. We investigate this proposition with a novel experiment in which we use an interactive prediction task to analyze the impact of interpretability and outcome feedback on trust in AI and on human performance in AI-assisted prediction tasks. We find that interpretability led to no robust improvements in trust, while outcome feedback had a significantly greater and more reliable effect. However, both factors had modest effects on participants' task performance. Our findings suggest that (1) factors receiving significant attention, such as interpretability, may be less effective at increasing trust than factors like outcome feedback, and (2) augmenting human performance via AI systems may not be a simple matter of increasing trust in AI, as increased trust is not always associated with equally sizable improvements in performance. These findings invite the research community to focus not only on methods for generating interpretations but also on techniques for ensuring that interpretations impact trust and performance in practice.


title: A Survey on Adversarial Attacks for Malware Analysis

abstract: Machine learning has witnessed tremendous growth in its adoption and advancement in the last decade. The evolution of machine learning from traditional algorithms to modern deep learning architectures has shaped the way today's technology functions. Its unprecedented ability to discover knowledge/patterns from unstructured data and automate the decision-making process led to its application in wide domains. High flying machine learning arena has been recently pegged back by the introduction of adversarial attacks. Adversaries are able to modify data, maximizing the classification error of the models. The discovery of blind spots in machine learning models has been exploited by adversarial attackers by generating subtle intentional perturbations in test samples. Increasing dependency on data has paved the blueprint for ever-high incentives to camouflage machine learning models. To cope with probable catastrophic consequences in the future, continuous research is required to find vulnerabilities in form of adversarial and design remedies in systems. This survey aims at providing the encyclopedic introduction to adversarial attacks that are carried out against malware detection systems. The paper will introduce various machine learning techniques used to generate adversarial and explain the structure of target files. The survey will also model the threat posed by the adversary and followed by brief descriptions of widely accepted adversarial algorithms. Work will provide a taxonomy of adversarial evasion attacks on the basis of attack domain and adversarial generation techniques. Adversarial evasion attacks carried out against malware detectors will be discussed briefly under each taxonomical headings and compared with concomitant researches. Analyzing the current research challenges in an adversarial generation, the survey will conclude by pinpointing the open future research directions.


title: Representation and modeling of charged particle distributions in tokamaks

abstract: Experimental diagnostics, analysis tools and simulations represent particle distributions in various forms and coordinates. Algorithms to manage these data are needed on platforms like the ITER Integrated Modelling & Analysis Suite (IMAS), performing tasks such as archiving, modeling, conversion and visualization. A method that accomplishes some of the required tasks for distributions of charged particles with arbitrarily large magnetic drifts in axisymmetric tokamak geometry is described here. Given a magnetic configuration, we first construct a database of guiding center orbits, which serves as a basis for representing particle distributions. The orbit database contains the geometric information needed to perform conversions between arbitrary coordinates, modeling tasks, and resonance analyses. Using that database, an imported or newly modeled distribution is mapped to an exact equilibrium, where the dimensionality is reduced to three constants of motion (CoM). The orbit weight is uniquely given when the input is a true distribution: one that measures the number of physical particles per unit of phase space volume. Less ideal inputs, such as distributions estimated without drifts, or models of particle sources, can also be processed. As an application example, we reconstruct the drift-induced features of a distribution of fusion-born alpha particles in a large tokamak, given only a birth profile, which is not a function of the alpha's CoM. Repeated back-and-forth transformations between CoM space and energy-pitch-cylinder coordinates are performed for verification and as a proof of principle for IMAS.


title: Spectral functions of heavy quarkonia in a bulk-viscous quark gluon plasma

abstract: We study the properties of quarkonia inside a bulk-viscous quark gluon plasma. The non-equilibrium nature of the medium is encoded in the deformed distribution functions of thermal quarks and gluons, with which we compute the dielectric permittivity within the hard thermal loop approximation at one-loop. The modified dielectric permittivity is used to calculate the in-medium heavy quark potential, and using the potential we compute spectral functions, which reflect the physical properties of heavy quarkonia. We discuss how the bulk viscous effect influences quantities such as binding energies and thermal widths. Based on those properties, we discuss the implications of the bulk viscous effect on the physical observables such as $ \psi' $ to $ J/\psi $ ratio and the nuclear modification factor, $R_{AA}$. In particular, we argue that the nuclear modification factors of excited and ground states show different sensitivities to the bulk viscous nature of a plasma, which is potentially useful for the critical point search.


title: Comparative Analysis of Machine Learning Models for Predicting Travel Time

abstract: In this paper, five different deep learning models are being compared for predicting travel time. These models are autoregressive integrated moving average (ARIMA) model, recurrent neural network (RNN) model, autoregressive (AR) model, Long-short term memory (LSTM) model, and gated recurrent units (GRU) model. The aim of this study is to investigate the performance of each developed model for forecasting travel time. The dataset used in this paper consists of travel time and travel speed information from the state of Missouri. The learning rate used for building each model was varied from 0.0001-0.01. The best learning rate was found to be 0.001. The study concluded that the ARIMA model was the best model architecture for travel time prediction and forecasting.


title: Phase function estimation from a diffuse optical image via deep learning

abstract: The phase function is a key element of a light propagation model for Monte Carlo (MC) simulation, which is usually fitted with an analytic function with associated parameters. In recent years, machine learning methods were reported to estimate the parameters of the phase function of a particular form such as the Henyey-Greenstein phase function but, to our knowledge, no studies have been performed to determine the form of the phase function. Here we design a convolutional neural network to estimate the phase function from a diffuse optical image without any explicit assumption on the form of the phase function. Specifically, we use a Gaussian mixture model as an example to represent the phase function generally and learn the model parameters accurately. The Gaussian mixture model is selected because it provides the analytic expression of phase function to facilitate deflection angle sampling in MC simulation, and does not significantly increase the number of free parameters. Our proposed method is validated on MC-simulated reflectance images of typical biological tissues using the Henyey-Greenstein phase function with different anisotropy factors. The effects of field of view (FOV) and spatial resolution on the errors are analyzed to optimize the estimation method. The mean squared error of the phase function is 0.01 and the relative error of the anisotropy factor is 3.28%.


title: SStaGCN: Simplified stacking based graph convolutional networks

abstract: Graph convolutional network (GCN) is a powerful model studied broadly in various graph structural data learning tasks. However, to mitigate the over-smoothing phenomenon, and deal with heterogeneous graph structural data, the design of GCN model remains a crucial issue to be investigated. In this paper, we propose a novel GCN called SStaGCN (Simplified stacking based GCN) by utilizing the ideas of stacking and aggregation, which is an adaptive general framework for tackling heterogeneous graph data. Specifically, we first use the base models of stacking to extract the node features of a graph. Subsequently, aggregation methods such as mean, attention and voting techniques are employed to further enhance the ability of node features extraction. Thereafter, the node features are considered as inputs and fed into vanilla GCN model. Furthermore, theoretical generalization bound analysis of the proposed model is explicitly given. Extensive experiments on $3$ public citation networks and another $3$ heterogeneous tabular data demonstrate the effectiveness and efficiency of the proposed approach over state-of-the-art GCNs. Notably, the proposed SStaGCN can efficiently mitigate the over-smoothing problem of GCN.


title: QA4PRF: A Question Answering based Framework for Pseudo Relevance Feedback

abstract: Pseudo relevance feedback (PRF) automatically performs query expansion based on top-retrieved documents to better represent the user's information need so as to improve the search results. Previous PRF methods mainly select expansion terms with high occurrence frequency in top-retrieved documents or with high semantic similarity with the original query. However, existing PRF methods hardly try to understand the content of documents, which is very important in performing effective query expansion to reveal the user's information need. In this paper, we propose a QA-based framework for PRF called QA4PRF to utilize contextual information in documents. In such a framework, we formulate PRF as a QA task, where the query and each top-retrieved document play the roles of question and context in the corresponding QA system, while the objective is to find some proper terms to expand the original query by utilizing contextual information, which are similar answers in QA task. Besides, an attention-based pointer network is built on understanding the content of top-retrieved documents and selecting the terms to represent the original query better. We also show that incorporating the traditional supervised learning methods, such as LambdaRank, to integrate PRF information will further improve the performance of QA4PRF. Extensive experiments on three real-world datasets demonstrate that QA4PRF significantly outperforms the state-of-the-art methods.


title: Selective Ensembles for Consistent Predictions

abstract: Recent work has shown that models trained to the same objective, and which achieve similar measures of accuracy on consistent test data, may nonetheless behave very differently on individual predictions. This inconsistency is undesirable in high-stakes contexts, such as medical diagnosis and finance. We show that this inconsistent behavior extends beyond predictions to feature attributions, which may likewise have negative implications for the intelligibility of a model, and one's ability to find recourse for subjects. We then introduce selective ensembles to mitigate such inconsistencies by applying hypothesis testing to the predictions of a set of models trained using randomly-selected starting conditions; importantly, selective ensembles can abstain in cases where a consistent outcome cannot be achieved up to a specified confidence level. We prove that that prediction disagreement between selective ensembles is bounded, and empirically demonstrate that selective ensembles achieve consistent predictions and feature attributions while maintaining low abstention rates. On several benchmark datasets, selective ensembles reach zero inconsistently predicted points, with abstention rates as low 1.5%.


title: A note on stability of syzygy bundles on Enriques and bielliptic surfaces

abstract: In this note, we prove that the syzygy bundle $M_L$ is cohomologically stable with respect to $L$ for any ample and globally generated line bundle $L$ on an Enriques (resp. bielliptic) surface over an algebraically closed field of characteristic $\neq 2$ (resp. $\neq 2,3$). In particular our result on complex Enriques surfaces improves a result of Torres-L\'opez and Zamora by removing a condition on Clifford index. Together with the results of Camere and Caucci--Lahoz, it implies that $M_L$ is stable with respect to $L$ for an ample and globally generated line bundle $L$ on any smooth minimal complex projective surface $X$ of Kodaira dimension zero.


title: Online Self-Evolving Anomaly Detection in Cloud Computing Environments

abstract: Modern cloud computing systems contain hundreds to thousands of computing and storage servers. Such a scale, combined with ever-growing system complexity, is causing a key challenge to failure and resource management for dependable cloud computing. Autonomic failure detection is a crucial technique for understanding emergent, cloud-wide phenomena and self-managing cloud resources for system-level dependability assurance. To detect failures, we need to monitor the cloud execution and collect runtime performance data. These data are usually unlabeled, and thus a prior failure history is not always available in production clouds. In this paper, we present a \emph{self-evolving anomaly detection} (SEAD) framework for cloud dependability assurance. Our framework self-evolves by recursively exploring newly verified anomaly records and continuously updating the anomaly detector online. As a distinct advantage of our framework, cloud system administrators only need to check a small number of detected anomalies, and their decisions are leveraged to update the detector. Thus, the detector evolves following the upgrade of system hardware, update of the software stack, and change of user workloads. Moreover, we design two types of detectors, one for general anomaly detection and the other for type-specific anomaly detection. With the help of self-evolving techniques, our detectors can achieve 88.94\% in sensitivity and 94.60\% in specificity on average, which makes them suitable for real-world deployment.


title: Toward UL-DL Rate Balancing: Joint Resource Allocation and Hybrid-Mode Multiple Access for UAV-BS Assisted Communication Systems

abstract: In this paper, we investigate unmanned aerial vehicle (UAV) assisted communication systems that require quasi-balanced data rates in uplink (UL) and downlink (DL), as well as users' heterogeneous traffic. To the best of our knowledge, this is the first work to explicitly investigate joint UL-DL optimization for UAV assisted systems under heterogeneous requirements. A hybrid-mode multiple access (HMMA) scheme is proposed toward heterogeneous traffic, where non-orthogonal multiple access (NOMA) targets high average data rate, while orthogonal multiple access (OMA) aims to meet users' instantaneous rate demands by compensating for their rates. HMMA enables a higher degree of freedom in multiple access and achieves a superior minimum average rate among users than the UAV assisted NOMA or OMA schemes. Under HMMA, a joint UL-DL resource allocation algorithm is proposed with a closed-form optimal solution for UL/DL power allocation to achieve quasi-balanced average rates for UL and DL. Furthermore, considering the error propagation in successive interference cancellation (SIC) of NOMA, an enhanced-HMMA scheme is proposed, which demonstrates high robustness against SIC error and a higher minimum average rate than the HMMA scheme.


title: Covariate Shift in High-Dimensional Random Feature Regression

abstract: A significant obstacle in the development of robust machine learning models is covariate shift, a form of distribution shift that occurs when the input distributions of the training and test sets differ while the conditional label distributions remain the same. Despite the prevalence of covariate shift in real-world applications, a theoretical understanding in the context of modern machine learning has remained lacking. In this work, we examine the exact high-dimensional asymptotics of random feature regression under covariate shift and present a precise characterization of the limiting test error, bias, and variance in this setting. Our results motivate a natural partial order over covariate shifts that provides a sufficient condition for determining when the shift will harm (or even help) test performance. We find that overparameterized models exhibit enhanced robustness to covariate shift, providing one of the first theoretical explanations for this intriguing phenomenon. Additionally, our analysis reveals an exact linear relationship between in-distribution and out-of-distribution generalization performance, offering an explanation for this surprising recent empirical observation.


title: Dynamics and habitability of the TESS circumbinary systems TOI-1338 and TIC-172900988

abstract: Two circumbinary planets have been recently discovered by TESS. The main aim of this work is to explore whether it is possible, besides the discovered circumbinary planet, to have an Earth-like planet within the habitable zone of the system. We carry out numerical simulations over the whole range of the two habitable zones in order to see whether an Earth mass planet can exist there. We find that both systems seem to be able to host an additional planet in their habitable zone. We construct dynamically informed habitable zones and we find that a large percentage of the habitable zone can be suitable for a planet to retain liquid water on its surface no matter what its orbital evolution will be. Moreover, we investigate the possibility to detect an Earth-like planet in the habitable zone of the two systems. We find that for both systems, if such a planet existed, the radial velocity and astrometry signals would be rather small to be detected by our current instruments. Some discussion is also made for the dynamical evolution of the existing planet.


title: Constructing the covariant three-point vertices systematically

abstract: An algorithm is developed for efficiently constructing the Lorentz covariant effective three-point vertices of the decay of a particle into two daughter particles in which all the masses and spins of the three particles can be arbitrary. The closely-related one-to-one correspondence between the helicity formalism and the covariant formulation is exploited for counting the number of independent terms and identifying the basic covariant three-point vertices. Assembling the basic operators according to the developed algorithm enables us to construct all the covariant three-point vertices systematically.


title: Refined inequalities for loosely trapped surface/attractive gravity probe surface

abstract: We reexamine a loosely trapped surface (LTS) proposed as an indicator for strong gravity and an attractive gravity probe surface (AGPS) as that for gravity. Refined inequalities for them are derived by taking account of angular momentum, gravitational waves and matters.


title: A Simple Algorithm for Computing the Zone of a Line in an Arrangement of Lines

abstract: Let $L$ be a set of $n$ lines in the plane. The zone $Z(\ell)$ of a line $\ell$ in the arrangement $\mathcal{A}(L)$ of $L$ is the set of faces of $\mathcal{A}(L)$ whose closure intersects $\ell$. It is known that the combinatorial size of $Z(\ell)$ is $O(n)$. Given $L$ and $\ell$, computing $Z(\ell)$ is a fundamental problem. Linear-time algorithms exist for computing $Z(\ell)$ if $\mathcal{A}(L)$ has already been built, but building $\mathcal{A}(L)$ takes $O(n^2)$ time. On the other hand, $O(n\log n)$-time algorithms are also known for computing $Z(\ell)$ without relying on $\mathcal{A}(L)$, but these algorithms are relatively complicated. In this paper, we present a simple algorithm that can compute $Z(\ell)$ in $O(n\log n)$ time. More specifically, once the sorted list of the intersections between $\ell$ and the lines of $L$ is known, the algorithm runs in $O(n)$ time. A big advantage of our algorithm, which mainly involves a Graham's scan style procedure, is its simplicity.


title: Assessing Deep Neural Networks as Probability Estimators

abstract: Deep Neural Networks (DNNs) have performed admirably in classification tasks. However, the characterization of their classification uncertainties, required for certain applications, has been lacking. In this work, we investigate the issue by assessing DNNs' ability to estimate conditional probabilities and propose a framework for systematic uncertainty characterization. Denoting the input sample as x and the category as y, the classification task of assigning a category y to a given input x can be reduced to the task of estimating the conditional probabilities p(y|x), as approximated by the DNN at its last layer using the softmax function. Since softmax yields a vector whose elements all fall in the interval (0, 1) and sum to 1, it suggests a probabilistic interpretation to the DNN's outcome. Using synthetic and real-world datasets, we look into the impact of various factors, e.g., probability density f(x) and inter-categorical sparsity, on the precision of DNNs' estimations of p(y|x), and find that the likelihood probability density and the inter-categorical sparsity have greater impacts than the prior probability to DNNs' classification uncertainty.


title: Torsion points of elliptic curves over multi-quadratic number fields

abstract: We compute the Mordell-Weil groups of the modular Jacobian varieties of hyperelliptic modular curves $X_1(M, MN)$ over every number field which is the composition of quadratic fields. Also we prove criteria for the existence of elliptic curves over such number fields with prescribed torsion points generalizing the results for quadratic number fields of Kamienny and Najman.


title: On the weak boundedness of multilinear Littlewood--Paley functions

abstract: In this note, notwithstanding the generalization, we simplify and shorten the proofs of the main results of the third author's paper \cite{SXY} significantly. In particular, the new proof for \cite[Theorem 1.1]{SXY} is quite short and, unlike the original proof, does not rely on the properties of the "Marcinkiewicz function". This allows us to get a precise linear dependence on Dini constants with a subsequent application to Littlewood--Paley operators by well-known techniques. In other words, we relax the log-Dini condition in the pointwise bound to the classical Dini condition. %$\int\limits_{0}^{1} \frac{\varphi(t)}{t}dt<\infty$. This solves an open problem (see e.g. \cite[pp. 37--38]{CY}). Our method can be applied to the multilinear case.


title: Blockage Prediction Using Wireless Signatures: Deep Learning Enables Real-World Demonstration

abstract: Overcoming the link blockage challenges is essential for enhancing the reliability and latency of millimeter wave (mmWave) and sub-terahertz (sub-THz) communication networks. Previous approaches relied mainly on either (i) multiple-connectivity, which under-utilizes the network resources, or on (ii) the use of out-of-band and non-RF sensors to predict link blockages, which is associated with increased cost and system complexity. In this paper, we propose a novel solution that relies only on in-band mmWave wireless measurements to proactively predict future dynamic line-of-sight (LOS) link blockages. The proposed solution utilizes deep neural networks and special patterns of received signal power, that we call pre-blockage wireless signatures to infer future blockages. Specifically, the developed machine learning models attempt to predict: (i) If a future blockage will occur? (ii) When will this blockage happen? (iii) What is the type of the blockage? And (iv) what is the direction of the moving blockage? To evaluate our proposed approach, we build a large-scale real-world dataset comprising nearly $0.5$ million data points (mmWave measurements) for both indoor and outdoor blockage scenarios. The results, using this dataset, show that the proposed approach can successfully predict the occurrence of future dynamic blockages with more than 85\% accuracy. Further, for the outdoor scenario with highly-mobile vehicular blockages, the proposed model can predict the exact time of the future blockage with less than $80$ms error for blockages happening within the future $500$ms. These results, among others, highlight the promising gains of the proposed proactive blockage prediction solution which could potentially enhance the reliability and latency of future wireless networks.


title: CAR -- Cityscapes Attributes Recognition A Multi-category Attributes Dataset for Autonomous Vehicles

abstract: Self-driving vehicles are the future of transportation. With current advancements in this field, the world is getting closer to safe roads with almost zero probability of having accidents and eliminating human errors. However, there is still plenty of research and development necessary to reach a level of robustness. One important aspect is to understand a scene fully including all details. As some characteristics (attributes) of objects in a scene (drivers' behavior for instance) could be imperative for correct decision making. However, current algorithms suffer from low-quality datasets with such rich attributes. Therefore, in this paper, we present a new dataset for attributes recognition -- Cityscapes Attributes Recognition (CAR). The new dataset extends the well-known dataset Cityscapes by adding an additional yet important annotation layer of attributes of objects in each image. Currently, we have annotated more than 32k instances of various categories (Vehicles, Pedestrians, etc.). The dataset has a structured and tailored taxonomy where each category has its own set of possible attributes. The tailored taxonomy focuses on attributes that is of most beneficent for developing better self-driving algorithms that depend on accurate computer vision and scene comprehension. We have also created an API for the dataset to ease the usage of CAR. The API can be accessed through https://github.com/kareem-metwaly/CAR-API.


title: Sparse Regularization with the $\ell_0$ Norm

abstract: We consider a minimization problem whose objective function is the sum of a fidelity term, not necessarily convex, and a regularization term defined by a positive regularization parameter $\lambda$ multiple of the $\ell_0$ norm composed with a linear transform. This problem has wide applications in compressed sensing, sparse machine learning and image reconstruction. The goal of this paper is to understand what choices of the regularization parameter can dictate the level of sparsity under the transform for a global minimizer of the resulting regularized objective function. This is a critical issue but it has been left unaddressed. We address it from a geometric viewpoint with which the sparsity partition of the image space of the transform is introduced. Choices of the regularization parameter are specified to ensure that a global minimizer of the corresponding regularized objective function achieves a prescribed level of sparsity under the transform. Results are obtained for the spacial sparsity case in which the transform is the identity map, a case that covers several applications of practical importance, including machine learning, image/signal processing and medical image reconstruction.


title: Masur's Divergence for Tori and Kummer Surfaces

abstract: Masur's divergence states that the horizontal foliation of translation surfaces is uniquely ergodic if the geodesic flow is recurrent on the moduli space. This established a relationship between geometrical properties of foliations and the dynamics on the moduli space. In this paper, we extend this theorem to complex torus and Kummer surfaces. We define and calculate horizontal foliations and the corresponding geodesic flow in the moduli space of K\"ahler metrics and prove that the horizontal foliation is uniquely ergodic if the geodesic flow is recurrent. We also find the a necessary algebraic condition on the geodesic flow for the horizontal foliation to be uniquely ergodic.


title: Self-encoding Barnacle Mating Optimizer Algorithm for Manpower Scheduling in Flow Shop

abstract: Flow Shop Scheduling (FSS) has been widely researched due to its application in many types of fields, while the human participant brings great challenges to this problem. Manpower scheduling captures attention for assigning workers with diverse proficiency to the appropriate stages, which is of great significance to production efficiency. In this paper, we present a novel algorithm called Self-encoding Barnacle Mating Optimizer (SBMO), which solves the FSS problem considering worker proficiency, defined as a new problem, Flow Shop Manpower Scheduling Problem (FSMSP). The highlight of the SBMO algorithm is the combination with the encoding method, crossover and mutation operators. Moreover, in order to solve the local optimum problem, we design a neighborhood search scheme. Finally, the extensive comparison simulations are conducted to demonstrate the superiority of the proposed SBMO. The results indicate the effectiveness of SBMO in approximate ratio, powerful stability, and execution time, compared with the classic and popular counterparts.


title: Correlation between optical flux and polarization variations in Flat Spectrum Radio Quasars on diverse timescales

abstract: Study of the polarization behaviour in blazars is a powerful tool to discern the role of magnetic field in the variable emission process in their relativistic jets. We present here results of our systematic investigation on the correlation between optical flux and polarization variations for eight flat-spectrum radio quasars on various timescales using data from the Steward Observatory that covers a period of $\sim$10 years. On long time scales ($\sim$several months), from a total of 79 observing cycles, in 34 observing cycles, we found a significant positive correlation between optical flux and optical polarization degree (PD), negative correlation in 3 cycles and no correlation in 42 cycles. On short time scales ($\sim$few days), in 47 out of a total of 55 epochs, we found a positive correlation between optical flux and PD, while, on the remaining 8 epochs, an anti-correlation was detected between the two quantities. Moreover, we noticed a significant positive correlation between optical and $\gamma-$ray fluxes on 14 epochs and a negative correlation between the two on one epoch. While the observed optical flux changes well fit in the shock-in-jet model, the observed changes in PD are not explainable by changes in the power-law spectral index of the relativistic electrons in the jet. Instead, the observed varied correlations between optical flux and PD could be due to multi-zone emission regions or the enhanced flux coinciding with the emergence of a new emission knot with its magnetic field either aligned or misaligned with the large scale magnetic field.


title: Active Vapor-Based Robotic Wiper

abstract: This paper presents a method for the normal estimation of mirrors and transparent objects that are difficult to recognize with a camera. To create a diffuse reflective surface, we propose spraying water vapor onto transparent or mirror surfaces. In the proposed method, we move an ultrasonic humidifier equipped on the tip of a robotic arm to apply sprayed water vapor onto the plane of a target object to form a cross-shaped misted area. Diffuse reflective surfaces are partially generated as misted areas, which allows the camera to detect the surface of the target object. The viewpoint of the gripper-mounted camera is adjusted such that the extracted misted area appears to be the largest in the image, and finally, the plane normal of the target object surface is estimated. Normal estimation experiments were conducted to evaluate the effectiveness of the proposed method. The RMSEs of the azimuth estimation for the mirror and transparent glass were approximately 4.2 and 5.8 degrees, respectively. Consequently, our robot experiments demonstrate that our robotic wiper can perform contact-force-regulated wiping motions to clean a transparent window, as humans do.


title: Bengali Handwritten Grapheme Classification: Deep Learning Approach

abstract: Despite being one of the most spoken languages in the world ($6^{th}$ based on population), research regarding Bengali handwritten grapheme (smallest functional unit of a writing system) classification has not been explored widely compared to other prominent languages. Moreover, the large number of combinations of graphemes in the Bengali language makes this classification task very challenging. With an effort to contribute to this research problem, we participate in a Kaggle competition \cite{kaggle_link} where the challenge is to separately classify three constituent elements of a Bengali grapheme in the image: grapheme root, vowel diacritics, and consonant diacritics. We explore the performances of some existing neural network models such as Multi-Layer Perceptron (MLP) and state of the art ResNet50. To further improve the performance we propose our own convolution neural network (CNN) model for Bengali grapheme classification with validation root accuracy 95.32\%, vowel accuracy 98.61\%, and consonant accuracy 98.76\%. We also explore Region Proposal Network (RPN) using VGGNet with a limited setting that can be a potential future direction to improve the performance.


title: Neutrino flavor evolution in dense environments and the r-process

abstract: In dense environments, standard and non-standard neutrino interactions with the background particles trigger a variety of flavor mechanisms, which can impact r-process nucleosynthetic abundances. Future observations of a(n) (extra)galactic supernova will tell us about properties of neutrinos and of the astrophysical source that produce them. The upcoming measurement of the diffuse supernova neutrino background constitute a unique source of information. We highlight some recent developments.


title: Enabling equivariance for arbitrary Lie groups

abstract: Although provably robust to translational perturbations, convolutional neural networks (CNNs) are known to suffer from extreme performance degradation when presented at test time with more general geometric transformations of inputs. Recently, this limitation has motivated a shift in focus from CNNs to Capsule Networks (CapsNets). However, CapsNets suffer from admitting relatively few theoretical guarantees of invariance. We introduce a rigourous mathematical framework to permit invariance to any Lie group of warps, exclusively using convolutions (over Lie groups), without the need for capsules. Previous work on group convolutions has been hampered by strong assumptions about the group, which precludes the application of such techniques to common warps in computer vision such as affine and homographic. Our framework enables the implementation of group convolutions over any finite-dimensional Lie group. We empirically validate our approach on the benchmark affine-invariant classification task, where we achieve 30% improvement in accuracy against conventional CNNs while outperforming most CapsNets. As further illustration of the generality of our framework, we train a homography-convolutional model which achieves superior robustness on a homography-perturbed dataset, where CapsNet results degrade.


title: Attractors and chain recurrence in noncompact space for semigroup of continuous maps

abstract: We shall address the alternative definition of chain recurrent set for the action of a semigroup of continuous self maps, given by M. Hurley \cite {mh} in noncompact space. Following this, we shall address the characterization of chain recurrence in terms of attractors given by C. Conley in \cite {conley}.


title: Generalization Bounds and Algorithms for Learning to Communicate over Additive Noise Channels

abstract: An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem of choosing a codebook and possibly also a generalized minimal distance decoder (which is parameterized by a covariance matrix) is addressed. High probability generalization bounds for the error probability loss function, as well as for a hinge-type surrogate loss function are provided. A stochastic-gradient based alternating-minimization algorithm for the latter loss function is proposed. In addition, a Gibbs-based algorithm that gradually expurgates an initial codebook from codewords in order to obtain a smaller codebook with improved error probability is proposed, and bounds on its average empirical error and generalization error, as well as a high probability generalization bound, are stated. Various experiments demonstrate the performance of the proposed algorithms. For coded systems, the problem of maximizing the mutual information between the input and the output with respect to the input distribution is addressed, and uniform convergence bounds for two different classes of input distributions are obtained.


title: Prediction of nonlinear interface dynamics in the unidirectional freezing of particle suspensions with rigid compacted layer

abstract: Water freezing in particle suspensions widely exists in nature. As a typical physical system of free boundary problem, the spatiotemporal evolution of the solid/liquid interface not only origins from phase transformation but also from permeation flow in front of ice. Physical models have been proposed in previous efforts to describe the interface dynamic behaviors in unidirectional freezing of particle suspensions. However, there are several physical parameters difficult to be determined in previous investigations dedicated to describing the spatiotemporal evolution in unidirectional freezing of particle suspensions. Here, based on the fundamental momentum theorem, we propose a consistent theoretical framework to address the unidirectional freezing process in the particle suspensions coupled with the effect of water permeation. An interface undercooling-dependent pushing force exerted on the compacted layer with a specific formula is derived based on the surface tension. Then a dynamic compacted layer is considered and analyzed. Numerical solutions of the nonlinear models reveal the dependence of system dynamics on some typical physical parameters, particle radius, initial particle concentration in the suspensions, freezing velocity and so on. The system dynamics are characterized by interface velocity, interface undercooling and interface recoil as functions of time. The models allow us to reconsider the formation mechanism of ice spears in freezing of particle suspensions in a simpler but novel way, with potential implications for both understanding and controlling not only ice formation in porous media but also crystallization processes in other complex systems.


title: A Unified and Fast Interpretable Model for Predictive Analytics

abstract: Predictive analytics aims to build machine learning models to predict behavior patterns and use predictions to guide decision-making. Predictive analytics is human involved, thus the machine learning model is preferred to be interpretable. In literature, Generalized Additive Model (GAM) is a standard for interpretability. However, due to the one-to-many and many-to-one phenomena which appear commonly in real-world scenarios, existing GAMs have limitations to serve predictive analytics in terms of both accuracy and training efficiency. In this paper, we propose FXAM (Fast and eXplainable Additive Model), a unified and fast interpretable model for predictive analytics. FXAM extends GAM's modeling capability with a unified additive model for numerical, categorical, and temporal features. FXAM conducts a novel training procedure called Three-Stage Iteration (TSI). TSI corresponds to learning over numerical, categorical, and temporal features respectively. Each stage learns a local optimum by fixing the parameters of other stages. We design joint learning over categorical features and partial learning over temporal features to achieve high accuracy and training efficiency. We prove that TSI is guaranteed to converge to the global optimum. We further propose a set of optimization techniques to speed up FXAM's training algorithm to meet the needs of interactive analysis. Thorough evaluations conducted on diverse data sets verify that FXAM significantly outperforms existing GAMs in terms of training speed, and modeling categorical and temporal features. In terms of interpretability, we compare FXAM with the typical post-hoc approach XGBoost+SHAP on two real-world scenarios, which shows the superiority of FXAM's inherent interpretability for predictive analytics.


title: Online Meta Adaptation for Variable-Rate Learned Image Compression

abstract: This work addresses two major issues of end-to-end learned image compression (LIC) based on deep neural networks: variable-rate learning where separate networks are required to generate compressed images with varying qualities, and the train-test mismatch between differentiable approximate quantization and true hard quantization. We introduce an online meta-learning (OML) setting for LIC, which combines ideas from meta learning and online learning in the conditional variational auto-encoder (CVAE) framework. By treating the conditional variables as meta parameters and treating the generated conditional features as meta priors, the desired reconstruction can be controlled by the meta parameters to accommodate compression with variable qualities. The online learning framework is used to update the meta parameters so that the conditional reconstruction is adaptively tuned for the current image. Through the OML mechanism, the meta parameters can be effectively updated through SGD. The conditional reconstruction is directly based on the quantized latent representation in the decoder network, and therefore helps to bridge the gap between the training estimation and true quantized latent distribution. Experiments demonstrate that our OML approach can be flexibly applied to different state-of-the-art LIC methods to achieve additional performance improvements with little computation and transmission overhead.


title: Synthesis and thermal expansion of chalcogenide MAX phase Hf2SeC

abstract: Thermal expansion of MAX phases along different directions tended to be different because of the anisotropy of hexagonal crystals. Herein, a new Hf2SeC phase was synthesized and confirmed to be relatively isotropic, whose coefficients of thermal expansion (CTEs) were determined to be 9.73 {\mu}K-1 and 10.18 {\mu}K-1 along a and c directions. The strong M-S bond endowed Hf2SC and Zr2SC lower CTEs than Hf2SeC and Zr2SeC. A good relationship between the thermal expansion anisotropy and the ratio of elastic stiffness constant c11 and c33 was established. This straightforward approximation could be used to roughly predict the thermal expansion anisotropy of MAX phases.


title: Faster-than-Nyquist Asynchronous NOMA Outperforms Synchronous NOMA

abstract: Faster-than-Nyquist (FTN) signaling aided non-orthogonal multiple access (NOMA) is conceived and its achievable rate is quantified in the presence of random link delays of the different users. We reveal that exploiting the link delays may potentially lead to a signal-to-interference-plus-noise ratio (SINR) gain, while transmitting the data symbols at FTN rates has the potential of increasing the degree-of-freedom (DoF). We then unveil the fundamental trade-off between the SINR and DoF. In particular, at a sufficiently high symbol rate, the SINR gain vanishes while the DoF gain achieves its maximum, where the achievable rate is almost $(1+\beta)$ times higher than that of the conventional synchronous NOMA transmission in the high signal-to-noise ratio (SNR) regime, with $\beta$ being the roll-off factor of the signaling pulse. Our simulation results verify our analysis and demonstrate considerable rate improvements over the conventional power-domain NOMA scheme.


title: Pose Recognition in the Wild: Animal pose estimation using Agglomerative Clustering and Contrastive Learning

abstract: Animal pose estimation has recently come into the limelight due to its application in biology, zoology, and aquaculture. Deep learning methods have effectively been applied to human pose estimation. However, the major bottleneck to the application of these methods to animal pose estimation is the unavailability of sufficient quantities of labeled data. Though there are ample quantities of unlabelled data publicly available, it is economically impractical to label large quantities of data for each animal. In addition, due to the wide variety of body shapes in the animal kingdom, the transfer of knowledge across domains is ineffective. Given the fact that the human brain is able to recognize animal pose without requiring large amounts of labeled data, it is only reasonable that we exploit unsupervised learning to tackle the problem of animal pose recognition from the available, unlabelled data. In this paper, we introduce a novel architecture that is able to recognize the pose of multiple animals fromunlabelled data. We do this by (1) removing background information from each image and employing an edge detection algorithm on the body of the animal, (2) Tracking motion of the edge pixels and performing agglomerative clustering to segment body parts, (3) employing contrastive learning to discourage grouping of distant body parts together. Hence we are able to distinguish between body parts of the animal, based on their visual behavior, instead of the underlying anatomy. Thus, we are able to achieve a more effective classification of the data than their human-labeled counterparts. We test our model on the TigDog and WLD (WildLife Documentary) datasets, where we outperform state-of-the-art approaches by a significant margin. We also study the performance of our model on other public data to demonstrate the generalization ability of our model.


title: A change-point detection method for detecting and locating the abrupt changes in distributions of damage-sensitive features of SHM data, with application to structural condition assessment

abstract: Diagnosing the changes of structural behaviors using monitoring data is an important objective of structural health monitoring (SHM). The changes in structural behaviors are usually manifested as the feature changes in monitored structural responses; thus, developing effective methods for automatically detecting such changes is of considerable significance. Existing methods for change detection in SHM are mainly used for scalar or vector data, thus incapable of detecting the changes of the features represented by complex data, e.g., the probability density functions (PDFs). Detecting the abrupt changes occurred in the distributions (represented by PDFs) associated with the damage-sensitive features extracted from SHM data are usually of crucial interest for structural condition assessment; however, the SHM community still lacks effective diagnostic tools for detecting such changes. In this study, a change-point detection method is developed in the functional data-analytic framework for PDF-valued sequence, and it is leveraged to diagnose the distributional information break encountered in structural condition assessment. A major challenge in PDF-valued data modeling or analysis is that the PDFs are special functional data subjecting to nonlinear constraints. To tackle this issue, the PDFs are embedded into the Bayes space, and the associated change-point model is constructed by using the linear structure of the Bayes space; then, a hypothesis testing procedure is presented for distributional change-point detection based on the isomorphic mapping between the Bayes space and a functional linear space. Comprehensive simulation studies are conducted to validate the effectiveness of the proposed method as well as demonstrate its superiority over the competing method. Finally, an application to real SHM data illustrates its practical utility in structural condition assessment.


title: Elliptic Methods for Solving the Linearized Field Equations of Causal Variational Principles

abstract: The existence theory is developed for solutions of the inhomogeneous linearized field equations for causal variational principles. These equations are formulated weakly with an integral operator which is shown to be bounded and symmetric on a Hilbert space endowed with a suitably adapted weighted $L^2$-scalar product. Guided by the procedure in the theory of linear elliptic partial differential equations, we use the spectral calculus to define Sobolev-type Hilbert spaces and invert the linearized field operator as an operator between such function spaces. The uniqueness of the resulting weak solutions is analyzed. Our constructions are illustrated in simple explicit examples. The connection to the causal action principle for static causal fermion systems is explained.


title: Larger Corner-Free Sets from Combinatorial Degenerations

abstract: There is a large and important collection of Ramsey-type combinatorial problems, closely related to central problems in complexity theory, that can be formulated in terms of the asymptotic growth of the size of the maximum independent sets in powers of a fixed small (directed or undirected) hypergraph, also called the Shannon capacity. An important instance of this is the corner problem studied in the context of multiparty communication complexity in the Number On the Forehead (NOF) model. Versions of this problem and the NOF connection have seen much interest (and progress) in recent works of Linial, Pitassi and Shraibman (ITCS 2019) and Linial and Shraibman (CCC 2021). We introduce and study a general algebraic method for lower bounding the Shannon capacity of directed hypergraphs via combinatorial degenerations, a combinatorial kind of "approximation" of subgraphs that originates from the study of matrix multiplication in algebraic complexity theory (and which play an important role there) but which we use in a novel way. Using the combinatorial degeneration method, we make progress on the corner problem by explicitly constructing a corner-free subset in $F_2^n \times F_2^n$ of size $\Omega(3.39^n/poly(n))$, which improves the previous lower bound $\Omega(2.82^n)$ of Linial, Pitassi and Shraibman (ITCS 2019) and which gets us closer to the best upper bound $4^{n - o(n)}$. Our new construction of corner-free sets implies an improved NOF protocol for the Eval problem. In the Eval problem over a group $G$, three players need to determine whether their inputs $x_1, x_2, x_3 \in G$ sum to zero. We find that the NOF communication complexity of the Eval problem over $F_2^n$ is at most $0.24n + O(\log n)$, which improves the previous upper bound $0.5n + O(\log n)$.


title: Phenomenology of one zero texture Yukawa matrix in a flavor symmetric scotogenic model

abstract: The scotogenic model is well known for accommodating small neutrino mass and dark matter. Here, we have realized the scotogenic model with the help of discrete flavor symmetry $A_{4}\otimes Z_{4}$. We have obtained three one zero textures of Yukawa coupling matrices from the model and have studied its impact on neutrino phenomenology and related aspects of cosmology. On the basis of $\mu-\tau$ symmetry, we have further discarded two structures of one zero texture Yukawa coupling matrix. We further analyze if the effective mass of active neutrinos obtained by the virtue of the Yukawa coupling matrix is consistent with the KamLAND-Zen limit for 0$\nu\beta\beta$. Also different lepton flavor violating(LFV) processes such as $l_{\alpha}\longrightarrow l_{\beta}\gamma$ and $l_{\alpha}\longrightarrow 3l_{\beta}$ are implemented and their influence on neutrino phenomenology is studied corresponding to the Yukawa coupling matrix. The entire work is carried out considering the dark matter mass($M_{DM}$) in the region $450-750$ GeV. We have also obtained some significant results for baryon asymmetry of the Universe in agreement with the one zero textures of the coupling matrices. Furthermore, interesting results for relic abundance on the basis of distinct mass splittings between the inert scalars.


title: Analysis of 5G academic Network based on graph representation learning method

abstract: With the rapid development of 5th Generation Mobile Communication Technology (5G), the diverse forms of collaboration and extensive data in academic social networks constructed by 5G papers make the management and analysis of academic social networks increasingly challenging. Despite the particular success achieved by representation learning in analyzing academic and social networks, most present presentation learning models focus on maintaining the first-order and second-order similarity of nodes. They rarely possess similar structural characteristics of spatial independence in the network. This paper proposes a Low-order Network representation Learning Model (LNLM) based on Non-negative Matrix Factorization (NMF) to solve these problems. The model uses the random walk method to extract low-order features of nodes and map multiple components to a low-dimensional space, effectively maintaining the internal correlation between members. This paper verifies the performance of this model, conducts comparative experiments on four test datasets and four real network datasets through downstream tasks such as multi-label classification, clustering, and link prediction. Comparing eight mainstream network representation learning models shows that the proposed model can significantly improve the detection efficiency and learning methods and effectively extract local and low-order features of the network.


title: Spectral enclosures and stability for non-self-adjoint discrete Schroedinger operators on the half-line

abstract: We make a spectral analysis of discrete Schroedinger operators on the half-line, subject to complex Robin-type boundary couplings and complex-valued potentials. First, optimal spectral enclosures are obtained for summable potentials. Second, general smallness conditions on the potentials guaranteeing a spectral stability are established. Third, a general identity which allows to generate optimal discrete Hardy inequalities for the discrete Dirichlet Laplacian on the half-line is proved.


title: Quantum communication using a quantum switch of quantum switches

abstract: The quantum switch describes a quantum operation in which two or more quantum channels act on a quantum system with the order of application determined by the state of an order quantum system. And by suitably choosing the state of the order system, one can create a quantum superposition of the different orders of application, which can perform communication tasks impossible within the framework of the standard quantum Shannon theory. In this paper, we consider the scenario of one-shot heralded qubit communication and ask whether there exist protocols using a given quantum switch or switches that could outperform the given ones. We answer this question in the affirmative. We define a higher-order quantum switch composed of two quantum switches, with their order of application controlled by another order quantum system. We then show that the quantum switches placed in a quantum superposition of their alternative orders can transmit a qubit, without any error, with a probability higher than that achievable with the quantum switches individually. We demonstrate this communication advantage over quantum switches useful as a resource and those that are useless. We also show that there are situations where there is no communication advantage over the individual quantum switches.


title: Solving Probability and Statistics Problems by Program Synthesis

abstract: We solve university level probability and statistics questions by program synthesis using OpenAI's Codex, a Transformer trained on text and fine-tuned on code. We transform course problems from MIT's 18.05 Introduction to Probability and Statistics and Harvard's STAT110 Probability into programming tasks. We then execute the generated code to get a solution. Since these course questions are grounded in probability, we often aim to have Codex generate probabilistic programs that simulate a large number of probabilistic dependencies to compute its solution. Our approach requires prompt engineering to transform the question from its original form to an explicit, tractable form that results in a correct program and solution. To estimate the amount of work needed to translate an original question into its tractable form, we measure the similarity between original and transformed questions. Our work is the first to introduce a new dataset of university-level probability and statistics problems and solve these problems in a scalable fashion using the program synthesis capabilities of large language models.


title: Pre-training Graph Neural Network for Cross Domain Recommendation

abstract: A recommender system predicts users' potential interests in items, where the core is to learn user/item embeddings. Nevertheless, it suffers from the data-sparsity issue, which the cross-domain recommendation can alleviate. However, most prior works either jointly learn the source domain and target domain models, or require side-features. However, jointly training and side features would affect the prediction on the target domain as the learned embedding is dominated by the source domain containing bias information. Inspired by the contemporary arts in pre-training from graph representation learning, we propose a pre-training and fine-tuning diagram for cross-domain recommendation. We devise a novel Pre-training Graph Neural Network for Cross-Domain Recommendation (PCRec), which adopts the contrastive self-supervised pre-training of a graph encoder. Then, we transfer the pre-trained graph encoder to initialize the node embeddings on the target domain, which benefits the fine-tuning of the single domain recommender system on the target domain. The experimental results demonstrate the superiority of PCRec. Detailed analyses verify the superiority of PCRec in transferring information while avoiding biases from source domains.


title: Data-Driven Inpatient Bed Assignment Using the P Model

abstract: Problem definition: Emergency department (ED) boarding refers to the practice of holding patients in the ED after they have been admitted to hospital wards, usually resulting from insufficient inpatient resources. Boarded patients may compete with new patients for medical resources in the ED, compromising the quality of emergency care. A common expedient for mitigating boarding is patient overflowing, i.e., sending patients to beds in other specialties or accommodation classes, which may compromise the quality of inpatient care and bring on operational challenges. We study inpatient bed assignment to shorten boarding times without excessive patient overflowing. Methodology: We use a queue with multiple customer classes and multiple server pools to model hospital wards. Exploiting patient flow data from a hospital, we propose a computationally tractable approach to formulating the bed assignment problem, where the joint probability of all waiting patients meeting their respective delay targets is maximized. Results: By dynamically adjusting the overflow rate, the proposed approach is capable not only of reducing patients' waiting times, but also of mitigating the time-of-day effect on boarding times. In numerical experiments, our approach greatly outperforms both early discharge policies and threshold-based overflowing policies, which are commonly used in practice. Managerial implications: We provide a practicable approach to solving the bed assignment problem. This data-driven approach captures critical features of patient flow management, while the resulting optimization problem is practically solvable. The proposed approach is a useful tool for the control of queueing systems with time-sensitive service requirements.


title: Data Augmentation using Random Image Cropping for High-resolution Virtual Try-On (VITON-CROP)

abstract: Image-based virtual try-on provides the capacity to transfer a clothing item onto a photo of a given person, which is usually accomplished by warping the item to a given human pose and adjusting the warped item to the person. However, the results of real-world synthetic images (e.g., selfies) from the previous method is not realistic because of the limitations which result in the neck being misrepresented and significant changes to the style of the garment. To address these challenges, we propose a novel method to solve this unique issue, called VITON-CROP. VITON-CROP synthesizes images more robustly when integrated with random crop augmentation compared to the existing state-of-the-art virtual try-on models. In the experiments, we demonstrate that VITON-CROP is superior to VITON-HD both qualitatively and quantitatively.


title: AstroSat view of spectral transition in the changing-look active galaxy NGC1566 during the declining phase of the 2018 outburst

abstract: NGC1566 is a changing-look active galaxy that exhibited an outburst during 2017-2018 with a peak in June 2018. We triggered AstroSat observations of NGC 1566 twice in August and October 2018 during its declining phase. Using the AstroSat observations along-with two XMM-Newton observations in 2015 (pre-outburst) and June 2018 (peak-outburst), we found that the X-ray power-law, the soft X-ray excess, and the disk components showed extreme variability during the outburst. Especially, the soft excess was negligible in 2015 before the outburst, it increased to a maximum level by a factor of $>200$ in June 2018, and reduced dramatically by a factor of $\sim7.4$ in August 2018 and become undetectable in October 2018. The Eddington fraction ($L/L_{Edd})$ increased from $\sim0.1\%$ (2015) to $\sim 5\%$ (June 2018), then decreased to $\sim 1.5\%$ (August 2018) and $0.3\%$ (October 2018). Thus, NGC 1566 made a spectral transition from a high soft-excess state to a negligible soft-excess state at a few $\%$ of the Eddington rate. The soft-excess is consistent with warm Comptonization in the inner disk that appears to have developed during the outburst and disappeared towards the end of the outburst over a timescale comparable to the sound crossing time. The multi-wavelength spectral evolution of NGC 1566 during the outburst is most likely caused by the radiation pressure instability in the inner regions of the accretion disk in NGC 1566.


title: Task allocation for decentralized training in heterogeneous environment

abstract: The demand for large-scale deep learning is increasing, and distributed training is the current mainstream solution. Ring AllReduce is widely used as a data parallel decentralized algorithm. However, in a heterogeneous environment, each worker calculates the same amount of data, so that there is a lot of waiting time loss among different workers, which makes the algorithm unable to adapt well to heterogeneous clusters. Resources are not used as they should be. In this paper, we design an implementation of static allocation algorithm. The dataset is artificially allocated to each worker, and samples are drawn proportionally for training, thereby speeding up the training speed of the network in a heterogeneous environment. We verify the convergence and influence on training speed of the network model under this algorithm on one machine with multi-card and multi-machine with multi-card. On this basis of feasibility, we propose a self-adaptive allocation algorithm that allows each machine to find the data it needs to adapt to the current environment. The self-adaptive allocation algorithm can reduce the training time by nearly one-third to half compared to the same proportional allocation.In order to better show the applicability of the algorithm in heterogeneous clusters, We replace a poorly performing worker with a good performing worker or add a poorly performing worker to the heterogeneous cluster. Experimental results show that training time will decrease as the overall performance improves. Therefore, it means that resources are fully used. Further, this algorithm is not only suitable for straggler problems, but also for most heterogeneous situations. It can be used as a plug-in for AllReduce and its variant algorithms.


title: The tidal quality of the hot Jupiter WASP-12b

abstract: WASP-12b stands out among the planets of its class of hot Jupiters because of the observed fast orbital decay attributed to tidal dissipation. The measured rate of the orbital period is $\stackrel{\bf\centerdot}{\textstyle{P}}_{\rm orb}\,=\,-\,29\pm3\;\mbox{ms/yr}\;$=$\;(9.2\pm1.0)\times10^{-10}\;\mbox{s/s}$. In the literature heretofore, all attempts to explain this high rate were based on the assumption that the orbital evolution is dominated by the tides in the star. Since the modified tidal quality factor in yellow dwarfs is insufficient to warrant such a decay rate, a hypothesis was put forward that the star may actually be a subgiant. Using the latest data from the Gaia mission, we deduce that WASP-12a at $1.36\,{M_{Sun}}$ is an evolving dwarf at an early stage of post-turn-off evolution that has not yet depleted hydrogen in its core. Its unremarkable position in the color-magnitude diagram and the existence of close planets orbiting red giants of similar mass contradict the hypothesis of an abrupt boost of tidal quality due to structural internal changes. On the other hand, the previous research neglected the tidal dissipation in the planet assuming it to be negligible due to the likely synchronisation of its rotation and a presumed high quality factor. We critically reassess this assumption in the light of recent astrometric results for Jupiter and Saturn. Assuming that the structure of WASP-12b is similar to that of our Jupiter and Saturn, we find that the observed orbital decay is well explained by the tides in the planet. The estimated value of the planet's modified quality factor coincides almost precisely with that of our Jupiter.


title: HADFL: Heterogeneity-aware Decentralized Federated Learning Framework

abstract: Federated learning (FL) supports training models on geographically distributed devices. However, traditional FL systems adopt a centralized synchronous strategy, putting high communication pressure and model generalization challenge. Existing optimizations on FL either fail to speedup training on heterogeneous devices or suffer from poor communication efficiency. In this paper, we propose HADFL, a framework that supports decentralized asynchronous training on heterogeneous devices. The devices train model locally with heterogeneity-aware local steps using local data. In each aggregation cycle, they are selected based on probability to perform model synchronization and aggregation. Compared with the traditional FL system, HADFL can relieve the central server's communication pressure, efficiently utilize heterogeneous computing power, and can achieve a maximum speedup of 3.15x than decentralized-FedAvg and 4.68x than Pytorch distributed training scheme, respectively, with almost no loss of convergence accuracy.


title: Deep Distilling: automated code generation using explainable deep learning

abstract: Human reasoning can distill principles from observed patterns and generalize them to explain and solve novel problems. The most powerful artificial intelligence systems lack explainability and symbolic reasoning ability, and have therefore not achieved supremacy in domains requiring human understanding, such as science or common sense reasoning. Here we introduce deep distilling, a machine learning method that learns patterns from data using explainable deep learning and then condenses it into concise, executable computer code. The code, which can contain loops, nested logical statements, and useful intermediate variables, is equivalent to the neural network but is generally orders of magnitude more compact and human-comprehensible. On a diverse set of problems involving arithmetic, computer vision, and optimization, we show that deep distilling generates concise code that generalizes out-of-distribution to solve problems orders-of-magnitude larger and more complex than the training data. For problems with a known ground-truth rule set, deep distilling discovers the rule set exactly with scalable guarantees. For problems that are ambiguous or computationally intractable, the distilled rules are similar to existing human-derived algorithms and perform at par or better. Our approach demonstrates that unassisted machine intelligence can build generalizable and intuitive rules explaining patterns in large datasets that would otherwise overwhelm human reasoning.


title: Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Concepts

abstract: Most existing methods in vision language pre-training rely on object-centric features extracted through object detection and make fine-grained alignments between the extracted features and texts. It is challenging for these methods to learn relations among multiple objects. To this end, we propose a new method called X-VLM to perform `multi-grained vision language pre-training.' The key to learning multi-grained alignments is to locate visual concepts in the image given the associated texts, and in the meantime align the texts with the visual concepts, where the alignments are in multi-granularity. Experimental results show that X-VLM effectively leverages the learned multi-grained alignments to many downstream vision language tasks and consistently outperforms state-of-the-art methods.


title: Wyner-Ziv Gradient Compression for Federated Learning

abstract: Due to limited communication resources at the client and a massive number of model parameters, large-scale distributed learning tasks suffer from communication bottleneck. Gradient compression is an effective method to reduce communication load by transmitting compressed gradients. Motivated by the fact that in the scenario of stochastic gradients descent, gradients between adjacent rounds may have a high correlation since they wish to learn the same model, this paper proposes a practical gradient compression scheme for federated learning, which uses historical gradients to compress gradients and is based on Wyner-Ziv coding but without any probabilistic assumption. We also implement our gradient quantization method on the real dataset, and the performance of our method is better than the previous schemes.


title: Dependence of total kinetic energy of fission fragments on the excitation energy of fissioning systems

abstract: We elucidated the reason why the average total kinetic energy (TKE) of fission fragments decreases when the excitation energy of the fissioning systems increases as indicated by experimental data for the neutron-induced fission events. To explore this problem, we used a method based on the four-dimensional Langevin equations we have developed. We have calculated the TKE of fission fragments for fissioning systems $^{236}$U$^{*}$ and $^{240}$Pu$^{*}$ excited above respective fission barriers, and compared the results with experimental data for n + $^{235}$U and n + $^{239}$Pu reactions, respectively. From the Langevin-model analysis, we have found that the shape of the abundant heavy fragments changes from almost spherical for low excitation domain to highly prolate shape for high excitation energy, while that of the light fragments does not change noticeably. The change of the "shape" of the heavy fragments causes an increase of a distance between the charge centers of the nascent fragments just after scission as excitation energy increases. Accordingly, the Coulomb repulsion between the two fragments decreases with an increase of the excitation energy, which causes the decrease of the average TKE. In this manner, we found that the change of the shape of the heavy fragment as a function of the excitation energy is the key issue for the TKE of fission fragments to decrease as the excitation energy of the fissioning nuclei increases. In other words, washing out of the shell effects which affect the shape of the heavy fragments is the key reason for the decreasing energy dependence of the average TKE of the fission fragments.


title: Keypoint Message Passing for Video-based Person Re-Identification

abstract: Video-based person re-identification (re-ID) is an important technique in visual surveillance systems which aims to match video snippets of people captured by different cameras. Existing methods are mostly based on convolutional neural networks (CNNs), whose building blocks either process local neighbor pixels at a time, or, when 3D convolutions are used to model temporal information, suffer from the misalignment problem caused by person movement. In this paper, we propose to overcome the limitations of normal convolutions with a human-oriented graph method. Specifically, features located at person joint keypoints are extracted and connected as a spatial-temporal graph. These keypoint features are then updated by message passing from their connected nodes with a graph convolutional network (GCN). During training, the GCN can be attached to any CNN-based person re-ID model to assist representation learning on feature maps, whilst it can be dropped after training for better inference speed. Our method brings significant improvements over the CNN-based baseline model on the MARS dataset with generated person keypoints and a newly annotated dataset: PoseTrackReID. It also defines a new state-of-the-art method in terms of top-1 accuracy and mean average precision in comparison to prior works.