title: Attosecond photoelectron spectroscopy of helium doubly excited states

abstract: We describe a numerical method that simulates the interaction of the helium atom with sequences of femtosecond and attosecond light pulses. The method, which is based on the close-coupling expansion of the electronic configuration space in a B-spline bipolar spherical harmonic basis, can accurately reproduce the excitation and single ionization of the atom, within the electrostatic approximation. The time dependent Schr\"odinger equation is integrated with a sequence of second-order split-exponential unitary propagators. The asymptotic channel-, energy- and angularly-resolved photoelectron distributions are computed by projecting the wavepacket at the end of the simulation on the multichannel scattering states of the atom, which are separately computed within the same close-coupling basis. This method is applied to simulate the pump-probe ionization of helium in the vicinity of the $2s/2p$ excitation threshold of the He$^+$ ion. This work confirms the qualitative conclusions of one of our earliest publications [L Argenti and E Lindroth, Phys. Rev. Lett. {\bf 105}, 53002 (2010)], in which we demonstrated the control of the $2s/2p$ ionization branching-ratio. Here, we take those calculations to convergence and show how correlation brings the periodic modulation of the branching ratios in almost phase opposition. The residual total ionization probability to the $2s+2p$ channels is dominated by the beating between the $sp_{2,3}^+$ and the $sp_{2,4}^+$ doubly excited states, which is consistent with the modulation of the complementary signal in the $1s$ channel, measured in 2010 by Chang and co-workers~[S Gilbertson~\emph{et al.}, Phys. Rev. Lett. {\bf 105}, 263003 (2010)].


title: High power 1640-nm Er:Y2O3 ceramic laser at room temperature

abstract: We report on high power operation of Er:Y2O3 ceramic laser at ~1.6 {\mu}m using low scattering loss, 0.25 at.% Er3+ doped ceramic sample fabricated in-house via co-precipitation process. The laser is in-band pumped by an Er, Yb fiber laser at 1535.6 nm and generates 10.2 W of continuous-wave (CW) output power at 1640.4 nm with a slope efficiency of 25% with respect to the absorbed pump power. To the best of our knowledge, this is the first demonstration of ~1.6 {\mu}m Er:Y2O3 laser at room temperature. The prospects for further scaling in output power and lasing efficiency via low Er3+ doping and reduced energy-transfer upconversion are discussed.


title: Relativistic light sails need to billow

abstract: We argue that light sails that are rapidly accelerated to relativistic velocities by lasers must be significantly curved in order to reduce their mechanical stresses and avoid tears. Using an integrated opto-thermo-mechanical model, we show that the diameter and radius of curvature of a circular light sail should be comparable in magnitude, both on the order of a few meters in optimal designs for gram-scale payloads. Moreover, when sufficient laser power is available, a sail's acceleration length decreases and its chip payload capacity increases as its curvature increases. Our findings provide guidance for emerging light sail design programs, which herald a new era of interstellar space exploration.


title: Multipartite Correlated Majorization Criteria for Finite Discrete Probability

abstract: In this paper we study multipartite and correlated majorization of the finite discrete probability distributions emerging in quantum information theory. We start proving the subadditivity of the R\'{e}nyi and Burg entropies, and we show that the criteria for such a generalized majorization scheme can be provided solely in terms of the R\'{e}nyi and Burg entropies. Surprisingly, the same set of criteria applies both to the correlated and uncorrelated cases. Finally, based on our findings in majorization, we give a proof of the characterization of the R\'{e}nyi and Burg entropies in terms of continuity, symmetry and (sub)additivity.


title: Topological Toda lattice and nonlinear bulk-edge correspondence

abstract: The Toda lattice is a model of nonlinear wave equations allowing exact soliton solutions. It is realized by an electric circuit made of a transmission line with variable capacitance diodes and inductors. It has been generalized to the dimerized Toda lattice by introducing alternating bondings specified by a certain parameter $\lambda $, where it is reduced to the Toda lattice at $\lambda =0$. In this work, we investigate the topological dynamics of the voltage along the transmission line. It is demonstrated numerically that the system is topological for $\lambda <0$, while it is trivial for $\lambda >0$ with the phase transition point given by the original Toda lattice ($\lambda =0$). These topological behaviors are well explained by the chiral index familiar in the Su-Schrieffer-Heeger model. The topological phase transition is observable by a significant difference between the dynamics of voltages in the two phases, which is explained by the emergence of the topological edge states. This is a bulk-edge correspondence in nonlinear systems. The dimerized Toda lattice is adiabaticaly connected to a linear system, which would be the reason why the topological arguments are valid. Furthermore, we show that the topological edge state is robust against randomness.


title: Latency of Concatenating Unlicensed LPWAN with Cellular IoT: An Experimental QoE Study

abstract: Developing low-power wide-area network (LPWAN) solutions that are efficient to adopt, deploy and maintain are vital for smart cities. The poor quality-of-service of unlicensed LPWAN, and the high service cost of LTE-M/NB-IoT are key disadvantages of these technologies. Concatenating unlicensed with licensed LPWANs can overcome these limitations and harness their benefits. However, a concatenated LPWAN architecture will inevitably result in excess latency which may impact users' quality-of-experience (QoE). To evaluate the real-life feasibility of this system, we first propose a concatenated LPWAN architecture and experimentally measure the statistics of end-to-end (E2E) latencies. The concatenated delay margin is determined by benchmarking the latencies with different LPWAN architecture schemes, namely with unlicensed IoT (standalone LoRa), cellular IoT (standalone LTE-M), and concatenated IoT (LoRa interfaced with LTE-M). Through extensive experimental measurement campaigns of 30,000 data points of E2E latencies, we show that the excess delay due to LPWAN interfacing introduces on average less than 300 milliseconds. The proof-of-concept results suggest that the latency for concatenating unlicensed LPWAN with cellular IoT is negligible for smart city use cases where human perception and decision making is in the loop.


title: Parametric Toricity of Steady State Varieties of Reaction Networks

abstract: We study real steady state varieties of the dynamics of chemical reaction networks. The dynamics are derived using mass action kinetics with parametric reaction rates. The models studied are not inherently parametric in nature. Rather, our interest in parameters is motivated by parameter uncertainty, as reaction rates are typically either measured with limited precision or estimated. We aim at detecting toricity and shifted toricity, using a framework that has been recently introduced and studied for the non-parametric case over both the real and the complex numbers. While toricity requires that the variety specifies a subgroup of the direct power of the multiplicative group of the underlying field, shifted toricity requires only a coset. In the non-parametric case these requirements establish real decision problems. In the presence of parameters we must go further and derive necessary and sufficient conditions in the parameters for toricity or shifted toricity to hold. Technically, we use real quantifier elimination methods. Our computations on biological networks here once more confirm shifted toricity as a relevant concept, while toricity holds only for degenerate parameter choices.


title: Projection-Based Reduced Order Model and Machine Learning Closure for Transient Simulations of High-Re Flows

abstract: The paper presents a Projection-Based Reduced-Order Model for simulations of high Reynolds turbulent flows. The PBROM are enhanced by incorporating various models of turbulent viscosity and residual closures to model the effects of interactions among the modes and energy dissipations. Remarkable improvements in prediction accuracies are achieved with a suitable turbulent viscosity model and a residual closure. The enhanced PBROM models are demonstrated for high-Re flows past a cylinder in two- and three- dimensions. These enhancements have shown capable of capturing complex flow features and removing unnecessary ones, while not affecting the efficiency of the overall model.


title: Multiplicity one for the pair (GL(n,D),GL(n,E))

abstract: Let F be a local field of characteristic zero. Let D be a quaternion algebra over F. Let E be a quadratic field extension of F. Let {\mu} be a character of GL(1,E). We study the distinction problem for the pair (GL(n,D), GL(n,E)) and we prove that any bi-(GL(n,E), {\mu})-equivariant tempered generalized function on GL(n,D) is invariant with respect to an anti-involution. Then it implies that dimHom({\pi},{\mu}) is at most 1 by the generalized Gelfand-Kazhdan criterion. Thus we give a new proof to the fact that (GL(2n,F),GL(n,E)) is a Gelfand pair when {\mu} is trivial and D splits.


title: Synchronous Pre-biasing of Triboelectric Nanogenerator for Enhanced Energy Extraction

abstract: Triboelectric Nanogenerator (TENG) is a class of ambient mechanical energy harvesters used to augment the battery life of electronic devices such as sensors in implantables, wearables, and Internet of Things (IoT) applications. In this work, the fundamentals of pre-biasing (pre-charging) the TENG at the start of the operation cycle to enhance the per-cycle extracted energy is presented. The energy gain is mathematically formulated, and the optimum pre-biasing voltage (equivalently charge) is derived by analyzing the energy exchange between the mechanical and the electrical domain over a periodic cycle. Further, a novel Energy Extraction Circuit (EEC) termed as "Pre-biased Synchronous Charge Extraction (pSCE)" is introduced to 1) Realize synchronous pre-biasing of TENG using the load battery itself and 2) Achieve enhanced energy extraction from TENG. Energy output per-cycle is derived analytically for the pSCE circuit and compared to the state of the art Synchronous Charge Extraction (SCE) circuit. The experimental implementation is performed for the proposed pSCE circuit that shows a 6.65 fold gain over the Full Wave Rectifier (standard EEC) and 1.45 over the SCE circuit for a 5V battery load.


title: From Chaos to Pseudo-Randomness: A Case Study on the 2D Coupled Map Lattice

abstract: Applying chaos theory for secure digital communications is promising and it is well acknowledged that in such applications the underlying chaotic systems should be carefully chosen. However, the requirements imposed on the chaotic systems are usually heuristic, without theoretic guarantee for the resultant communication scheme. Among all the primitives for secure communications, it is well-accepted that (pseudo) random numbers are most essential. Taking the well-studied two-dimensional coupled map lattice (2D CML) as an example, this paper performs a theoretical study towards pseudo-random number generation with the 2D CML. In so doing, an analytical expression of the Lyapunov exponent (LE) spectrum of the 2D CML is first derived. Using the LEs, one can configure system parameters to ensure the 2D CML only exhibits complex dynamic behavior, and then collect pseudo-random numbers from the system orbits. Moreover, based on the observation that least significant bit distributes more evenly in the (pseudo) random distribution, an extraction algorithm E is developed with the property that, when applied to the orbits of the 2D CML, it can squeeze uniform bits. In implementation, if fixed-point arithmetic is used in binary format with a precision of $z$ bits after the radix point, E can ensure that the deviation of the squeezed bits is bounded by $2^{-z}$ . Further simulation results demonstrate that the new method not only guide the 2D CML model to exhibit complex dynamic behavior, but also generate uniformly distributed independent bits. In particular, the squeezed pseudo random bits can pass both NIST 800-22 and TestU01 test suites in various settings. This study thereby provides a theoretical basis for effectively applying the 2D CML to secure communications.


title: Existence result for fractional problems with logarithmic and critical exponential nonlinearities

abstract: We study the existence of nontrivial solutions for a nonlinear fractional elliptic equation in presence of logarithmic and critical exponential nonlinearities. This problem extends [5] to fractional $N/s$-Laplacian equations with logarithmic nonlinearity. We overcome the lack of compactness due to the critical exponential nonlinearity by using the fractional Trudinger-Moser inequality. The existence result is established via critical point theory.


title: Coarse to Fine Multi-Resolution Temporal Convolutional Network

abstract: Temporal convolutional networks (TCNs) are a commonly used architecture for temporal video segmentation. TCNs however, tend to suffer from over-segmentation errors and require additional refinement modules to ensure smoothness and temporal coherency. In this work, we propose a novel temporal encoder-decoder to tackle the problem of sequence fragmentation. In particular, the decoder follows a coarse-to-fine structure with an implicit ensemble of multiple temporal resolutions. The ensembling produces smoother segmentations that are more accurate and better-calibrated, bypassing the need for additional refinement modules. In addition, we enhance our training with a multi-resolution feature-augmentation strategy to promote robustness to varying temporal resolutions. Finally, to support our architecture and encourage further sequence coherency, we propose an action loss that penalizes misclassifications at the video level. Experiments show that our stand-alone architecture, together with our novel feature-augmentation strategy and new loss, outperforms the state-of-the-art on three temporal video segmentation benchmarks.


title: FCCDN: Feature Constraint Network for VHR Image Change Detection

abstract: Change detection is the process of identifying pixelwise differences in bitemporal co-registered images. It is of great significance to Earth observations. Recently, with the emergence of deep learning (DL), the power and feasibility of deep convolutional neural network (CNN)-based methods have been shown in the field of change detection. However, there is still a lack of effective supervision for change feature learning. In this work, a feature constraint change detection network (FCCDN) is proposed. We constrain features both in bitemporal feature extraction and feature fusion. More specifically, we propose a dual encoder-decoder network backbone for the change detection task. At the center of the backbone, we design a nonlocal feature pyramid network to extract and fuse multiscale features. To fuse bitemporal features in a robust way, we build a dense connection-based feature fusion module. Moreover, a self-supervised learning-based strategy is proposed to constrain feature learning. Based on FCCDN, we achieve state-of-the-art performance on two building change detection datasets (LEVIR-CD and WHU). On the LEVIR-CD dataset, we achieve an IoU of 0.8569 and an F1 score of 0.9229. On the WHU dataset, we achieve an IoU of 0.8820 and an F1 score of 0.9373. Moreover, for the first time, the acquisition of accurate bitemporal semantic segmentation results is achieved without using semantic segmentation labels. This is vital for the application of change detection because it saves the cost of labeling.


title: RST Parsing from Scratch

abstract: We introduce a novel top-down end-to-end formulation of document-level discourse parsing in the Rhetorical Structure Theory (RST) framework. In this formulation, we consider discourse parsing as a sequence of splitting decisions at token boundaries and use a seq2seq network to model the splitting decisions. Our framework facilitates discourse parsing from scratch without requiring discourse segmentation as a prerequisite; rather, it yields segmentation as part of the parsing process. Our unified parsing model adopts a beam search to decode the best tree structure by searching through a space of high-scoring trees. With extensive experiments on the standard English RST discourse treebank, we demonstrate that our parser outperforms existing methods by a good margin in both end-to-end parsing and parsing with gold segmentation. More importantly, it does so without using any handcrafted features, making it faster and easily adaptable to new languages and domains.


title: Hypergraph Pre-training with Graph Neural Networks

abstract: Despite the prevalence of hypergraphs in a variety of high-impact applications, there are relatively few works on hypergraph representation learning, most of which primarily focus on hyperlink prediction, often restricted to the transductive learning setting. Among others, a major hurdle for effective hypergraph representation learning lies in the label scarcity of nodes and/or hyperedges. To address this issue, this paper presents an end-to-end, bi-level pre-training strategy with Graph Neural Networks for hypergraphs. The proposed framework named HyperGene bears three distinctive advantages. First, it is capable of ingesting the labeling information when available, but more importantly, it is mainly designed in the self-supervised fashion which significantly broadens its applicability. Second, at the heart of the proposed HyperGene are two carefully designed pretexts, one on the node level and the other on the hyperedge level, which enable us to encode both the local and the global context in a mutually complementary way. Third, the proposed framework can work in both transductive and inductive settings. When applying the two proposed pretexts in tandem, it can accelerate the adaptation of the knowledge from the pre-trained model to downstream applications in the transductive setting, thanks to the bi-level nature of the proposed method. The extensive experimental results demonstrate that: (1) HyperGene achieves up to 5.69% improvements in hyperedge classification, and (2) improves pre-training efficiency by up to 42.80% on average.


title: Selberg's Central limit theorem for quadratic Dirichlet L-functions over function fields

abstract: In this article, we study the logarithm of the central value $L\left(\frac{1}{2}, \chi_D\right)$ in the symplectic family of Dirichlet $L$-functions associated with the hyperelliptic curve of genus $\delta$ over a fixed finite field $\mathbb{F}_q$ in the limit as $\delta\to \infty$. Unconditionally, we show that the distribution of $\log \big|L\left(\frac{1}{2}, \chi_D\right)\big|$ is asymptotically bounded above by the Gaussian distribution of mean $\frac{1}{2}\log \deg(D)$ and variance $\log \deg(D)$. Assuming a mild condition on the distribution of the low-lying zeros in this family, we obtain the full Gaussian distribution.


title: Drag of Two Cylindrical Intruders in a Two-Dimensional Granular Environment

abstract: The drag of two cylindrical intruders in a two-dimensional granular environment is numerically studied by the discrete element method. We find the yield force, below which the intruders cannot move because of interactions with the surrounding particles. Above the yield force, on the other hand, the intruders can move at a constant speed. We investigate the relationship between the drag force and the steady speed of the intruders, where the speed becomes higher as the distance between the intruders decreases. We confirm that the origin of the yield is the Coulombic friction between the particles and the bottom plate by changing the value of the friction coefficient. We also find that the yield force is almost proportional to the friction coefficient, which means that the number of particles determining the yield force is almost constant. On the other hand, the two-dimensional elasticity is applicable to determine the stress fields around the intruders. We confirm that fields asymmetric with respect to the drag direction are reproduced by using the information of the stresses on the surfaces of the intruders by introducing bipolar coordinates.


title: Blessing or Curse of Democracy?: Current Evidence from the Covid-19 Pandemic

abstract: Background: A major question in Covid-19 research is whether democracies handled the Covid-19 pandemic crisis better or worse than authoritarian countries. However, it is important to consider the issues of democracy versus authoritarianism, and state fragility, when examining official Covid-19 death counts in research, because these factors can influence the accurate reporting of pandemic deaths by governments. In contrast, excess deaths are less prone to variability in differences in definitions of Covid-19 deaths and testing capacities across countries. Here we use excess pandemic deaths to explore potential relationships between political systems and public health outcomes. Methods: We address these issues by comparing the official government Covid-19 death counts in a well-established John Hopkins database to the generally more reliable excess mortality measure of Covid-19 deaths, taken from the recently released World Mortality Dataset. We put the comparison in the context of the political and fragile state dimensions. Findings: We find (1) significant potential underreporting of Covid-19 deaths by authoritarian governments and governments with high state fragility and (2) substantial geographic variation among countries and regions with regard to standard democracy indices. Additionally, we find that more authoritarian governments are (weakly) associated with more excess deaths during the pandemic than democratic governments. Interpretations: The inhibition and censorship of information flows, inherent to authoritarian states, likely results in major inaccuracies in pandemic statistics that confound global public health analyses. Thus, both excess pandemic deaths and official Covid-19 death counts should be examined in studies using death as an outcome variable.


title: Towards Artificial Intelligence Enabled Financial Crime Detection

abstract: Recently, financial institutes have been dealing with an increase in financial crimes. In this context, financial services firms started to improve their vigilance and use new technologies and approaches to identify and predict financial fraud and crime possibilities. This task is challenging as institutions need to upgrade their data and analytics capabilities to enable new technologies such as Artificial Intelligence (AI) to predict and detect financial crimes. In this paper, we put a step towards AI-enabled financial crime detection in general and money laundering detection in particular to address this challenge. We study and analyse the recent works done in financial crime detection and present a novel model to detect money laundering cases with minimum human intervention needs.


title: EXoN: EXplainable encoder Network

abstract: We propose a new semi-supervised learning method of Variational AutoEncoder (VAE) which yields a customized and explainable latent space by EXplainable encoder Network (EXoN). Customization means a manual design of latent space layout for specific labeled data. To improve the performance of our VAE in a classification task without the loss of performance as a generative model, we employ a new semi-supervised classification method called SCI (Soft-label Consistency Interpolation). The classification loss and the Kullback-Leibler divergence play a crucial role in constructing explainable latent space. The variability of generated samples from our proposed model depends on a specific subspace, called activated latent subspace. Our numerical results with MNIST and CIFAR-10 datasets show that EXoN produces an explainable latent space and reduces the cost of investigating representation patterns on the latent space.


title: CITIES: Contextual Inference of Tail-Item Embeddings for Sequential Recommendation

abstract: Sequential recommendation techniques provide users with product recommendations fitting their current preferences by handling dynamic user preferences over time. Previous studies have focused on modeling sequential dynamics without much regard to which of the best-selling products (i.e., head items) or niche products (i.e., tail items) should be recommended. We scrutinize the structural reason for why tail items are barely served in the current sequential recommendation model, which consists of an item-embedding layer, a sequence-modeling layer, and a recommendation layer. Well-designed sequence-modeling and recommendation layers are expected to naturally learn suitable item embeddings. However, tail items are likely to fall short of this expectation because the current model structure is not suitable for learning high-quality embeddings with insufficient data. Thus, tail items are rarely recommended. To eliminate this issue, we propose a framework called CITIES, which aims to enhance the quality of the tail-item embeddings by training an embedding-inference function using multiple contextual head items so that the recommendation performance improves for not only the tail items but also for the head items. Moreover, our framework can infer new-item embeddings without an additional learning process. Extensive experiments on two real-world datasets show that applying CITIES to the state-of-the-art methods improves recommendation performance for both tail and head items. We conduct an additional experiment to verify that CITIES can infer suitable new-item embeddings as well.


title: Insect-Computer Hybrid System for Autonomous Search and Rescue Mission

abstract: There is still a long way to go before artificial mini robots are really used for search and rescue missions in disaster-hit areas due to hindrance in power consumption, computation load of the locomotion, and obstacle-avoidance system. Insect-computer hybrid system, which is the fusion of living insect platform and microcontroller, emerges as an alternative solution. This study demonstrates the first-ever insect-computer hybrid system conceived for search and rescue missions, which is capable of autonomous navigation and human presence detection in an unstructured environment. Customized navigation control algorithm utilizing the insect's intrinsic navigation capability achieved exploration and negotiation of complex terrains. On-board high-accuracy human presence detection using infrared camera was achieved with a custom machine learning model. Low power consumption suggests system suitability for hour-long operations and its potential for realization in real-life missions.


title: A recursion formula for the generalized Euler function $ \varphi_e(n) $

abstract: In this paper, basing on the linear algebra methods and elementary techniques, for any positive integers $ e $ and $ n $, we obtain a recursion formula for the generalized Euler function $ \varphi_e(n) $, which is determined by some matrices related to a congruence equation modulo $ e $. Furthermore, through the recursion formula, we get the explicit formula for $ \varphi_5(n) $. Our results generalize the corresponding results in \cite{A4,A8,A10,A11}.


title: Financial Time Series Analysis and Forecasting with HHT Feature Generation and Machine Learning

abstract: We present the method of complementary ensemble empirical mode decomposition (CEEMD) and Hilbert-Huang transform (HHT) for analyzing nonstationary financial time series. This noise-assisted approach decomposes any time series into a number of intrinsic mode functions, along with the corresponding instantaneous amplitudes and instantaneous frequencies. Different combinations of modes allow us to reconstruct the time series using components of different timescales. We then apply Hilbert spectral analysis to define and compute the associated instantaneous energy-frequency spectrum to illustrate the properties of various timescales embedded in the original time series. Using HHT, we generate a collection of new features and integrate them into machine learning models, such as regression tree ensemble, support vector machine (SVM), and long short-term memory (LSTM) neural network. Using empirical financial data, we compare several HHT-enhanced machine learning models in terms of forecasting performance.


title: CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes

abstract: Malicious applications of deepfakes (i.e., technologies generating target facial attributes or entire faces from facial images) have posed a huge threat to individuals' reputation and security. To mitigate these threats, recent studies have proposed adversarial watermarks to combat deepfake models, leading them to generate distorted outputs. Despite achieving impressive results, these adversarial watermarks have low image-level and model-level transferability, meaning that they can protect only one facial image from one specific deepfake model. To address these issues, we propose a novel solution that can generate a Cross-Model Universal Adversarial Watermark (CMUA-Watermark), protecting a large number of facial images from multiple deepfake models. Specifically, we begin by proposing a cross-model universal attack pipeline that attacks multiple deepfake models iteratively. Then, we design a two-level perturbation fusion strategy to alleviate the conflict between the adversarial watermarks generated by different facial images and models. Moreover, we address the key problem in cross-model optimization with a heuristic approach to automatically find the suitable attack step sizes for different models, further weakening the model-level conflict. Finally, we introduce a more reasonable and comprehensive evaluation method to fully test the proposed method and compare it with existing ones. Extensive experimental results demonstrate that the proposed CMUA-Watermark can effectively distort the fake facial images generated by multiple deepfake models while achieving a better performance than existing methods.


title: Gravitational lensing $H_0$ tension from ultralight axion galactic cores

abstract: Gravitational lensing time delays offer an avenue to measure the Hubble parameter $H_0$, with some analyses suggesting a tension with early-type probes of $H_0$. The lensing measurements must mitigate systematic uncertainties due to the mass modelling of lens galaxies. In particular, a core component in the lens density profile would form an approximate local mass sheet degeneracy and could bias $H_0$ in the right direction to solve the lensing tension. We consider ultralight dark matter as a possible mechanism to generate such galactic cores. We show that cores of roughly the required properties could arise naturally if an ultralight axion of mass $m\sim10^{-25}$ eV makes up a fraction of order ten percent of the total cosmological dark matter density. A relic abundance of this order of magnitude could come from vacuum misalignment. Stellar kinematics measurements of well-resolved massive galaxies (including the Milky Way) may offer a way to test the scenario. Kinematics analyses aiming to test the core hypothesis in massive elliptical lens galaxies should not, in general, adopt the perfect mass sheet limit, as ignoring the finite extent of an actual physical core could lead to significant systematic errors.


title: From Impurity Doping to Metallic Growth in Diffusion Doping: Properties and Structure of Ag Doped InAs Nanocrystals

abstract: Tuning of the electronic properties of pre-synthesized colloidal semiconductor nanocrystals (NCs) by doping plays a key role in the prospect of implementing them in printed electronics devices such as transistors, and photodetectors. While such impurity doping reactions have already been introduced, the understanding of the doping process, the nature of interaction between the impurity and host atoms, and the conditions affecting the solubility limit of impurities in nanocrystals are still unclear. Here, we used a post-synthesis diffusion based doping reaction to introduce Ag impurities into InAs NCs. Optical absorption spectroscopy along with analytical inductively coupled plasma mass-spectroscopy (ICP-MS) were used to present a two stage doping model consisting of a "doping region" and a "growth region", depending on the concentration of the impurities in the reaction vessel. X-ray absorption fine-structure (XAFS) spectroscopy was employed to determine the impurity location and correlate between the structural and electronic properties for different sizes of InAs NCs and dopant concentrations. The resulting structural model describes a heterogeneous system where the impurities initially dope the NC, by substituting for In atoms near the surface of the NC, until the "solubility limit" is reached, after which the rapid growth and formation of metallic structures are identified.


title: Multifunctional operation of the double-layer ferromagnetic structure coupled by a rectangular nanoresonator

abstract: The use of spin waves as a signal carrier requires developing the functional elements allowing for multiplexing and demultiplexing information coded at different wavelengths. For this purpose, we propose a system of thin ferromagnetic layers dynamically coupled by a rectangular ferromagnetic resonator. We show that a single and double, clockwise and counter-clockwise, circulating modes of the resonator offer a wide possibility of control of propagating waves. Particularly, at frequency related to the double-clockwise circulating spin-wave mode of the resonator, the spin wave excited in one layer is transferred to the second one where it propagates in the backward direction. Interestingly, the wave excited in the second layer propagates in the forward direction only in that layer. This demonstrates add-drop filtering, as well as circulator functionality. Thus, the proposed system can become an important part of future magnonic technology for signal routing.


title: The current-type quadrupole moment and gravitational-wave mode $(\ell,m)=(2,1)$ of compact binary systems at the third post-Newtonian order

abstract: Up to the third post-Newtonian (3PN) order, we compute (i) the current-type quadrupole moment of (non-spinning) compact binary systems, as well as (ii) the corresponding gravitational-wave mode $(2,1)$ (constituting a 3.5PN correction in the waveform). Moreover, at this occasion, (iii) we recompute and confirm the previous calculation of the mass-type octupole moment to 3PN order. The ultra-violet (UV) divergences due to the point-like nature of the source are treated by means of dimensional regularization. This entails generalizing the definition of the irreducible mass and current multipole moments of an isolated PN source in $d$ spatial dimensions. In particular, we find that the current type moment has the symmetry of a particular mixed Young tableau and that, in addition, there appears a third type of moment which is however inexistent in 3 spatial dimensions.


title: Heavily Doped Semiconductor Nanocrystal Quantum Dots

abstract: Doping of semiconductors by impurity atoms enabled their widespread technological application in micro and opto-electronics. For colloidal semiconductor nanocrystals, an emerging family of materials where size, composition and shape-control offer widely tunable optical and electronic properties, doping has proven elusive. This arises both from the synthetic challenge of how to introduce single impurities and from a lack of fundamental understanding of this heavily doped limit under strong quantum confinement. We develop a method to dope semiconductor nanocrystals with metal impurities providing control of the band gap and Fermi energy. A combination of optical measurements, scanning tunneling spectroscopy and theory revealed the emergence of a confined impurity band and band-tailing. Successful control of doping and its understanding provide n- and p-doped semiconductor nanocrystals which greatly enhance the potential application of such materials in solar cells, thin-film transistors, and optoelectronic devices.


title: DepressionNet: A Novel Summarization Boosted Deep Framework for Depression Detection on Social Media

abstract: Twitter is currently a popular online social media platform which allows users to share their user-generated content. This publicly-generated user data is also crucial to healthcare technologies because the discovered patterns would hugely benefit them in several ways. One of the applications is in automatically discovering mental health problems, e.g., depression. Previous studies to automatically detect a depressed user on online social media have largely relied upon the user behaviour and their linguistic patterns including user's social interactions. The downside is that these models are trained on several irrelevant content which might not be crucial towards detecting a depressed user. Besides, these content have a negative impact on the overall efficiency and effectiveness of the model. To overcome the shortcomings in the existing automatic depression detection methods, we propose a novel computational framework for automatic depression detection that initially selects relevant content through a hybrid extractive and abstractive summarization strategy on the sequence of all user tweets leading to a more fine-grained and relevant content. The content then goes to our novel deep learning framework comprising of a unified learning machinery comprising of Convolutional Neural Network (CNN) coupled with attention-enhanced Gated Recurrent Units (GRU) models leading to better empirical performance than existing strong baselines.


title: Precise Approximation of Convolutional Neural Networks for Homomorphically Encrypted Data

abstract: Homomorphic encryption is one of the representative solutions to privacy-preserving machine learning (PPML) classification enabling the server to classify private data of clients while guaranteeing privacy. This work focuses on PPML using word-wise fully homomorphic encryption (FHE). In order to implement deep learning on word-wise homomorphic encryption (HE), the ReLU and max-pooling functions should be approximated by some polynomials for homomorphic operations. Most of the previous studies focus on HE-friendly networks, where the ReLU and max-pooling functions are approximated using low-degree polynomials. However, for the classification of the CIFAR-10 dataset, using a low-degree polynomial requires designing a new deep learning model and training. In addition, this approximation by low-degree polynomials cannot support deeper neural networks due to large approximation errors. Thus, we propose a precise polynomial approximation technique for the ReLU and max-pooling functions. Precise approximation using a single polynomial requires an exponentially high-degree polynomial, which results in a significant number of non-scalar multiplications. Thus, we propose a method to approximate the ReLU and max-pooling functions accurately using a composition of minimax approximate polynomials of small degrees. If we replace the ReLU and max-pooling functions with the proposed approximate polynomials, well-studied deep learning models such as ResNet and VGGNet can still be used without further modification for PPML on FHE. Even pre-trained parameters can be used without retraining. We approximate the ReLU and max-pooling functions in the ResNet-152 using the composition of minimax approximate polynomials of degrees 15, 27, and 29. Then, we succeed in classifying the plaintext ImageNet dataset with 77.52% accuracy, which is very close to the original model accuracy of 78.31%.


title: RtFPS: An Interactive Map that Visualizes and Predicts Wildfires in the US

abstract: Climate change has largely impacted our daily lives. As one of its consequences, we are experiencing more wildfires. In the year 2020, wildfires burned a record number of 8,888,297 acres in the US. To awaken people's attention to climate change, and to visualize the current risk of wildfires, We developed RtFPS, "Real-Time Fire Prediction System". It provides a real-time prediction visualization of wildfire risk at specific locations base on a Machine Learning model. It also provides interactive map features that show the historical wildfire events with environmental info.


title: InAs nanocrystals with robust p-type doping

abstract: Robust control over the carrier type is fundamental for the fabrication of nanocrystal-based optoelectronic devices, such as the p-n homojunction, but effective incorporation of impurities in semiconductor nanocrystals and its characterization is highly challenging due to their small size. Herein, InAs nanocrystals, post-synthetically doped with Cd, serve as a model system for successful p-type doping of originally n-type InAs nanocrystals, as demonstrated in field-effect transistors (FETs). Advanced structural analysis, using atomic resolution electron microscopy and synchrotron X-ray absorption fine structure spectroscopy reveal that Cd impurities reside near and on the nanocrystal surface acting as substitutional p-dopants replacing Indium. Commensurately, Cd-doped InAs FETs exhibited remarkable stability of their hole conduction, mobility, and hysteretic behavior over time when exposed to air, while intrinsic InAs NCs FETs were easily oxidized and their performance quickly declined. Therefore, Cd plays a dual role acting as a p-type dopant, and also protects the nanocrystals from oxidation, as evidenced directly by Xray photoelectron spectroscopy measurements of air-exposed samples of intrinsic and Cd doped InAs NCs films. This study demonstrates robust p-type doping of InAs nanocrystals, setting the stage for implementation of such doped nanocrystal systems in printed electronic devices.


title: Weakly-supervised 3D Human Pose Estimation with Cross-view U-shaped Graph Convolutional Network

abstract: Although monocular 3D human pose estimation methods have made significant progress, it is far from being solved due to the inherent depth ambiguity. Instead, exploiting multi-view information is a practical way to achieve absolute 3D human pose estimation. In this paper, we propose a simple yet effective pipeline for weakly-supervised cross-view 3D human pose estimation. By only using two camera views, our method can achieve state-of-the-art performance in a weakly-supervised manner, requiring no 3D ground truth but only 2D annotations. Specifically, our method contains two steps: triangulation and refinement. First, given the 2D keypoints that can be obtained through any classic 2D detection methods, triangulation is performed across two views to lift the 2D keypoints into coarse 3D poses. Then, a novel cross-view U-shaped graph convolutional network (CV-UGCN), which can explore the spatial configurations and cross-view correlations, is designed to refine the coarse 3D poses. In particular, the refinement progress is achieved through weakly-supervised learning, in which geometric and structure-aware consistency checks are performed. We evaluate our method on the standard benchmark dataset, Human3.6M. The Mean Per Joint Position Error on the benchmark dataset is 27.4 mm, which outperforms existing state-of-the-art methods remarkably (27.4 mm vs 30.2 mm).


title: Byzantine-Resilient Federated Machine Learning via Over-the-Air Computation

abstract: Federated learning (FL) is recognized as a key enabling technology to provide intelligent services for future wireless networks and industrial systems with delay and privacy guarantees. However, the performance of wireless FL can be significantly degraded by Byzantine attack, such as data poisoning attack, model poisoning attack and free-riding attack. To design the Byzantine-resilient FL paradigm in wireless networks with limited radio resources, we propose a novel communication-efficient robust model aggregation scheme via over-the-air computation (AirComp). This is achieved by applying the Weiszfeld algorithm to obtain the smoothed geometric median aggregation against Byzantine attack. The additive structure of the Weiszfeld algorithm is further leveraged to match the signal superposition property of multiple-access channels via AirComp, thereby expediting the communication-efficient secure aggregation process of FL. Numerical results demonstrate the robustness against Byzantine devices and good learning performance of the proposed approach.


title: THP: Topological Hawkes Processes for Learning Causal Structure on Event Sequences

abstract: Learning causal structure among event types on multi-type event sequences is an important but challenging task. Existing methods, such as the Multivariate Hawkes processes, mostly assumed that each sequence is independent and identically distributed. However, in many real-world applications, it is commonplace to encounter a topological network behind the event sequences such that an event is excited or inhibited not only by its history but also by its topological neighbors. Consequently, the failure in describing the topological dependency among the event sequences leads to the error detection of the causal structure. By considering the Hawkes processes from the view of temporal convolution, we propose a Topological Hawkes process (THP) to draw a connection between the graph convolution in the topology domain and the temporal convolution in time domains. We further propose a causal structure learning method on THP in a likelihood framework. The proposed method is featured with the graph convolution-based likelihood function of THP and a sparse optimization scheme with an Expectation-Maximization of the likelihood function. Theoretical analysis and experiments on both synthetic and real-world data demonstrate the effectiveness of the proposed method


title: Synthesis of InAs/CdSe/ZnSe Core/Shell1/Shell2 Structures with Bright and Stable Near-Infrared Fluorescence

abstract: A complex InAs/CdSe/ZnSe Core/Shell1/Shell2 (CSS) structure is synthesized, where the intermediate CdSe buffer layer decreases strain between the InAs core and the ZnSe outer shell. This structure leads to significantly improved fluorescence quantum yield as compared to previously prepared core/shell structures and enables growth of much thicker shells. The shell growth is done using a layer-by-layer method in which the shell cation and anion precursors are added sequentially allowing for excellent control and a good size distribution is maintained throughout the entire growth process. The CSS structure is characterized using transmission electron microscopy, as well as by X-ray diffraction and X-ray-photoelectron spectroscopy which provide evidence for shell growth. The quantum yield for CSS with small InAs cores reaches over 70% - exceptional photoluminescence intensity for III-V semiconductor nanocrystals. In larger InAs cores there is a systematic decrease in the quantum yield, with a yield of ~40% for intermediate size cores down to a few percent in large cores. The CSS structures also exhibit very good photostability, vastly improved over those of organically coated cores, and transformation into water environment via ligand exchange is performed without significant decrease of the quantum yield. These new InAs/CdSe/ZnSe CSS nanocrystals are therefore promising near-IR chromophores for biological fluorescence tagging and optoelectronic devices.


title: VS-Net: Voting with Segmentation for Visual Localization

abstract: Visual localization is of great importance in robotics and computer vision. Recently, scene coordinate regression based methods have shown good performance in visual localization in small static scenes. However, it still estimates camera poses from many inferior scene coordinates. To address this problem, we propose a novel visual localization framework that establishes 2D-to-3D correspondences between the query image and the 3D map with a series of learnable scene-specific landmarks. In the landmark generation stage, the 3D surfaces of the target scene are over-segmented into mosaic patches whose centers are regarded as the scene-specific landmarks. To robustly and accurately recover the scene-specific landmarks, we propose the Voting with Segmentation Network (VS-Net) to segment the pixels into different landmark patches with a segmentation branch and estimate the landmark locations within each patch with a landmark location voting branch. Since the number of landmarks in a scene may reach up to 5000, training a segmentation network with such a large number of classes is both computation and memory costly for the commonly used cross-entropy loss. We propose a novel prototype-based triplet loss with hard negative mining, which is able to train semantic segmentation networks with a large number of labels efficiently. Our proposed VS-Net is extensively tested on multiple public benchmarks and can outperform state-of-the-art visual localization methods. Code and models are available at \href{https://github.com/zju3dv/VS-Net}{https://github.com/zju3dv/VS-Net}.


title: Resonance-like structure near the $\eta d$ threshold in the $\gamma{d}${$\to$}$\pi^0\eta{d}$ reaction

abstract: To investigate the interaction between the nucleon $N$ and nucleon resonance $N(1535)1/2^-$, the $\eta d$ threshold structure connected to the isoscalar $S$-wave $N$-$N(1535)1/2^-$ system has been experimentally studied in the $\gamma{d}${$\to$}$\pi^0\eta{d}$ reaction at incident photon energies ranging from the reaction threshold to 1.15 GeV. A strong enhancement is observed near the $\eta d$ threshold over the three-body phase-space contribution in the $\eta d$ invariant-mass distribution. An analysis incorporating the known isovector resonance $\mathcal{D}_{12}$ with a spin-parity of $2^+$ in the $\pi^0d$ channel reveals the existence of a narrow isoscalar resonance-like structure with $1^-$ in the $\eta d$ system. Using a Flatt\'e parametrization, the mass is found to be $2.427_{-0.006}^{+0.013}$ GeV, close to the $\eta d$ threshold, and the width is $\left(0.029_{-0.029}^{+0.006}{\rm\ GeV}\right)+\left(0.00_{-0.00}^{+0.41}\right) p_\eta c$, where $p_\eta$ denotes the $\eta$ momentum in the rest frame of the $\eta d$ system. The observed structure would be attributed to a predicted isoscalar $1^-$ $\eta NN$ bound state from $\eta NN$ and $\pi NN$ coupled-channel calculation, or an $\eta d$ virtual state owing to strong $\eta d$ attraction.


title: A Bayesian approach for partial Gaussian graphical models with sparsity

abstract: We explore various Bayesian approaches to estimate partial Gaussian graphical models. Our hierarchical structures enable to deal with single-output as well as multiple-output linear regressions, in small or high dimension, enforcing either no sparsity, sparsity, group sparsity or even sparse-group sparsity for a bi-level selection through partial correlations (direct links) between predictors and responses, thanks to spike-and-slab priors corresponding to each setting. Adaptative and global shrinkages are also incorporated in the Bayesian modeling of the direct links. An existing result for model selection consistency is reformulated to stick to our sparse and group-sparse settings, providing a theoretical guarantee under some technical assumptions. Gibbs samplers are developed and a simulation study shows the efficiency of our models which give very competitive results, especially in terms of support recovery. To conclude, a real dataset is investigated.


title: Application of mixed-variable physics-informed neural networks to solve normalised momentum and energy transport equations for 2D internal convective flow

abstract: The prohibitive cost and low fidelity of experimental data in industry scale thermofluid systems limit the usefulness of pure data-driven machine learning methods. Physics-informed neural networks (PINN) strive to overcome this by embedding the physics equations in the construction of the neural network loss function. In the present paper, the mixed-variable PINN methodology is applied to develop steady-state and transient surrogate models of incompressible laminar flow with heat transfer through a 2D internal domain with obstructions. Automatic spatial and temporal differentiation is applied to the partial differential equations for mass, momentum and energy conservation, and the residuals are included in the loss function, together with the boundary and initial values. Good agreement is obtained between the PINN and CFD results for both the steady-state and transient cases, but normalization of the PDEs proves to be crucial. Although this proves the ability of the PINN approach to solve multiple physics-based PDEs on a single domain, the PINN takes significantly longer to solve than the traditional finite volume numerical methods utilized in commercial CFD software.


title: Bayesian Effect Selection for Additive Quantile Regression with an Analysis to Air Pollution Thresholds

abstract: Statistical techniques used in air pollution modelling usually lack the possibility to understand which predictors affect air pollution in which functional form; and are not able to regress on exceedances over certain thresholds imposed by authorities directly. The latter naturally induce conditional quantiles and reflect the seriousness of particular events. In the present paper we focus on this important aspect by developing quantile regression models further. We propose a general Bayesian effect selection approach for additive quantile regression within a highly interpretable framework. We place separate normal beta prime spike and slab priors on the scalar importance parameters of effect parts and implement a fast Gibbs sampling scheme. Specifically, it enables to study quantile-specific covariate effects, allows these covariates to be of general functional form using additive predictors, and facilitates the analysts' decision whether an effect should be included linearly, non-linearly or not at all in the quantiles of interest. In a detailed analysis on air pollution data in Madrid (Spain) we find the added value of modelling extreme nitrogen dioxide (NO2) concentrations and how thresholds are driven differently by several climatological variables and traffic as a spatial proxy. Our results underpin the need of enhanced statistical models to support short-term decisions and enable local authorities to mitigate or even prevent exceedances of NO2 concentration limits.


title: Temporal and Spectral Study of PKS B1222+216 Flares in 2014

abstract: We report on temporal and spectral study of a flat spectrum radio quasar, PKS B1222+216, in flare state to get insight into acceleration and emission mechanisms inside the jet. This is one of the brightest and highly active blazar in the MeV-GeV regime. Long term multi-waveband light curves of this object showed a flaring activity in 2014 with two distinct flares. Work presented here includes the study of flux-index variation, flare fitting, hardness ratio and spectral modelling of both X-ray and $\gamma-$ray data. The flux-index correlation we have found in MeV-GeV regime indicates a 'softer when brighter' feature. Modelling of $\gamma-$ray light curves suggests that low energy particles initiate both the flares followed by the injection of high energy particles. The short rise time indicates the presence of Fermi first order acceleration. Multi-waveband spectral energy distributions (SEDs) generated for flares are fitted with a single-zone leptonic model. This SED modelling shows the inverse Compton scattering of photon field reprocessed from Broad Line Region (BLR) primarily accounts for GeV emission. We have also report a shift in break-energy in the soft X-ray regime during the flaring activity which is the consequence of a rapid change in injection spectra.


title: Fast Crack Detection Using Convolutional Neural Network

abstract: To improve the efficiency and reduce the labour cost of the renovation process, this study presents a lightweight Convolutional Neural Network (CNN)-based architecture to extract crack-like features, such as cracks and joints. Moreover, Transfer Learning (TF) method was used to save training time while offering comparable prediction results. For three different objectives: 1) Detection of the concrete cracks; 2) Detection of natural stone cracks; 3) Differentiation between joints and cracks in natural stone; We built a natural stone dataset with joints and cracks information as complementary for the concrete benchmark dataset. As the results show, our model is demonstrated as an effective tool for industry use.


title: What can developers' messages tell us? A psycholinguistic analysis of Jazz teams' attitudes and behavior patterns

abstract: Reports that communication and behavioral issues contribute to inadequately performing software teams have fuelled a wealth of research aimed at understanding the human processes employed during software development. The increasing level of interest in human issues is particularly relevant for agile and global software development approaches that emphasize the importance of people and their interactions during projects. While mature analysis techniques in behavioral psychology have been recommended for studying such issues, particularly when using archives and artifacts, these techniques have rarely been used in software engineering research. We utilize these techniques under an embedded case study approach to examine whether IBM Rational Jazz practitioners' behaviors change over project duration and whether certain tasks affect teams' attitudes and behaviors. We found highest levels of project engagement at project start and completion, as well as increasing levels of team collectiveness as projects progressed. Additionally, Jazz practitioners were most insightful and perceptive at the time of project scoping. Further, Jazz teams' attitudes and behaviors varied in line with the nature of the tasks they were performing. We explain these findings and discuss their implications for software project governance and tool design.


title: Simulation-Based Impact of Connected Vehicles in Platooning Mode on Travel Time, Emissions and Fuel Consumption

abstract: Several approaches have been presented during the last decades to reduce carbon pollution from transportation. One example is the use of platooning mode. This paper considers data obtained from daily trips to investigate the impact of platooning on travel time, emissions of CO2, CO, NO2 and HC and fuel consumption on a road network in Upper Austria. For this purpose, we studied fuel combustion-based engines relying on the extension of the 3DCoAutoSim simulation platform. The obtained results showed that the platooning mode not only increased driving efficiency but also decreased the total emissions by reducing fuel consumption.


title: Data Quality in Empirical Software Engineering: A Targeted Review

abstract: Context: The utility of prediction models in empirical software engineering (ESE) is heavily reliant on the quality of the data used in building those models. Several data quality challenges such as noise, incompleteness, outliers and duplicate data points may be relevant in this regard. Objective: We investigate the reporting of three potentially influential elements of data quality in ESE studies: data collection, data pre-processing, and the identification of data quality issues. This enables us to establish how researchers view the topic of data quality and the mechanisms that are being used to address it. Greater awareness of data quality should inform both the sound conduct of ESE research and the robust practice of ESE data collection and processing. Method: We performed a targeted literature review of empirical software engineering studies covering the period January 2007 to September 2012. A total of 221 relevant studies met our inclusion criteria and were characterized in terms of their consideration and treatment of data quality. Results: We obtained useful insights as to how the ESE community considers these three elements of data quality. Only 23 of these 221 studies reported on all three elements of data quality considered in this paper. Conclusion: The reporting of data collection procedures is not documented consistently in ESE studies. It will be useful if data collection challenges are reported in order to improve our understanding of why there are problems with software engineering data sets and the models developed from them. More generally, data quality should be given far greater attention by the community. The improvement of data sets through enhanced data collection, pre-processing and quality assessment should lead to more reliable prediction models, thus improving the practice of software engineering.


title: Non-polynomial $q$-Askey scheme: integral representations, eigenfunction properties, and polynomial limits

abstract: We construct a non-polynomial generalization of the $q$-Askey scheme. Whereas the elements of the $q$-Askey scheme are given by $q$-hypergeometric series, the elements of the non-polynomial scheme are given by contour integrals, whose integrands are built from Ruijsenaars' hyperbolic gamma function. Alternatively, the integrands can be expressed in terms of Faddeev's quantum dilogarithm, Woronowicz's quantum exponential, or Kurokawa's double sine function. We present the basic properties of all the elements of the scheme, including their integral representations, joint eigenfunction properties, and polynomial limits.


title: Asynchronous wreath product and cascade decompositions for concurrent behaviours

abstract: We develop new algebraic tools to reason about concurrent behaviours modelled as languages of Mazurkiewicz traces and asynchronous automata. These tools reflect the distributed nature of traces and the underlying causality and concurrency between events, and can be said to support true concurrency. They generalize the tools that have been so efficient in understanding, classifying and reasoning about word languages. In particular, we introduce an asynchronous version of the wreath product operation and we describe the trace languages recognized by such products (the so-called asynchronous wreath product principle). We then propose a decomposition result for recognizable trace languages, analogous to the Krohn-Rhodes theorem, and we prove this decomposition result in the special case of acyclic architectures. Finally, we introduce and analyze two distributed automata-theoretic operations. One, the local cascade product, is a direct implementation of the asynchronous wreath product operation. The other, global cascade sequences, although conceptually and operationally similar to the local cascade product, translates to a more complex asynchronous implementation which uses the gossip automaton of Mukund and Sohoni. This leads to interesting applications to the characterization of trace languages definable in first-order logic: they are accepted by a restricted local cascade product of the gossip automaton and 2-state asynchronous reset automata, and also by a global cascade sequence of 2-state asynchronous reset automata. Over distributed alphabets for which the asynchronous Krohn-Rhodes theorem holds, a local cascade product of such automata is sufficient and this, in turn, leads to the identification of a simple temporal logic which is expressively complete for such alphabets.


title: Auslander correspondence for kawada rings

abstract: We study the Auslander ring of a basic left K\"othe ring $\Lambda$ and give a characterization of basic left K\"othe rings in terms of their Auslander rings. We also study the functor category Mod$((\Lambda$-mod$)^{\rm op})$ and characterize basic left K\"othe rings $\Lambda$ by using functor categories Mod$((\Lambda$-mod$)^{\rm op})$. As a consequence we show that there exists a bijection between the Morita equivalence classes of left Kawada rings and the Morita equivalence classes of Auslander generalized right QF-2 rings.


title: A Critical Evaluation of Failure in a Nearshore Outsourcing Project: What dilemma analysis can tell us

abstract: Global Software Engineering (GSE) research contains few examples consciously applying what Glass and colleagues have termed an 'evaluative-critical' approach. In this study we apply dilemma analysis to conduct a critical review of a major (and ongoing) nearshore Business Process Outsourcing project in New Zealand. The project has become so troubled that a Government Minister has recently been assigned responsibility for troubleshooting it. The 'Novopay' project concerns the implementation of a nationwide payroll system responsible for the payment of some 110,000 teachers and education sector staff. An Australian company won the contract for customizing and implementing the Novopay system, taking over from an existing New Zealand service provider. We demonstrate how a modified form of dilemma analysis can be a powerful technique for highlighting risks and stakeholder impacts from empirical data, and that adopting an evaluative-critical approach to such projects can usefully highlight tensions and barriers to satisfactory project outcomes.


title: Modeling Collective Anticipation and Response on Wikipedia

abstract: The dynamics of popularity in online media are driven by a combination of endogenous spreading mechanisms and response to exogenous shocks including news and events. However, little is known about the dependence of temporal patterns of popularity on event-related information, e.g. which types of events trigger long-lasting activity. Here we propose a simple model that describes the dynamics around peaks of popularity by incorporating key features, i.e., the anticipatory growth and the decay of collective attention together with circadian rhythms. The proposed model allows us to develop a new method for predicting the future page view activity and for clustering time series. To validate our methodology, we collect a corpus of page view data from Wikipedia associated to a range of planned events, that are events which we know in advance will have a fixed date in the future, such as elections and sport events. Our methodology is superior to existing models in both prediction and clustering tasks. Furthermore, restricting to Wikipedia pages associated to association football, we observe that the specific realization of the event, in our case which team wins a match or the type of the match, has a significant effect on the response dynamics after the event. Our work demonstrates the importance of appropriately modeling all phases of collective attention, as well as the connection between temporal patterns of attention and characteristic underlying information of the events they represent.


title: A frequency domain approach for local module identification in dynamic networks

abstract: In classical approaches of dynamic network identification, in order to identify a system (module) embedded in a dynamic network, one has to formulate a Multi-input-Single-output (MISO) identification problem that requires identification of a parametric model for all the modules constituting the MISO setup including (possibly) the noise model, and determine their model order. This requirement leads to model order selection steps for modules that are of no interest to the experimenter which increases the computational complexity for large-sized networks. Also, identification using a parametric noise model (like BJ method) can suffer from local minima, however neglecting the noise model has its impact on the variance of the estimates. In this paper, we provide a two-step identification approach to avoid these problems. The first step involves performing a non-parametric indirect approach for a MISO identification problem to get the non-parametric frequency response function (FRF) estimates and its variance as a function of frequency. In the second step, the estimated non-parametric FRF of the target module is smoothed using a parametric frequency domain estimator with the estimated variance from the previous step as the non-parametric noise model. The developed approach is practical with weak assumptions on noise, uses the available toolbox, requires a parametric model only for the target module of interest, and uses a non-parametric noise model to reduce the variance of the estimates. Numerical simulations illustrate the potentials of the introduced method in comparison with the classical identification methods.


title: A hybrid classification-regression approach for 3D hand pose estimation using graph convolutional networks

abstract: Hand pose estimation is a crucial part of a wide range of augmented reality and human-computer interaction applications. Predicting the 3D hand pose from a single RGB image is challenging due to occlusion and depth ambiguities. GCN-based (Graph Convolutional Networks) methods exploit the structural relationship similarity between graphs and hand joints to model kinematic dependencies between joints. These techniques use predefined or globally learned joint relationships, which may fail to capture pose-dependent constraints. To address this problem, we propose a two-stage GCN-based framework that learns per-pose relationship constraints. Specifically, the first phase quantizes the 2D/3D space to classify the joints into 2D/3D blocks based on their locality. This spatial dependency information guides this phase to estimate reliable 2D and 3D poses. The second stage further improves the 3D estimation through a GCN-based module that uses an adaptative nearest neighbor algorithm to determine joint relationships. Extensive experiments show that our multi-stage GCN approach yields an efficient model that produces accurate 2D/3D hand poses and outperforms the state-of-the-art on two public datasets.


title: On the $A_\alpha$ spectral radius of strongly connected digraphs

abstract: Let $G$ be a digraph with adjacency matrix $A(G)$. Let $D(G)$ be the diagonal matrix with outdegrees of vertices of $G$. Nikiforov \cite{Niki} proposed to study the convex combinations of the adjacency matrix and diagonal matrix of the degrees of undirected graphs. Liu et al. \cite{LWCL} extended the definition to digraphs. For any real $\alpha\in[0,1]$, the matrix $A_\alpha(G)$ of a digraph $G$ is defined as $$A_\alpha(G)=\alpha D(G)+(1-\alpha)A(G).$$ The largest modulus of the eigenvalues of $A_\alpha(G)$ is called the $A_\alpha$ spectral radius of $G$, denoted by $\lambda_\alpha(G)$. This paper proves some extremal results about the spectral radius $\lambda_\alpha(G)$ that generalize previous results about $\lambda_0(G)$ and $\lambda_{\frac{1}{2}}(G)$. In particular, we characterize the extremal digraph with the maximum (or minimum) $A_\alpha$ spectral radius among all $\widetilde{\infty}$-digraphs and $\widetilde{\theta}$-digraphs on $n$ vertices. Furthermore, we determine the digraphs with the second and the third minimum $A_\alpha$ spectral radius among all strongly connected bicyclic digraphs. For $0\leq\alpha\leq\frac{1}{2}$, we also determine the digraphs with the second, the third and the fourth minimum $A_\alpha$ spectral radius among all strongly connected digraphs on $n$ vertices. Finally, we characterize the digraph with the minimum $A_\alpha$ spectral radius among all strongly connected bipartite digraphs which contain a complete bipartite subdigraph.


title: Skeleton-aware multi-scale heatmap regression for 2D hand pose estimation

abstract: Existing RGB-based 2D hand pose estimation methods learn the joint locations from a single resolution, which is not suitable for different hand sizes. To tackle this problem, we propose a new deep learning-based framework that consists of two main modules. The former presents a segmentation-based approach to detect the hand skeleton and localize the hand bounding box. The second module regresses the 2D joint locations through a multi-scale heatmap regression approach that exploits the predicted hand skeleton as a constraint to guide the model. Furthermore, we construct a new dataset that is suitable for both hand detection and pose estimation. We qualitatively and quantitatively validate our method on two datasets. Results demonstrate that the proposed method outperforms state-of-the-art and can recover the pose even in cluttered images and complex poses.


title: On a problem of M. Talagrand

abstract: We address a special case of a conjecture of M. Talagrand relating two notions of "threshold" for an increasing family $\mathcal F$ of subsets of a finite set $V$. The full conjecture implies equivalence of the "Fractional Expectation-Threshold Conjecture," due to Talagrand and recently proved by the authors and B. Narayanan, and the (stronger) "Expectation-Threshold Conjecture" of the second author and G. Kalai. The conjecture under discussion here says there is a fixed $L$ such that if, for a given $\mathcal F$, $p\in [0,1]$ admits $\lambda:2^V \rightarrow \mathbb R^+$ with \[ \mbox{$\sum_{S\subseteq F}\lambda_S\ge 1 ~~\forall F\in \mathcal F$} \] and \[ \mbox{$\sum_S\lambda_Sp^{|S|} \le 1/2$} \] (a.k.a. $\mathcal F$ is weakly $p$-small), then $p/L$ admits such a $\lambda$ taking values in $\{0,1\}$ ($\mathcal F$ is $(p/L)$-small). Talagrand showed this when $\lambda$ is supported on singletons and suggested, as a more challenging test case, proving it when $\lambda$ is supported on pairs. The present work provides such a proof.


title: Viscosity subsoltions of Hamilton-Jacobi equations and Invariant sets of contact Hamilton systems

abstract: The objective of this paper is to present some results about viscosity subsolutions of the contact Hamiltonian-Jacobi equations on connected, closed manifold $M$ $$ H(x,\partial_x u,u)= 0, \quad x\in M. $$ Based on implicit variational principles introduced in [12,14], we focus on the monotonicity of the solution semigroups on viscosity subsolutions and the positive invariance of the epigraph for viscosity subsolutions. Besides, we show a similar consequence for strict viscosity subsolutions on $M$.


title: An Efficient Application of Neuroevolution for Competitive Multiagent Learning

abstract: Multiagent systems provide an ideal environment for the evaluation and analysis of real-world problems using reinforcement learning algorithms. Most traditional approaches to multiagent learning are affected by long training periods as well as high computational complexity. NEAT (NeuroEvolution of Augmenting Topologies) is a popular evolutionary strategy used to obtain the best performing neural network architecture often used to tackle optimization problems in the field of artificial intelligence. This paper utilizes the NEAT algorithm to achieve competitive multiagent learning on a modified pong game environment in an efficient manner. The competing agents abide by different rules while having similar observation space parameters. The proposed algorithm utilizes this property of the environment to define a singular neuroevolutionary procedure that obtains the optimal policy for all the agents. The compiled results indicate that the proposed implementation achieves ideal behaviour in a very short training period when compared to existing multiagent reinforcement learning models.


title: PASOCS: A Parallel Approximate Solver for Probabilistic Logic Programs under the Credal Semantics

abstract: The Credal semantics is a probabilistic extension of the answer set semantics which can be applied to programs that may or may not be stratified. It assigns to atoms a set of acceptable probability distributions characterised by its lower and upper bounds. Performing exact probabilistic inference in the Credal semantics is computationally intractable. This paper presents a first solver, based on sampling, for probabilistic inference under the Credal semantics called PASOCS (Parallel Approximate SOlver for the Credal Semantics). PASOCS performs both exact and approximate inference for queries given evidence. Approximate solutions can be generated using any of the following sampling methods: naive sampling, Metropolis-Hastings and Gibbs Markov Chain Monte-Carlo. We evaluate the fidelity and performance of our system when applied to both stratified and non-stratified programs. We perform a sanity check by comparing PASOCS to available systems for stratified programs, where the semantics agree, and show that our system is competitive on unstratified programs.


title: Killing One Bird with Two Stones: Model Extraction and Attribute Inference Attacks against BERT-based APIs

abstract: The collection and availability of big data, combined with advances in pre-trained models (e.g., BERT, XLNET, etc), have revolutionized the predictive performance of modern natural language processing tasks, ranging from text classification to text generation. This allows corporations to provide machine learning as a service (MLaaS) by encapsulating fine-tuned BERT-based models as APIs. However, BERT-based APIs have exhibited a series of security and privacy vulnerabilities. For example, prior work has exploited the security issues of the BERT-based APIs through the adversarial examples crafted by the extracted model. However, the privacy leakage problems of the BERT-based APIs through the extracted model have not been well studied. On the other hand, due to the high capacity of BERT-based APIs, the fine-tuned model is easy to be overlearned, but what kind of information can be leaked from the extracted model remains unknown. In this work, we bridge this gap by first presenting an effective model extraction attack, where the adversary can practically steal a BERT-based API (the target/victim model) by only querying a limited number of queries. We further develop an effective attribute inference attack which can infer the sensitive attribute of the training data used by the BERT-based APIs. Our extensive experiments on benchmark datasets under various realistic settings validate the potential vulnerabilities of BERT-based APIs. Moreover, we demonstrate that two promising defense methods become ineffective against our attacks, which calls for more effective defense methods.


title: Spectroscopy of the local density-of-states in nanowires using integrated quantum dots

abstract: In quantum dot (QD) electron transport experiments additional features can appear in the differential conductance $dI/dV$ that do not originate from discrete states in the QD, but rather from a modulation of the density-of-states (DOS) in the leads. These features are particularly pronounced when the leads are strongly confined low dimensional systems, such as in a nanowire (NW) where transport is one-dimensional and quasi-zero dimensional lead-states can emerge. In this paper we study such lead-states in InAs NWs. We use a QD integrated directly into the NW during the epitaxial growth as an energetically and spatially well-defined tunnel probe to perform $dI/dV$ spectroscopy of discrete bound states in the `left' and `right' NW lead segments. By tuning a sidegate in close proximity of one lead segment, we can distinguish transport features related to the modulation in the lead DOS and to excited states in the QD. We implement a non-interacting capacitance model and derive expressions for the slopes of QD and lead resonances that appear in two-dimensional plots of $dI/dV$ as a function of source-drain bias and gate voltage in terms of the different lever arms determined by the capacitive couplings. We discuss how the interplay between the lever arms affect the slopes. We verify our model by numerically calculating the $dI/dV$ using a resonant tunneling model with three non-interacting quantum dots in series. Finally, we used the model to describe the measured $dI/dV$ spectra and extract quantitatively the tunnel couplings of the lead segments. Our results constitute an important step towards a quantitative understanding of normal and superconducting subgap states in hybrid NW devices.


title: A Query Language for Summarizing and Analyzing Business Process Data

abstract: In modern enterprises, Business Processes (BPs) are realized over a mix of workflows, IT systems, Web services and direct collaborations of people. Accordingly, process data (i.e., BP execution data such as logs containing events, interaction messages and other process artifacts) is scattered across several systems and data sources, and increasingly show all typical properties of the Big Data. Understanding the execution of process data is challenging as key business insights remain hidden in the interactions among process entities: most objects are interconnected, forming complex, heterogeneous but often semi-structured networks. In the context of business processes, we consider the Big Data problem as a massive number of interconnected data islands from personal, shared and business data. We present a framework to model process data as graphs, i.e., Process Graph, and present abstractions to summarize the process graph and to discover concept hierarchies for entities based on both data objects and their interactions in process graphs. We present a language, namely BP-SPARQL, for the explorative querying and understanding of process graphs from various user perspectives. We have implemented a scalable architecture for querying, exploration and analysis of process graphs. We report on experiments performed on both synthetic and real-world datasets that show the viability and efficiency of the approach.


title: CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understanding

abstract: Scientific document understanding is challenging as the data is highly domain specific and diverse. However, datasets for tasks with scientific text require expensive manual annotation and tend to be small and limited to only one or a few fields. At the same time, scientific documents contain many potential training signals, such as citations, which can be used to build large labelled datasets. Given this, we present an in-depth study of cite-worthiness detection in English, where a sentence is labelled for whether or not it cites an external source. To accomplish this, we introduce CiteWorth, a large, contextualized, rigorously cleaned labelled dataset for cite-worthiness detection built from a massive corpus of extracted plain-text scientific documents. We show that CiteWorth is high-quality, challenging, and suitable for studying problems such as domain adaptation. Our best performing cite-worthiness detection model is a paragraph-level contextualized sentence labelling model based on Longformer, exhibiting a 5 F1 point improvement over SciBERT which considers only individual sentences. Finally, we demonstrate that language model fine-tuning with cite-worthiness as a secondary task leads to improved performance on downstream scientific document understanding tasks.


title: Graph-based Detection of Multiuser Impulse Radio Systems

abstract: Impulse-Radio (IR) is a wideband modulation technique that can support multiple users by employing random Time-Hopping (TH) combined with repeated transmissions. The latter is aimed at alleviating the impact of collisions. This work employs a graphical model for describing the multiuser system which, in turn, facilitates the inclusion of general coding schemes. Based on factor graph representation of the system, several iterative multiuser detectors are presented. These detectors are applicable for any binary linear coding scheme. The performance of the proposed multiuser detectors is evaluated via simulations revealing large gains with low complexity.


title: Quantum and classical registers

abstract: We present a generic theory of "registers" in imperative programs and instantiate it in the classical and quantum setting. Roughly speaking, a register is some mutable part of the program state. Mutable classical variables and quantum registers and wires in quantum circuits are examples of this. However, registers in our setting can also refer to subparts of other registers, or combinations of parts from different registers, or quantum registers seen in a different basis, etc. Our formalization is intended to be well suited for formalization in theorem provers and as a foundation for modeling quantum/classical variables in imperative programs. We study the quantum registers in greater detail and cover the infinite-dimensional case as well. We implemented a large part of our results (including a minimal quantum Hoare logic and an analysis of quantum teleportation) in the Isabelle/HOL theorem prover.


title: GOALS: Gradient-Only Approximations for Line Searches Towards Robust and Consistent Training of Deep Neural Networks

abstract: Mini-batch sub-sampling (MBSS) is favored in deep neural network training to reduce the computational cost. Still, it introduces an inherent sampling error, making the selection of appropriate learning rates challenging. The sampling errors can manifest either as a bias or variances in a line search. Dynamic MBSS re-samples a mini-batch at every function evaluation. Hence, dynamic MBSS results in point-wise discontinuous loss functions with smaller bias but larger variance than static sampled loss functions. However, dynamic MBSS has the advantage of having larger data throughput during training but requires the complexity regarding discontinuities to be resolved. This study extends the gradient-only surrogate (GOS), a line search method using quadratic approximation models built with only directional derivative information, for dynamic MBSS loss functions. We propose a gradient-only approximation line search (GOALS) with strong convergence characteristics with defined optimality criterion. We investigate GOALS's performance by applying it on various optimizers that include SGD, RMSprop and Adam on ResNet-18 and EfficientNetB0. We also compare GOALS's against the other existing learning rate methods. We quantify both the best performing and most robust algorithms. For the latter, we introduce a relative robust criterion that allows us to quantify the difference between an algorithm and the best performing algorithm for a given problem. The results show that training a model with the recommended learning rate for a class of search directions helps to reduce the model errors in multimodal cases.


title: A comment on the paper "Continued fractions and orderings on the Markov numbers, Adv. Math. 370 (2020), 107231"

abstract: We discuss the validity of the proof of the fixed numerator conjecture on Markov numbers, which is the main result of the paper mentioned in the title.


title: Who Watches the New Watchmen? The Challenges for Drone Digital Forensics Investigations

abstract: The technological advance of drone technology has augmented the existing capabilities of flying vehicles rendering them a valuable asset of the modern society. As more drones are expected to occupy the airspace in the near future, security-related incidents, either malicious acts or accidents, will increase as well. The forensics analysis of a security incident is essential, as drones are flying above populated areas and have also been weaponised from radical forces and perpetrators. Thus, it is an imperative need to establish a Drone Digital Forensics Investigation Framework and standardise the processes of collecting and processing such evidence. Although there are numerous drone platforms in the market, the same principles apply to all of them; just like mobile phones. Nevertheless, due to the nature of drones, standardised forensics procedures to date do not manage to address the required processes and challenges that such investigations pose. Acknowledging this need, we detail the unique characteristics of drones and the gaps in existing methodologies and standards, showcasing that there are fundamental issues in terms of their forensics analysis from various perspectives, ranging from operational and procedural ones, and escalate to manufacturers, as well as legal restrictions. The above creates a very complex environment where coordinated actions must be made among the key stakeholders. Therefore, this work paves the way to address these challenges by identifying the main issues, their origins, and the needs in the field by performing a thorough review of the literature and a gap analysis.


title: Ab initio investigation of impurity ferromagnetism in the Pd1-xFex alloys: concentration and position dependence

abstract: We present the ab initio results of the structural and magnetic properties of the Pd host matrix implanted with Fe solute atoms at various concentrations. By means of density functional theory we confirm that iron impurities are able to initialize significant magnetization of the Pd atoms, when the impurity consentation exceeds 3 at.%. Besides, we demonstrate that the imposed magnetization depends on impurity positions in the host matrix, in particular, there is a maximum of magnetization for a uniform distribution of the iron impurity.


title: Continual World: A Robotic Benchmark For Continual Reinforcement Learning

abstract: Continual learning (CL) -- the ability to continuously learn, building on previously acquired knowledge -- is a natural requirement for long-lived autonomous reinforcement learning (RL) agents. While building such agents, one needs to balance opposing desiderata, such as constraints on capacity and compute, the ability to not catastrophically forget, and to exhibit positive transfer on new tasks. Understanding the right trade-off is conceptually and computationally challenging, which we argue has led the community to overly focus on catastrophic forgetting. In response to these issues, we advocate for the need to prioritize forward transfer and propose Continual World, a benchmark consisting of realistic and meaningfully diverse robotic tasks built on top of Meta-World as a testbed. Following an in-depth empirical evaluation of existing CL methods, we pinpoint their limitations and highlight unique algorithmic challenges in the RL setting. Our benchmark aims to provide a meaningful and computationally inexpensive challenge for the community and thus help better understand the performance of existing and future solutions. Information about the benchmark, including the open-source code, is available at https://sites.google.com/view/continualworld.


title: End-to-End Video Object Detection with Spatial-Temporal Transformers

abstract: Recently, DETR and Deformable DETR have been proposed to eliminate the need for many hand-designed components in object detection while demonstrating good performance as previous complex hand-crafted detectors. However, their performance on Video Object Detection (VOD) has not been well explored. In this paper, we present TransVOD, an end-to-end video object detection model based on a spatial-temporal Transformer architecture. The goal of this paper is to streamline the pipeline of VOD, effectively removing the need for many hand-crafted components for feature aggregation, e.g., optical flow, recurrent neural networks, relation networks. Besides, benefited from the object query design in DETR, our method does not need complicated post-processing methods such as Seq-NMS or Tubelet rescoring, which keeps the pipeline simple and clean. In particular, we present temporal Transformer to aggregate both the spatial object queries and the feature memories of each frame. Our temporal Transformer consists of three components: Temporal Deformable Transformer Encoder (TDTE) to encode the multiple frame spatial details, Temporal Query Encoder (TQE) to fuse object queries, and Temporal Deformable Transformer Decoder to obtain current frame detection results. These designs boost the strong baseline deformable DETR by a significant margin (3%-4% mAP) on the ImageNet VID dataset. TransVOD yields comparable results performance on the benchmark of ImageNet VID. We hope our TransVOD can provide a new perspective for video object detection. Code will be made publicly available at https://github.com/SJTU-LuHe/TransVOD.


title: Tabulation of knots up to five triple-crossings and moves between oriented diagrams

abstract: We enumerate and show tables of minimal diagrams for all prime knots up to the triple-crossing number equal to five. We derive a minimal generating set of oriented moves connecting triple-crossing diagrams of the same oriented knot. We also present a conjecture about a strict lower bound of the triple-crossing number of a knot related to the breadth of its Alexander polynomial.


title: OntoED: Low-resource Event Detection with Ontology Embedding

abstract: Event Detection (ED) aims to identify event trigger words from a given text and classify it into an event type. Most of current methods to ED rely heavily on training instances, and almost ignore the correlation of event types. Hence, they tend to suffer from data scarcity and fail to handle new unseen event types. To address these problems, we formulate ED as a process of event ontology population: linking event instances to pre-defined event types in event ontology, and propose a novel ED framework entitled OntoED with ontology embedding. We enrich event ontology with linkages among event types, and further induce more event-event correlations. Based on the event ontology, OntoED can leverage and propagate correlation knowledge, particularly from data-rich to data-poor event types. Furthermore, OntoED can be applied to new unseen event types, by establishing linkages to existing ones. Experiments indicate that OntoED is more predominant and robust than previous approaches to ED, especially in data-scarce scenarios.


title: Towards Knowledge Organization Ecosystems

abstract: It is needless to mention the (already established) overarching importance of knowledge organization and its tried-and-tested high-quality schemes in knowledge-based Artificial Intelligence (AI) systems. But equally, it is also hard to ignore that, increasingly, standalone KOSs are becoming functionally ineffective components for such systems, given their inability to capture the continuous facetization and drift of domains. The paper proposes a radical re-conceptualization of KOSs as a first step to solve such an inability, and, accordingly, contributes in the form of the following dimensions: (i) an explicit characterization of Knowledge Organization Ecosystems (KOEs) (possibly for the first time) and their positioning as pivotal components in realizing sustainable knowledge-based AI solutions, (ii) as a consequence of such a novel characterization, a first examination and characterization of KOEs as Socio-Technical Systems (STSs), thus opening up an entirely new stream of research in knowledge-based AI, and (iii) motivating KOEs not to be mere STSs but STSs which are grounded in Ethics and Responsible Artificial Intelligence cardinals from their very genesis. The paper grounds the above contributions in relevant research literature in a distributed fashion throughout the paper, and finally concludes by outlining the future research possibilities.


title: Hydrodynamic limits of the nonlinear Schr\"odinger equation with the Chern-Simons gauge fields

abstract: We present two types of the hydrodynamic limit of the nonlinear Schr\"odinger-Chern-Simons (SCS) system. We consider two different scalings of the SCS system and show that each SCS system asymptotically converges towards the compressible and incompressible Euler system, coupled with the Chern-Simons equations and Poisson equation respectively, as the scaled Planck constant converges to 0. Our method is based on the modulated energy estimate. In the case of compressible limit, we observe that the classical theory of relative entropy method can be applied to show the hydrodynamic limit, with the additional quantum correction term. On the other hand, for the incompressible limit, we directly estimate the modulated energy to derive the desired asymptotic convergence.


title: COTR: Convolution in Transformer Network for End to End Polyp Detection

abstract: Purpose: Colorectal cancer (CRC) is the second most common cause of cancer mortality worldwide. Colonoscopy is a widely used technique for colon screening and polyp lesions diagnosis. Nevertheless, manual screening using colonoscopy suffers from a substantial miss rate of polyps and is an overwhelming burden for endoscopists. Computer-aided diagnosis (CAD) for polyp detection has the potential to reduce human error and human burden. However, current polyp detection methods based on object detection framework need many handcrafted pre-processing and post-processing operations or user guidance that require domain-specific knowledge. Methods: In this paper, we propose a convolution in transformer (COTR) network for end-to-end polyp detection. Motivated by the detection transformer (DETR), COTR is constituted by a CNN for feature extraction, transformer encoder layers interleaved with convolutional layers for feature encoding and recalibration, transformer decoder layers for object querying, and a feed-forward network for detection prediction. Considering the slow convergence of DETR, COTR embeds convolution layers into transformer encoder for feature reconstruction and convergence acceleration. Results: Experimental results on two public polyp datasets show that COTR achieved 91.49\% precision, 82.69% sensitivity, and 86.87% F1-score on the ETIS-LARIB, and 91.67% precision, 93.54% sensitivity, and 92.60% F1-score on the CVC-ColonDB. Conclusion: This study proposed an end to end detection method based on detection transformer for colorectal polyp detection. Experimental results on ETIS-LARIB and CVC-ColonDB dataset demonstrated that the proposed model achieved comparable performance against state-of-the-art methods.


title: Rethinking Global Context in Crowd Counting

abstract: This paper investigates the role of global context for crowd counting. Specifically, a pure transformer is used to extract features with global information from overlapping image patches. Inspired by classification, we add a context token to the input sequence, to facilitate information exchange with tokens corresponding to image patches throughout transformer layers. Due to the fact that transformers do not explicitly model the tried-and-true channel-wise interactions, we propose a token-attention module (TAM) to recalibrate encoded features through channel-wise attention informed by the context token. Beyond that, it is adopted to predict the total person count of the image through regression-token module (RTM). Extensive experiments on various datasets, including ShanghaiTech, UCF-QNRF, JHU-CROWD++ and NWPU, demonstrate that the proposed context extraction techniques can significantly improve the performance over the baselines.