title: A new radial, natural, higher order intermediary of the main problem four decades after the elimination of the parallax

abstract: Simplifications in dealing with the equation of the center when the short-period effects are removed from a zonal Hamiltonian are commonly attributed to the elimination of parallactic terms. But this interpretation is incorrect, and the simplifications rather stem from the removal of concomitant long-period terms, an outcome that can also be achieved without need of eliminating the parallax. To show that, a Lie transforms simplification is invented that augments the exponents of the inverse of the radius and still achieves analogous simplifications in handling the equation of the center to those provided by the classical elimination of the parallax simplification. The particular case in which the new transformation does not modify the exponents of the parallactic terms of the original problem, leads to a new intermediary of the main problem that, while keeping higher order effects of J2, is formally analogous to Cid's first order radial intermediary.


title: Maximizing Parallelism in Distributed Training for Huge Neural Networks

abstract: The recent Natural Language Processing techniques have been refreshing the state-of-the-art performance at an incredible speed. Training huge language models is therefore an imperative demand in both industry and academy. However, huge language models impose challenges to both hardware and software. Graphical processing units (GPUs) are iterated frequently to meet the exploding demand, and a variety of ASICs like TPUs are spawned. However, there is still a tension between the fast growth of the extremely huge models and the fact that Moore's law is approaching the end. To this end, many model parallelism techniques are proposed to distribute the model parameters to multiple devices, so as to alleviate the tension on both memory and computation. Our work is the first to introduce a 3-dimensional model parallelism for expediting huge language models. By reaching a perfect load balance, our approach presents smaller memory and communication cost than existing state-of-the-art 1-D and 2-D model parallelism. Our experiments on 64 TACC's V100 GPUs show that our 3-D parallelism outperforms the 1-D and 2-D parallelism with 2.32x and 1.57x speedup, respectively.


title: Systematic studies of rubidium-exposed surfaces by X-ray photoelectron spectroscopy and light-induced atom desorption

abstract: We systematically investigated various types of surfaces on which rubidium (Rb) atoms were deposited by X-ray photoelectron spectroscopy (XPS) and measured the light-induced atom desorption (LIAD) from those surfaces. The main surfaces of interest included synthetic quartz, yttrium metal, and paraffin. The Rb atoms deposited on quartz and yttrium surfaces by exposure to Rb vapor at room temperature were detected by XPS. Quartz is originally silicon dioxide. The yttrium surfaces were also oxidized, and Rb atoms reacted with oxygen on both surfaces. Conversely, Rb deposition was observed only at low temperatures on paraffin. Specifically, Rb atoms deposited on paraffin, which is not an oxygen compound, also formed oxygen compounds under ultrahigh vacuum conditions by reaction with the background gas. All examined surfaces showed a similar light wavelength or photon energy dependence, such that the LIAD rates increased with decreasing light wavelength. We presume that some types of compounds of alkali metal and oxygen can be ubiquitous sources for LIAD from many types of surfaces of alkali-metal vapor cells.


title: A unified logical framework for explanations in classifier systems

abstract: Recent years have witnessed a renewed interest in Boolean function in explaining binary classifiers in the field of explainable AI (XAI). The standard approach of Boolean function is propositional logic. We present a modal language of a ceteris paribus nature which supports reasoning about binary input classifiers and their properties. We study a family of classifier models, axiomatize it as two proof systems regarding the cardinality of the language and show completeness of our axiomatics. Moreover, we prove that satisfiability checking problem for our modal language is NEXPTIME-complete in the infinite-variable case, while it becomes polynomial in the finite-variable case. We furthermore identify an interesting NP fragment of our language in the infinite-variable case. We leverage the language to formalize counterfactual conditional as well as a variety of notions of explanation including abductive, contrastive and counterfactual explanations, and biases. Finally, we present two extensions of our language: a dynamic extension by the notion of assignment enabling classifier change and an epistemic extension in which the classifier's uncertainty about the actual input can be represented.


title: Plumbing and computation of crosscap number

abstract: We introduce a "deformation" of plumbing. We also define a structure of data used in a calculation by computer aid of the crosscap numbers of alternating knots.


title: NeuralWOZ: Learning to Collect Task-Oriented Dialogue via Model-Based Simulation

abstract: We propose NeuralWOZ, a novel dialogue collection framework that uses model-based dialogue simulation. NeuralWOZ has two pipelined models, Collector and Labeler. Collector generates dialogues from (1) user's goal instructions, which are the user context and task constraints in natural language, and (2) system's API call results, which is a list of possible query responses for user requests from the given knowledge base. Labeler annotates the generated dialogue by formulating the annotation as a multiple-choice problem, in which the candidate labels are extracted from goal instructions and API call results. We demonstrate the effectiveness of the proposed method in the zero-shot domain transfer learning for dialogue state tracking. In the evaluation, the synthetic dialogue corpus generated from NeuralWOZ achieves a new state-of-the-art with improvements of 4.4% point joint goal accuracy on average across domains, and improvements of 5.7% point of zero-shot coverage against the MultiWOZ 2.1 dataset.


title: Soft Biomimetic Optical Tactile Sensing with the TacTip: A Review

abstract: Reproducing the capabilities of the human sense of touch in machines is an important step in enabling robot manipulation to have the ease of human dexterity. A combination of robotic technologies will be needed, including soft robotics, biomimetics and the high-resolution sensing offered by optical tactile sensors. This combination is considered here as a SoftBOT (Soft Biomimetic Optical Tactile) sensor. This article reviews the BRL TacTip as a prototypical example of such a sensor. Topics include the relation between artificial skin morphology and the transduction principles of human touch, the nature and benefits of tactile shear sensing, 3D printing for fabrication and integration into robot hands, the application of AI to tactile perception and control, and the recent step-change in capabilities due to deep learning. This review consolidates those advances from the past decade to indicate a path for robots to reach human-like dexterity.


title: On the multiplicities of the character codegrees

abstract: Let G be a finite group and ? be an irreducible character of G, the number cod(?) = jG : Let $ G $ be a finite group and $ \chi $ be an irreducible character of $ G $, the number $ \cod(\chi) = |G: \kernel(\chi)|/\chi(1) $ is called the codegree of $ \chi $. Also, $ \cod(G) = \{ \cod(\chi) \ | \ \chi \in \Irr(G) \} $. For $d\in\cod(G)$, the multiplicity of $d$ in $G$, denoted by $m'_G(d)$, is the number of irreducible characters of $G$ having codegree $d$. A finite group $G$ is called a $T'_k$-group for some integer $k\geq 1$, if there exists $d_0\in\cod(G)$ such that $m'_G(d_0)=k$ and for every $d\in\cod(G)-\{d_0\}$, we have $m'_G(d)=1$. In this note we characterize finite $T'_k$-groups completely, where $k\geq 1$ is an integer.


title: Learning Personal Style from Few Examples

abstract: A key task in design work is grasping the client's implicit tastes. Designers often do this based on a set of examples from the client. However, recognizing a common pattern among many intertwining variables such as color, texture, and layout and synthesizing them into a composite preference can be challenging. In this paper, we leverage the pattern recognition capability of computational models to aid in this task. We offer a set of principles for computationally learning personal style. The principles are manifested in PseudoClient, a deep learning framework that learns a computational model for personal graphic design style from only a handful of examples. In several experiments, we found that PseudoClient achieves a 79.40% accuracy with only five positive and negative examples, outperforming several alternative methods. Finally, we discuss how PseudoClient can be utilized as a building block to support the development of future design applications.


title: Model Aided Deep Learning Based MIMO OFDM Receiver With Nonlinear Power Amplifiers

abstract: Multi-input multi-output orthogonal frequency division multiplexing (MIMO OFDM) is a key technology for mobile communication systems. However, due to the issue of high peak-to-average power ratio (PAPR), the OFDM symbols may suffer from nonlinear distortions of the power amplifier (PA) at the transmitters, which degrades the channel estimation and detection performances of the receivers. To mitigate the clipping distortions at the receivers end, we leverage deep learning (DL) and devise a DL based receiver which is aided by the traditional least square (LS) channel estimation and the zero-forcing (ZF) equalization models. Moreover, a data driven DL based receiver without explicit channel estimation is proposed and combined with the model aided DL based receiver to further improve the performance. Simulation results showcase that the proposed model aided DL based receiver has superior performance of bit error rate and has robustness over different levels of clipping distortions.


title: Spectral Analysis of Current Fluctuations in Periodically Driven Stochastic Systems

abstract: Current fluctuations play an important role in non-equilibrium statistical mechanics, and are a key object of interest in both theoretical studies and in practical applications. So far, most of the studies were devoted to the fluctuations in the time-averaged current -- the zero frequency Fourier component of the time dependent current. However, in many practical applications the fluctuations at other frequencies are of equal importance. Here we study the full frequency dependence of current statistics in periodically driven stochastic systems. First, we show a general method to calculate the current statistics, valid even when the current's frequency is incommensurate with the driving frequency, breaking the time periodicity of the system. Somewhat surprisingly, we find that the cumulant generating function (CGF), that encodes all the statistics of the current, is composed of a continuous background at any frequency accompanied by either positive or negative peaks at current's frequencies commensurate with the driving frequency. We show that cumulants of increasing orders display peaks at an increasing number of locations but with decreasing amplitudes that depend on the commensurate ratio of frequencies. All these peaks are then transcribed in the behaviour of the CGF. As the measurement time increases, these peaks become sharper but keep the same amplitude and eventually lead to discontinuities of the CGF at all the frequencies that are commensurate with the driving frequency in the limit of infinitely long measurement. We demonstrate our formalism and its consequences on three types of models: an underdamped Brownian particle in a periodically driven harmonic potential; a periodically driven run-and-tumble particle; and a two-state system.


title: Analytical solutions for Ising models on high dimensional lattices

abstract: We use an m-vicinity method to examine Ising models on hypercube lattices of high dimensions d>=3. This method is applicable for both short-range and long-range interactions. We introduce a small parameter, which determines whether the method can be used when calculating the free energy. When we account for interaction with the nearest neighbors only, the value of this parameter depends on the dimension of the lattice d. We obtain an expression for the critical temperature in terms of the interaction constants that is in a good agreement with results of computer simulations. For d=5, 6, 7, our theoretical estimates match the experiments both qualitatively and quantitatively. For d=3, 4, our method is sufficiently accurate for calculation of the critical temperatures, however, it predicts a finite jump of the heat capacity at the critical point. In the case of the three-dimensional lattice (d=3), this contradicts to the commonly accepted ideas of the type of the singularity at the critical point. For the four-dimensional lattice (d = 4) the character of the singularity is under current discussion. For the dimensions d=1, 2 the m-vicinity method is not applicable.


title: A Hybrid SIE-PDE Formulation Without Boundary Condition Requirement for Transverse Magnetic Electromagnetic Analysis

abstract: A hybrid surface integral equation partial differential equation (SIE-PDE) formulation without the boundary condition requirement is proposed to solve the transverse magnetic (TM) electromagnetic problems. In the proposed formulation, the computational domain is decomposed into two overlapping domains: the SIE and PDE domains. In the SIE domain, complex structures with piecewise homogeneous media, e.g., highly conductive media, are included. An equivalent model for those structures is constructed by replacing them with the background medium and introducing a surface equivalent electric current density on an enclosed boundary to represent their electromagnetic effects. The remaining computational domain and homogeneous background medium replaced domain consist of the PDE domain, in which inhomogeneous or non-isotropic media are included. Through combining the surface equivalent electric current density and the inhomogeneous Helmholtz equation, a hybrid SIE-PDE formulation is derived. It requires no boundary conditions, and is mathematically equivalent to the original physical model. Through careful construction of basis functions to expand electric fields and the equivalent current density, the discretized formulation is made compatible with the SIE and PDE domain interface. The accuracy and efficiency are validated through two numerical examples. Results show that the proposed SIE-PDE formulation can obtain accurate results, and significant performance improvements in terms of CPU time and memory consumption compared with the FEM are achieved.


title: Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translation

abstract: A neural multimodal machine translation (MMT) system is one that aims to perform better translation by extending conventional text-only translation models with multimodal information. Many recent studies report improvements when equipping their models with the multimodal module, despite the controversy of whether such improvements indeed come from the multimodal part. We revisit the contribution of multimodal information in MMT by devising two interpretable MMT models. To our surprise, although our models replicate similar gains as recently developed multimodal-integrated systems achieved, our models learn to ignore the multimodal information. Upon further investigation, we discover that the improvements achieved by the multimodal models over text-only counterparts are in fact results of the regularization effect. We report empirical findings that highlight the importance of MMT models' interpretability, and discuss how our findings will benefit future research.


title: Approximate Implication with d-Separation

abstract: The graphical structure of Probabilistic Graphical Models (PGMs) encodes the conditional independence (CI) relations that hold in the modeled distribution. Graph algorithms, such as d-separation, use this structure to infer additional conditional independencies, and to query whether a specific CI holds in the distribution. The premise of all current systems-of-inference for deriving CIs in PGMs, is that the set of CIs used for the construction of the PGM hold exactly. In practice, algorithms for extracting the structure of PGMs from data, discover approximate CIs that do not hold exactly in the distribution. In this paper, we ask how the error in this set propagates to the inferred CIs read off the graphical structure. More precisely, what guarantee can we provide on the inferred CI when the set of CIs that entailed it hold only approximately? It has recently been shown that in the general case, no such guarantee can be provided. We prove that such a guarantee exists for the set of CIs inferred in directed graphical models, making the d-separation algorithm a sound and complete system for inferring approximate CIs. We also prove an approximation guarantee for independence relations derived from marginal CIs.


title: Comparison-limited Vector Quantization

abstract: In this paper a variation of the classic vector quantization problem is considered. In the standard formulation, a quantizer is designed to minimize the distortion between input and output when the number of reconstruction points is fixed. We consider, instead, the scenario in which the number of comparators used in quantization is fixed. More precisely, we study the case in which a vector quantizer of dimension d is comprised of k comparators, each receiving a linear combination of the inputs and producing the output value one/zero if this linear combination is above/below a certain threshold. In reconstruction, the comparators' output is mapped to a reconstruction point, chosen so as to minimize a chosen distortion measure between the quantizer input and its reconstruction. The Comparison-Limited Vector Quantization (CLVQ) problem is then defined as the problem of optimally designing the configuration of the compactors and the choice of reconstruction points so as to minimize the given distortion. In this paper, we design a numerical optimization algorithm for the CLVQ problem. This algorithm leverages combinatorial geometrical notions to describe the hyperplane arrangement induced by the configuration of the comparators. It also relies on a genetic genetic meta heuristic to improve the selection of the quantizer initialization and avoid local minima encountered during optimization. We numerically evaluate the performance of our algorithm in the case of input distributions following uniform and Gaussian i.i.d. sources to be compressed under quadratic distortion and compare it to the classic Linde-Buzo-Gray (LBG) algorithm.


title: A Brief Survey on Interactive Automotive UI

abstract: Automotive User Interface (AutoUI) is relatively a new discipline in the context of both Transportation Engineering and Human Machine Interaction (HMI). It covers various HMI aspects both inside and outside vehicle ranging from operating the vehicle itself, undertaking various secondary tasks, driver behaviour analysis, cognitive load estimation and so on. This review paper discusses various interactive HMI inside a vehicle used for undertaking secondary tasks. We divided recent HMIs through four sections on virtual touch interfaces, wearable devices, speech recognition and non-visual interfaces and eye gaze controlled systems. Finally, we summarized advantages and disadvantages of various technologies.


title: Charge Transport in and Electroluminescence from sp$^{3}$-Functionalized Carbon Nanotube Networks

abstract: The controlled covalent functionalization of semiconducting single-walled carbon nanotubes (SWCNTs) with luminescent sp$^{3}$ defects leads to additional narrow and tunable photoluminescence features in the near-infrared and even enables single-photon emission at room temperature, thus strongly expanding their application potential. However, the successful integration of sp$^{3}$-functionalized SWCNTs in optoelectronic devices with efficient defect state electroluminescence not only requires control over their emission properties but also a detailed understanding of the impact of functionalization on their electrical performance, especially in dense networks. Here, we demonstrate ambipolar, light-emitting field-effect transistors based on networks of pristine and functionalized polymer-sorted (6,5) SWCNTs. We investigate the influence of sp$^{3}$ defects on charge transport by employing electroluminescence and (charge-modulated) photoluminescence spectroscopy combined with temperature-dependent current-voltage measurements. We find that sp$^{3}$-functionalized SWCNTs actively participate in charge transport within the network as mobile carriers efficiently sample the sp$^{3}$ defects, which act as shallow trap states. While both hole and electron mobilities decrease with increasing degree of functionalization, the transistors remain fully operational, showing electroluminescence from the defect states that can be tuned by the defect density.


title: Occam Learning Meets Synthesis Through Unification

abstract: The generalizability of PBE solvers is the key to the empirical synthesis performance. Despite the importance of generalizability, related studies on PBE solvers are still limited. In theory, few existing solvers provide theoretical guarantees on generalizability, and in practice, there is a lack of PBE solvers with satisfactory generalizability on important domains such as conditional linear integer arithmetic (CLIA). In this paper, we adopt a concept from the computational learning theory, Occam learning, and perform a comprehensive study on the framework of synthesis through unification (STUN), a state-of-the-art framework for synthesizing programs with nested if-then-else operators. We prove that Eusolver, a state-of-the-art STUN solver, does not satisfy the condition of Occam learning, and then we design a novel STUN solver, PolyGen, of which the generalizability is theoretically guaranteed by Occam learning. We evaluate PolyGen on the domains of CLIA and demonstrate that PolyGen significantly outperforms two state-of-the-art PBE solvers on CLIA, Eusolver and Euphony, on both generalizability and efficiency.


title: Understanding the chemical mechanism behind photo-induced enhanced Raman spectroscopy

abstract: Photo-Induced Enhanced Raman Spectroscopy (PIERS) is a new surface enhanced Raman spectroscopy (SERS) modality with an order-of-magnitude Raman signal enhancement of adsorbed analytes over that of typical SERS substrates. Despite the impressive PIERS enhancement factors and explosion in recent demonstrations of its utility, the detailed enhancement mechanism remains undetermined. Using a range of optical and X-ray spectroscopies, supported by density functional theory calculations, we elucidate the chemical and atomic-scale mechanism behind the PIERS enhancement. Stable PIERS substrates with enhancement factors of 10^6 were fabricated using self-organized hexagonal arrays of TiO2 nanotubes that were defect-engineered via annealing in inert atmospheres, and silver nanoparticles were deposited by magnetron sputtering and subsequent thermal dewetting. We identified the key source of the enhancement of PIERS vs. SERS in these structures as an increase in the Raman polarizability of the adsorbed probe molecule upon photo-induced charge transfer. A balance between crystallinity, which enhances charge transfer due to higher electron mobility in anatase-rutile heterostructures but decreases visible light absorption, and oxygen vacancy defects, which increase visible light absorption and photo-induced electron transfers, was critical to achieve high PIERS enhancements.

categories: cond-mat.mtrl-sci cond-mat.mes-hall physics.app-ph physics.optics


title: Signature of spin-resolved quantum point contact in p-type trilayer WSe$_{2}$ van der Waals heterostructure

abstract: In this study, the electrostatically induced quantum confinement structure, quantum point contact, has been realized in p-type trilayer tungsten diselenide-based van der Waals heterostructure with modified van der Waals contact method with degenerately doped transition metal dichalcogenide crystals. Clear quantized conductance and pinch-off state through the one-dimensional confinement were observed by dual-gating of split gate electrodes and top gate. Conductance plateaus were observed at step of 0.5 $\times$ 2e$^{2}$/h at zero and high magnetic field in addition to quarter plateaus at a finite bias voltage condition indicating the signature of spin-polarized quantum point contact realization.


title: Internet of Everything Driven Neuromarketing: Key Technologies and Challenges

abstract: Preserving customers' expectations and understanding factors affecting their purchasing decisions would significantly affect designing effective marketing and advertising strategies. However, constantly and swiftly changing the customers' interests and consumption behaviors, make it inevitable to utilize the sophisticated tools and approaches based on advanced technologies. Among them, neuromarketing by measuring the customers' physiological and neural signals, studying the consumers' cognitive, and affective responses to marketing stimulus, provides deep insight into the customers' motivations, preferences, and decisions. Recently, the Internet of Everything (IoE) has brought many new opportunities to the industry and has attracted the attention of many researchers in recent years. The main objective of this paper is to address how the Internet of Everything (IoE) would empower neuromarketing techniques. In particular, applications of IoE gadgets and devices in eleven groups of neuromarketing techniques are discussed to present numerous solutions that would help meet this goal. Moreover, we present an in-depth understanding of current research issues as well as emerging trends.


title: Reducing the Deployment-Time Inference Control Costs of Deep Reinforcement Learning Agents via an Asymmetric Architecture

abstract: Deep reinforcement learning (DRL) has been demonstrated to provide promising results in several challenging decision making and control tasks. However, the required inference costs of deep neural networks (DNNs) could prevent DRL from being applied to mobile robots which cannot afford high energy-consuming computations. To enable DRL methods to be affordable in such energy-limited platforms, we propose an asymmetric architecture that reduces the overall inference costs via switching between a computationally expensive policy and an economic one. The experimental results evaluated on a number of representative benchmark suites for robotic control tasks demonstrate that our method is able to reduce the inference costs while retaining the agent's overall performance.


title: The Dial-a-Ride Problem in Primary Care with Flexible Scheduling

abstract: Patient transportation systems are instrumental in lowering access barriers in primary care by taking patients to their GPs. As part of this setting, each transportation request of a chronic or walk-in patient consists of an outbound trip to the GP and an inbound trip back home. The economic sustainability of patient transportation systems mainly depends on their utilization and how well transportation requests can be bundled through ride sharing. To ease the latter, we consider a flexible scheduling of chronic patients in which only a certain range for an appointment is fixed a priori while the exact time is determined by the scheduling of the outbound trip. This leads to a novel extension of the dial-a-ride problem that we call the dial-a-ride problem with combined requests and flexible scheduling (DARPCF). In this paper, we introduce two heuristics for the DARPCF that exploit this increased flexibility. Both approaches initially compute so-called mini-clusters of outbound requests. Then, the mini-clusters are linked by (i) solving a traveling salesman problem and creating routes of outbound rides with a splitting procedure or by (ii) using a rolling horizon approach and solving bipartite matching problems for the vehicle assignment. Our computational study shows that by using the presented algorithms with the flexible scheduling of chronic appointments, the average number of served requests can be increased by 16% compared to a non-flexible setting.


title: Determining the Credibility of Science Communication

abstract: Most work on scholarly document processing assumes that the information processed is trustworthy and factually correct. However, this is not always the case. There are two core challenges, which should be addressed: 1) ensuring that scientific publications are credible -- e.g. that claims are not made without supporting evidence, and that all relevant supporting evidence is provided; and 2) that scientific findings are not misrepresented, distorted or outright misreported when communicated by journalists or the general public. I will present some first steps towards addressing these problems and outline remaining challenges.


title: $p$-nilpotency criteria for some verbal subgroups

abstract: Let $G$ be a finite group, let $p$ be a prime and let $w$ be a group-word. We say that $G$ satisfies $P(w,p)$ if the prime $p$ divides the order of $xy$ for every $w$-value $x$ in $G$ of $p'$-order and for every non-trivial $w$-value $y$ in $G$ of order divisible by $p$. If $k \geq 2$, we prove that the $k$th term of the lower central series of $G$ is $p$-nilpotent if and only if $G$ satisfies $P(\gamma_k,p)$. In addition, if $G$ is soluble, we show that the $k$th term of the derived series of $G$ is $p$-nilpotent if and only if $G$ satisfies $P(\delta_k,p)$.


title: Intelligently Wireless Batteryless RF-Powered Reconfigurable Surface

abstract: This work exploits commodity, ultra-low cost, commercial radio frequency identification tags (RFID) as the elements of a reconfigurable surface. Such batteryless tags are powered and controlled by a software-defined (SDR) reader, with properly modified software, so that a source-destination link is assisted, operating at a different carrier frequency. In terms of theory, the optimal gain and corresponding best element configuration is offered, with tractable polynomial complexity (instead of exponential) in number of elements. In terms of practice, a concrete way to design and prototype a wireless, batteryless, RF-powered, reconfigurable surface is offered and a proof-of-concept is experimentally demonstrated. It is also found that even with perfect channel estimation, the weak nature of backscattered links limits the performance gains, even for large number of surface elements. Impact of channel estimation errors is also studied. Future extensions at various carrier frequencies could be directly accommodated, through simple modifications in the antenna and matching network of each RFID tag/surface element.


title: CSCAD: Correlation Structure-based Collective Anomaly Detection in Complex System

abstract: Detecting anomalies in large complex systems is a critical and challenging task. The difficulties arise from several aspects. First, collecting ground truth labels or prior knowledge for anomalies is hard in real-world systems, which often lead to limited or no anomaly labels in the dataset. Second, anomalies in large systems usually occur in a collective manner due to the underlying dependency structure among devices or sensors. Lastly, real-time anomaly detection for high-dimensional data requires efficient algorithms that are capable of handling different types of data (i.e. continuous and discrete). We propose a correlation structure-based collective anomaly detection (CSCAD) model for high-dimensional anomaly detection problem in large systems, which is also generalizable to semi-supervised or supervised settings. Our framework utilize graph convolutional network combining a variational autoencoder to jointly exploit the feature space correlation and reconstruction deficiency of samples to perform anomaly detection. We propose an extended mutual information (EMI) metric to mine the internal correlation structure among different data features, which enhances the data reconstruction capability of CSCAD. The reconstruction loss and latent standard deviation vector of a sample obtained from reconstruction network can be perceived as two natural anomalous degree measures. An anomaly discriminating network can then be trained using low anomalous degree samples as positive samples, and high anomalous degree samples as negative samples. Experimental results on five public datasets demonstrate that our approach consistently outperforms all the competing baselines.


title: Towards Diverse Paragraph Captioning for Untrimmed Videos

abstract: Video paragraph captioning aims to describe multiple events in untrimmed videos with descriptive paragraphs. Existing approaches mainly solve the problem in two steps: event detection and then event captioning. Such two-step manner makes the quality of generated paragraphs highly dependent on the accuracy of event proposal detection which is already a challenging task. In this paper, we propose a paragraph captioning model which eschews the problematic event detection stage and directly generates paragraphs for untrimmed videos. To describe coherent and diverse events, we propose to enhance the conventional temporal attention with dynamic video memories, which progressively exposes new video features and suppresses over-accessed video contents to control visual focuses of the model. In addition, a diversity-driven training strategy is proposed to improve diversity of paragraph on the language perspective. Considering that untrimmed videos generally contain massive but redundant frames, we further augment the video encoder with keyframe awareness to improve efficiency. Experimental results on the ActivityNet and Charades datasets show that our proposed model significantly outperforms the state-of-the-art performance on both accuracy and diversity metrics without using any event boundary annotations. Code will be released at https://github.com/syuqings/video-paragraph.


title: Pre-training Universal Language Representation

abstract: Despite the well-developed cut-edge representation learning for language, most language representation models usually focus on specific levels of linguistic units. This work introduces universal language representation learning, i.e., embeddings of different levels of linguistic units or text with quite diverse lengths in a uniform vector space. We propose the training objective MiSAD that utilizes meaningful n-grams extracted from large unlabeled corpus by a simple but effective algorithm for pre-trained language models. Then we empirically verify that well designed pre-training scheme may effectively yield universal language representation, which will bring great convenience when handling multiple layers of linguistic objects in a unified way. Especially, our model achieves the highest accuracy on analogy tasks in different language levels and significantly improves the performance on downstream tasks in the GLUE benchmark and a question answering dataset.


title: Constraining the relativistic mean-field models from PREX-2 data: Effective forces revisited

abstract: Based on the current measurement of the neutron distribution radius ($R_n$) of $^{208}$Pb through the PREX-2 data, we re-visited the recently developed G3 and IOPB-I force parameter by fine-tuning some of the specific couplings within the relativistic mean-field model. The $\omega-\rho-$mesons coupling $\Lambda_{\omega}$ and the $\rho-$meson coupling $g_{\rho}$ are refitted to reproduce the experimental neutron radius of $^{208}$Pb without compromising the bulk properties of finite nuclei and infinite nuclear matter observables. The modified parameter sets are applied to calculate the gross properties of finite nuclei for a few double closed-shell nuclei and further used to obtain the various infinite nuclear matter observables at saturation. In addition to these, the force parameters are adopted to calculate the properties of high isospin asymmetry dense system such as neutron star matter and tested for the validation for the constraint from GW170817 binary neutron star merger events. The tuned forces are predicting relatively good results for finite and infinite nuclear matter systems and the current limitation on neutron radius from PREX-2. A systematic analysis using these two refitted parameter sets over the nuclear chat will be communicated shortly.


title: Binary comb models for FRB 121102

abstract: The first repeating fast radio burst source, FRB 121102, is observed to emit bursts periodically. We show that FRB 121102 can be interpreted as an interacting neutron star binary system with an orbital period of 159 days. We develop a binary comb model by introducing an eccentricity in the orbit. Besides the original funnel mode of the binary comb model, which was applied to FRB 180916.J0158+65 by Ioka and Zhang 2020, we also identify two new modes of the binary comb model, i.e. the tau-crossing mode and the inverse funnel mode, and apply them to interpret FRB 121102. These new developments expand the applicable parameter space, allowing the companion star to be a massive star, a massive black hole, or a supermassive black hole, with the latter two having larger parameter spaces. These models are also consistent with other observations, such as the persistent bright radio counterpart associated with the source. We also argue that the observed frequency dependence of the active window does not disfavor the binary comb model, in contrast to recent claims, and propose two possible scenarios to interpret the data.


title: Modelling Chromatic Emittance Growth in Staged Plasma Wakefield Acceleration to 1 TeV using Nonlinear Transfer Matrices

abstract: A framework for integrating transfer matrices with particle-in-cell simulations is developed for TeV staging of plasma wakefield accelerators. Using nonlinear transfer matrices in terms up to ninth order in normalized energy spread $\sqrt{\langle\delta\gamma^2\rangle}$ and deriving a compact expression for the chromatic emittance growth in terms of the nonlinear matrix, plasma wakefield accelerating stages simulated using the three-dimensional particle-in-cell framework OSIRIS 4.0 were combined to model acceleration of an electron beam from 10 GeV to 1 TeV in 85 plasma stages of meter scale-length with long density ramps and connected by simple focusing lenses. In this calculation, we find that for initial relative energy spreads below $10^{-3}$, energy-spread growth below $10^{-5}$ of the energy gain per stage and normalized emittance below mm-mrad, the chromatic emittance growth can be minimal. The technique developed here may be useful for plasma collider design, and potentially could be expanded to encompass non-linear wake structures and include other degrees of freedom such as lepton spin.


title: Investigation of Accelerated Hydration in Nanosilica Incorporated Tricalcium Silicate using THz Spectroscopy

abstract: The incorporation of nanosilica in cementitious systems helps in accelerating the cement hydration process and early-stage formation of the main hydration product, that is, calcium silicate hydrate. Nanosilica reacts with the other key hydration product, calcium hydroxide to form additional calcium silicate hydrate. In this work, Terahertz spectroscopy has been employed to study the variation in hydration kinetics of the main constituent of cement, Tricalcium Silicate, due to the addition of different percentages of nanosilica. The variation has been analyzed in terms of change in the absorbance as well as a shift in the wavenumber of the key resonances. The resonance around 520, 514 cm-1, due to symmetric-asymmetric bending of silicate tetrahedral units, decreases in intensity very rapidly as hydration progresses and more so for the nanosilica incorporated samples demonstrating accelerated hydration. Interestingly, the resonance around 451 cm-1, due to symmetric and asymmetric bending of silicate tetrahedral units along with some contribution of vibrational modes of calcium oxide polyhedral units, does not show a similar decrease in intensity. The prominence of the resonance around 451 cm-1 even after the onset of hydration is found to be mostly due to the contribution from the vibrational modes of the newly formed silicates tetrahedra chains of calcium silicate hydrate. Early-stage formation of calcium silicate hydrate due to nanosilica incorporation has been analyzed by tracking the shift in resonances as polymerized chains of silicates are formed. These results have been corroborated with Scanning Electron Microscopy results which clearly show the early changes in the morphology of the hydrated C3S due to nanosilica incorporation.


title: Computation of Eigenvalues for Nonlocal Models by Spectral Methods

abstract: The purpose of this work is to study spectral methods to approximate the eigenvalues of nonlocal integral operators. Indeed, even if the spatial domain is an interval, it is very challenging to obtain closed analytical expressions for the eigenpairs of peridynamic operators. Our approach is based on the weak formulation of eigenvalue problem and we consider as orthogonal basis to compute the eigenvalues a set of Fourier trigonometric or Chebyshev polynomials. We show the order of convergence for eigenvalues and eigenfunctions in $L^2$-norm, and finally, we perform some numerical simulations to compare the two proposed methods.


title: Joint Training of the Superimposed Direct and Reflected Links in Reconfigurable Intelligent Surface Assisted Multiuser Communications

abstract: In Reconfigurable intelligent surface (RIS)-assisted systems the acquisition of CSI and the optimization of the reflecting coefficients constitute a pair of salient design issues. In this paper, a novel channel training protocol is proposed, which is capable of achieving a flexible performance vs. signalling and pilot overhead as well as implementation complexity trade-off. More specifically, first of all, we conceive a holistic channel estimation protocol, which integrates the existing channel estimation techniques and passive beamforming design. Secondly, we propose a new channel training framework. In contrast to the conventional channel estimation arrangements, our new framework divides the training phase into several periods, where the superimposed end-to-end channel is estimated instead of separately estimating the direct BS-user channel and cascaded reflected BS-RIS-user channels. As a result, the reflecting coefficients of the RIS are optimized by comparing the objective function values over multiple training periods. Moreover, the theoretical performance of our channel training protocol is analyzed and compared to that under the optimal reflecting coefficients. In addition, the potential benefits of our channel training protocol in reducing the complexity, pilot overhead as well as signalling overhead are also detailed. Thirdly, we derive the theoretical performance of channel estimation protocols and our channel training protocol in the presence of noise for a SISO scenario, which provides useful insights into the impact of the noise on the overall RIS performance. Finally, our numerical simulations characterize the performance of the proposed protocols and verify our theoretical analysis. In particular, the simulation results demonstrate that our channel training protocol is more competitive than the channel estimation protocol at low signal-to-noise ratios.


title: CLEVE: Contrastive Pre-training for Event Extraction

abstract: Event extraction (EE) has considerably benefited from pre-trained language models (PLMs) by fine-tuning. However, existing pre-training methods have not involved modeling event characteristics, resulting in the developed EE models cannot take full advantage of large-scale unsupervised data. To this end, we propose CLEVE, a contrastive pre-training framework for EE to better learn event knowledge from large unsupervised data and their semantic structures (e.g. AMR) obtained with automatic parsers. CLEVE contains a text encoder to learn event semantics and a graph encoder to learn event structures respectively. Specifically, the text encoder learns event semantic representations by self-supervised contrastive learning to represent the words of the same events closer than those unrelated words; the graph encoder learns event structure representations by graph contrastive pre-training on parsed event-related semantic structures. The two complementary representations then work together to improve both the conventional supervised EE and the unsupervised "liberal" EE, which requires jointly extracting events and discovering event schemata without any annotated data. Experiments on ACE 2005 and MAVEN datasets show that CLEVE achieves significant improvements, especially in the challenging unsupervised setting. The source code and pre-trained checkpoints can be obtained from https://github.com/THU-KEG/CLEVE.


title: Optimality of the recursive Neyman allocation

abstract: We derive a formula for the optimal sample allocation in a general stratified scheme under upper bounds on the sample strata-sizes. Such a general scheme includes SRSWOR within strata as a special case. The solution is given in terms of V-allocation with V being the set of take-all strata. We use V-allocation to give a formal proof of optimality of the popular recursive Neyman algorithm, rNa. This approach is convenient also for a quick proof of optimality of the algorithm of Stenger and Gabler (2005), SGa, as well as of its modification, coma, we propose here. Finally, we compare running times of rNa, SGa and coma. Ready-to-use R-implementations of these algorithms are available on CRAN repository at https://cran.r-project.org/web/packages/stratallo.


title: Surface characterization of p-type point contact germanium detectors

abstract: P-type point contact (PPC) germanium detectors are used in rare event and low-background searches, including neutrinoless double beta (0vbb) decay, low-energy nuclear recoils, and coherent elastic neutrino-nucleus scattering. The detectors feature an excellent energy resolution, low detection thresholds down to the sub-keV range, and enhanced background rejection capabilities. However, due to their large passivated surface, separating the signal readout contact from the bias voltage electrode, PPC detectors are susceptible to surface effects such as charge build-up. A profound understanding of their response to surface events is essential. In this work, the response of a PPC detector to alpha and beta particles hitting the passivated surface was investigated in a multi-purpose scanning test stand. It is shown that the passivated surface can accumulate charges resulting in a radial-dependent degradation of the observed event energy. In addition, it is demonstrated that the pulse shapes of surface alpha events show characteristic features which can be used to discriminate against these events.


title: REAM$\sharp$: An Enhancement Approach to Reference-based Evaluation Metrics for Open-domain Dialog Generation

abstract: The lack of reliable automatic evaluation metrics is a major impediment to the development of open-domain dialogue systems. Various reference-based metrics have been proposed to calculate a score between a predicted response and a small set of references. However, these metrics show unsatisfactory correlations with human judgments. For a reference-based metric, its reliability mainly depends on two factors: its ability to measure the similarity between the predicted response and the reference response, as well as the reliability of the given reference set. Yet, there are few discussions on the latter. Our work attempts to fill this vacancy. We first clarify an assumption on reference-based metrics that, if more high-quality references are added into the reference set, the reliability of the metric will increase. Next, we present REAM$\sharp$: an enhancement approach to Reference-based EvAluation Metrics for open-domain dialogue systems. A prediction model is designed to estimate the reliability of the given reference set. We show how its predicted results can be helpful to augment the reference set, and thus improve the reliability of the metric. Experiments validate both the effectiveness of our prediction model and that the reliability of reference-based metrics improves with the augmented reference sets.


title: An empirical nonlinear power spectrum overdensity-response

abstract: Context. The overdensity inside a cosmological sub-volume and the tidal fields from its surroundings affect the matter distribution of the region. The resulting difference between the local and global power spectra is characterized by the response function. Aims. Our aim is to provide a new, simple, and accurate formula for the power spectrum overdensity response at highly nonlinear scales based on the results of cosmological simulations and paying special attention to the lognormal nature of the density field. Methods. We measured the dark matter power spectrum amplitude as a function of the overdensity ($\delta_W$) in $N$-body simulation subsamples. We show that the response follows a power-law form in terms of $(1+\delta_W)$, and we provide a new fit in terms of the variance, $\sigma(L)$, of a sub-volume of size $L$. Results. Our fit has a similar accuracy and a comparable complexity to second-order standard perturbation theory on large scales, but it is also valid for nonlinear (smaller) scales, where perturbation theory needs higher-order terms for a comparable precision. Furthermore, we show that the lognormal nature of the overdensity distribution causes a previously unidentified bias: the power spectrum amplitude for a subsample with an average density is typically underestimated by about $-2\sigma^2$. Although this bias falls to the sub-percent level above characteristic scales of $200Mpch^{-1}$, taking it into account improves the accuracy of estimating power spectra from zoom-in simulations and smaller high-resolution surveys embedded in larger low-resolution volumes.


title: Relational Graph Neural Network Design via Progressive Neural Architecture Search

abstract: We propose a novel solution to addressing a long-standing dilemma in the representation learning of graph neural networks (GNNs): how to effectively capture and represent useful information embedded in long-distance nodes to improve the performance of nodes with low homophily without leading to performance degradation in nodes with high homophily. This dilemma limits the generalization capability of existing GNNs. Intuitively, interactions with distant nodes introduce more noise for a node than those with close neighbors. However, in most existing works, messages being passed among nodes are mingled together, which is inefficient from a communication perspective. Our solution is based on a novel, simple, yet effective aggregation scheme, resulting in a ladder-style GNN architecture, namely LADDER-GNN. Specifically, we separate messages from different hops, assign different dimensions for them, and then concatenate them to obtain node representations. Such disentangled representations facilitate improving the information-to-noise ratio of messages passed from different hops. To explore an effective hop-dimension relationship, we develop a conditionally progressive neural architecture search strategy. Based on the searching results, we further propose an efficient approximate hop-dimension relation function to facilitate the rapid configuration of the proposed LADDER-GNN. We verify the proposed LADDER-GNN on seven diverse semi-supervised node classification datasets. Experimental results show that our solution achieves better performance than most existing GNNs. We further analyze our aggregation scheme with two commonly used GNN architectures, and the results corroborate that our scheme outperforms existing schemes in classifying low homophily nodes by a large margin.


title: How Attentive are Graph Attention Networks?

abstract: Graph Attention Networks (GATs) are one of the most popular GNN architectures and are considered as the state-of-the-art architecture for representation learning with graphs. In GAT, every node attends to its neighbors given its own representation as the query. However, in this paper we show that GAT computes a very limited kind of attention: the ranking of the attention scores is unconditioned on the query node. We formally define this restricted kind of attention as static attention and distinguish it from a strictly more expressive dynamic attention. Because GATs use a static attention mechanism, there are simple graph problems that GAT cannot express: in a controlled problem, we show that static attention hinders GAT from even fitting the training data. To remove this limitation, we introduce a simple fix by modifying the order of operations and propose GATv2: a dynamic graph attention variant that is strictly more expressive than GAT. We perform an extensive evaluation and show that GATv2 outperforms GAT across 11 OGB and other benchmarks while we match their parametric costs. Our code is available at https://github.com/tech-srl/how_attentive_are_gats . GATv2 is available as part of the PyTorch Geometric library, the Deep Graph Library, and the TensorFlow GNN library.


title: Design Study of APSU Type Hybrid MBA Lattice for Mid Energy DLSR

abstract: In recent years, a new generation of storage ring based light sources, known as diffraction limited storage rings (DLSRs), whose emittance approaches the diffraction limit for the range of X ray wavelengths of interest to the scientific community, has garnered significant attention worldwide. Researchers have begun to design and build DLSRs. Among various DLSR proposals, the hybrid multibend achromat (HMBA) lattice enables sextupole strengths to be maintained at a reasonable level when minimizing the emittance; hence, it has been adopted in many DLSR designs. Based on the H7BA lattice, the design of the Advanced Photon Source Upgrade Project (APSU) can effectively reduce emittance by replacing six quadrupoles with antibends. Herein, we discuss the feasibility of designing an APSU type HMBA lattice for the Southern Advanced Photon Source, a mid energy DLSR light source with ultralow emittance that has been proposed to be built adjacent to the China Spallation Neutron Source. Both linear and nonlinear dynamics are optimized to obtain a detailed design of this type of lattice. The emittance is minimized, while a sufficiently large dynamic aperture (DA) and momentum acceptance (MA) are maintained. A design comprising 36 APSU type H7BAs, with an energy of 3 GeV and a circumference of 972 m, is achieved. The horizontal natural emittance is 20 pm rad, with a horizontal DA of 5.8 mm, a vertical DA of 4.5 mm, and an MA of 4%, as well as a long longitudinal damping time of 120 ms. Subsequently, a few modifications are performed based on the APSU type lattice to reduce the longitudinal damping time from 120 to 44 ms while maintaining other performance parameters at the same level.


title: Generating Ten BCI Commands Using Four Simple Motor Imageries

abstract: The brain computer interface (BCI) systems are utilized for transferring information among humans and computers by analyzing electroencephalogram (EEG) recordings.The process of mentally previewing a motor movement without generating the corporal output can be described as motor imagery (MI).In this emerging research field, the number of commands is also limited in relation to the number of MI tasks; in the current literature, mostly two or four commands (classes) are studied. As a solution to this problem, it is recommended to use mental tasks as well as MI tasks. Unfortunately, the use of this approach reduces the classification performance of MI EEG signals. The fMRI analyses show that the resources in the brain associated with the motor imagery can be activated independently. It is assumed that the brain activity induced by the MI of the combination of body parts corresponds to the superposition of the activities generated during each body parts's simple MI. In this study, in order to create more than four BCI commands, we suggest to generate combined MI EEG signals artificially by using left hand, right hand, tongue, and feet motor imageries in pairs. A maximum of ten different BCI commands can be generated by using four motor imageries in pairs.This study aims to achieve high classification performances for BCI commands produced from four motor imageries by implementing a small-sized deep neural network (DNN).The presented method is evaluated on the four-class datasets of BCI Competitions III and IV, and an average classification performance of 81.8% is achieved for ten classes. The above assumption is also validated on a different dataset which consists of simple and combined MI EEG signals acquired in real time. Trained with the artificially generated combined MI EEG signals, DivFE resulted in an average of 76.5% success rate for the combined MI EEG signals acquired in real-time.


title: Enhancement of superconductivity by electronic nematicity in cuprate superconductors

abstract: The cuprate superconductors are characterized by numerous ordering tendencies, with the nematic order being the most distinct form of order. Here the intertwinement of the electronic nematicity with superconductivity in cuprate superconductors is studied based on the kinetic-energy-driven superconductivity. It is shown that the optimized Tc takes a dome-like shape with the weak and strong strength regions on each side of the optimal strength of the electronic nematicity, where the optimized Tc reaches its maximum. This dome-like shape nematic-order strength dependence of Tc indicates that the electronic nematicity enhances superconductivity. Moreover, this nematic order induces the anisotropy of the electron Fermi surface (EFS), where although the original EFS with the four-fold rotation symmetry is broken up into that with a residual two-fold rotation symmetry, this EFS with the two-fold rotation symmetry still is truncated to form the Fermi arcs with the most spectral weight that locates at the tips of the Fermi arcs. Concomitantly, these tips of the Fermi arcs connected by the wave vectors ${\bf q}_{i}$ construct an octet scattering model, however, the partial wave vectors and their respective symmetry-corresponding partners occur with unequal amplitudes, leading to these ordered states being broken both rotation and translation symmetries. As a natural consequence, the electronic structure is inequivalent between the $k_{x}$ and $k_{y}$ directions. These anisotropic features of the electronic structure are also confirmed via the result of the autocorrelation of the single-particle excitation spectra, where the breaking of the rotation symmetry is verified by the inequivalence on the average of the electronic structure at the two Bragg scattering sites. Furthermore, the strong energy dependence of the order parameter of the electronic nematicity is also discussed.


title: Quartic asymmetric exchange for two-dimensional ferromagnets with trigonal prismatic symmetry

abstract: We suggest a possible origin of noncollinear magnetic textures in ferromagnets (FMs) with the $D_{3h}$ point group symmetry. The suggested mechanism is different from the Dzyaloshinskii-Moriya interaction (DMI) and its straightforward generalizations. The considered symmetry class is important because a large fraction of all single-layer intrinsic FMs should belong to it. In particular, so does a monolayer Fe$_3$GeTe$_2$. At the same time, DMI vanishes identically in materials described by this point group, in the continuous limit. We use symmetry analysis to identify the only possible contribution to the free energy density in two dimensions that is of the fourth order with respect to the local magnetization direction and linear with respect to its spatial derivatives. This contribution predicts long-range conical magnetic spirals with both the average magnetization and the average chirality dependent on the spiral propagation direction. We relate the predicted spirals to a recent experiment on Fe$_3$GeTe$_2$. Finally, we demonstrate that, for easy-plane materials, the same mechanism may stabilize bimerons.


title: Darboux integrability for diagonal systems of hydrodynamic type

abstract: We prove that 1) diagonal systems of hydrodynamic type are Darboux integrable if and only if the corresponding systems for commuting flows are Darboux integrable, 2) systems for commuting flows are Darboux integrable if and only if the Laplace transformation sequences terminate, 3) Darboux integrable systems are necessarily semihamiltonian. We give geometric interpretation for Darboux integrability of such systems in terms of congruences of lines and in terms of solution orbits with respect to symmetry subalgebras, discuss known and new examples.


title: On the wheeled PROP of stable cohomology of Aut(F_n) with bivariant coefficients

abstract: We show that the stable cohomology of automorphism groups of free groups with coefficients obtained by applying Hom(-,-) to tensor powers of the abelianization, is equipped with the structure of a wheeled PROP H. We define another wheeled PROP E by Ext-groups in the category of functors from the category of finitely generated free groups to k-modules. The main result of this paper is the construction of a morphism of wheeled PROPs $\phi: E \to H$ such that $\phi(E)$ is the wheeled PROP generated by the cohomology class h_1 constructed by the first author.


title: Quantum interference control of perfect photon absorption in a three-level atom-cavity system

abstract: We analyze a scheme for controlling coherent photon absorption by cavity electromagnetically induced transparency (EIT) in a three-level atom-cavity system. Coherent perfect absorption (CPA) can occur when time-reversed symmetry of lasing process is obtained and destructive interference happens at the cavity interfaces. Generally, the frequency range of CPA is dependent on the decay rates of cavity mirrors. When the control laser is settled, the smaller cavity decay rate causes the wider frequency range of CPA, and the input intensity is larger to satisfy CPA condition for a given frequency. While the cavity parameters are determined, Rabi frequency of the control laser has little effect on the frequency range of CPA. However, with EIT-type quantum interference, the CPA mode is tunable by the control laser. This means the CPA with given frequency and intensity of an input laser can be manipulated as the coherent non-perfect absorption (CNPA). Moreover, with the relative phase of input probe lasers, the probe fields can be perfectly transmitted and/or reflected. Therefore, the system can be used as a controllable coherent perfect absorber or transmitter and/or reflector, and our work may have practical applications in optical logic devices.


title: Perceived Safety in Physical Human Robot Interaction -- A Survey

abstract: This review paper focuses on different aspects of perceived safety for a number of autonomous physical systems. This is a major aspect of robotics research, as more and more applications allow human and autonomous systems to share their space, with crucial implications both on safety and on its perception. The alternative terms used to express related concepts (e.g., psychological safety, trust, comfort, stress, fear, and anxiety) are listed and explained. Then, the available methods to assess perceived safety (i.e., questionnaires, physiological measurements, behavioral assessment, and direct input devices) are described. Six categories of autonomous systems are considered (industrial manipulators, mobile robots, mobile manipulators, humanoid robots, drones, and autonomous vehicles), providing an overview of the main themes related to perceived safety in the specific domain, a description of selected works, and an analysis of how motion and characteristics of the system influence the perception of safety. The survey also discusses experimental duration and location of the reviewed papers as well as identified trends over time.


title: Tesseract: Parallelize the Tensor Parallelism Efficiently

abstract: Together with the improvements in state-of-the-art accuracies of various tasks, deep learning models are getting significantly larger. However, it is extremely difficult to implement these large models because limited GPU memory makes it impossible to fit large models into a single GPU or even a GPU server. Besides, it is highly necessary to reduce the training time for large models. Previous methods like Megatron-LM implemented a 1-Dimensional distributed method to use GPUs to speed up the training. However, these methods have a high communication overhead and a low scaling efficiency on large-scale clusters. To solve these problems, we propose Tesseract, a highly scalable tensor parallelism with a novel design. It increases efficiency by reducing communication overhead and lowers the memory required for each GPU. By introducing the novel dimension into tensor parallelism, Tesseract greatly increases the memory capacity of tensor parallelism. Concretely, this new dimension furthermore increases the degree of tensor parallelism. Compared to previous 1-D and 2-D methods, Tesseract manages to reduce the communication cost on each layer, resulting in speedups of 1.38x and 1.53x respectively with strong scaling. In weak scaling experiments, Tesseract achieves a maximum of 4.0/1.7 times inference speedup and 3.4/1.7 times throughput improvement compared to 1-D/2-D methods, respectively. By introducing Tesseract, we offer a more efficient and scalable way to implement large deep learning models with limited GPU resources.


title: Swampland de Sitter Conjectures in No-Scale Supergravity Models

abstract: It is challenging to construct explicit and controllable models that realize de Sitter solutions in string compactifications. This difficulty is the main motivation for the Refined de Sitter Conjecture and the Trans-Planckian Censorship Conjecture which forbid stable de Sitter solutions but allow metastable, unstable and rolling solutions in a theory consistent with quantum gravity. Inspired by this, we first study a toy de Sitter No-Scale Supergravity model and show that for particular choices of parameters it can be consistent with the Refined de Sitter Conjecture and the Trans-Planckian Censorship Conjecture. Then we modify the model by adding rolling dynamics and show that the theory can become stable along the imaginary direction, where it would otherwise be unstable. We extend the model to multi-field rolling and de Sitter fields, finding the parameter space where they can be compatible with the Refined de Sitter Conjecture . The modified models with rolling fields can be used to construct Quintessence models to accommodate the accelerating expansion of the Universe.


title: Normal Inverse Gaussian Autoregressive Model Using EM Algorithm

abstract: In this article, normal inverse Gaussian (NIG) autoregressive model is introduced. The parameters of the model are estimated using Expectation Maximization (EM) algorithm. The efficacy of the EM algorithm is shown using simulated and real world financial data. It is shown that NIG autoregressive model fit very well the considered financial data and hence could be useful in modeling of various real life time-series data.


title: Merging timescale for supermassive black hole binary in interacting galaxy NGC 6240

abstract: One of the main possible way of creating the supermassive black hole (SMBH) is a so call hierarchical merging scenario. Central SMBHs at the final phase of interacting and coalescing host-galaxies are observed as SMBH binary (SMBHB) candidates at different separations from hundreds of pc to mpc. Today one of the strongest SMBHB candidate is a ULIRG galaxy NGC 6240 which was X-ray spatially and spectroscopically resolved by Chandra. Dynamical calculation of central SMBHBs merging in a dense stellar environment allows us to retrace their evolution from kpc to mpc scales. The main goal of our dynamical modeling was to reach the final, gravitational wave (GW) emission regime for the model BHs. We present the direct N-body simulations with up to one million particles and relativistic post-Newtonian corrections for the SMBHs particles up to 3.5 post-Newtonian terms. Generally speaking, the set of initial physical conditions can strongly effect of our merging time estimations. But in a range of our parameters, we did not find any strong correlation between merging time and BHs mass or BH to bulge mass ratios. Varying the model numerical parameters (such as particle number - N) makes our results quite robust and physically more motivated. From our 20 models we found the upper limit of merging time for central SMBHB is less than $\sim$55 Myr. This concrete number are valid only for our set of combination of initial mass ratios. Further detailed research of rare dual/multiple BHs in dense stellar environment (based on observations data) can clarify the dynamical co-evolution of central BHs and their host-galaxies.


title: Structured Sentiment Analysis as Dependency Graph Parsing

abstract: Structured sentiment analysis attempts to extract full opinion tuples from a text, but over time this task has been subdivided into smaller and smaller sub-tasks, e,g,, target extraction or targeted polarity classification. We argue that this division has become counterproductive and propose a new unified framework to remedy the situation. We cast the structured sentiment problem as dependency graph parsing, where the nodes are spans of sentiment holders, targets and expressions, and the arcs are the relations between them. We perform experiments on five datasets in four languages (English, Norwegian, Basque, and Catalan) and show that this approach leads to strong improvements over state-of-the-art baselines. Our analysis shows that refining the sentiment graphs with syntactic dependency information further improves results.


title: Computation-aided classical-quantum multiple access to boost network communication speeds

abstract: A multiple access channel (MAC) consists of multiple senders simultaneously transmitting their messages to a single receiver. For the classical-quantum case (cq-MAC), achievable rates are known assuming that all the messages are decoded, a common assumption in quantum network design. However, such a conventional design approach ignores the global network structure, i.e., the network topology. When a cq-MAC is given as a part of quantum network communication, this work shows that computation properties can be used to boost communication speeds with code design dependently on the network topology. We quantify achievable quantum communication rates of codes with computation property for a two-sender cq-MAC. When the two-sender cq-MAC is a boson coherent channel with binary discrete modulation, we show that it achieves the maximum possible communication rate (the single-user capacity), which cannot be achieved with conventional design. Further, such a rate can be achieved by different detection methods: quantum (with and without quantum memory), on-off photon counting and homodyne (each at different photon power). Finally, we describe two practical applications, one of which cryptographic.


title: Drop Clause: Enhancing Performance, Interpretability and Robustness of the Tsetlin Machine

abstract: In this article, we introduce a novel variant of the Tsetlin machine (TM) that randomly drops clauses, the key learning elements of a TM. In effect, TM with drop clause ignores a random selection of the clauses in each epoch, selected according to a predefined probability. In this way, additional stochasticity is introduced in the learning phase of TM. To explore the effects drop clause has on accuracy, training time, interpretability and robustness, we conduct extensive experiments on nine benchmark datasets in natural language processing~(NLP) (IMDb, R8, R52, MR and TREC) and image classification (MNIST, Fashion MNIST, CIFAR-10 and CIFAR-100). Our proposed model outperforms baseline machine learning algorithms by a wide margin and achieves competitive performance in comparison with recent deep learning model such as BERT and AlexNET-DFA. In brief, we observe up to +10% increase in accuracy and 2x to 4x faster learning compared with standard TM. We further employ the Convolutional TM to document interpretable results on the CIFAR datasets, visualizing how the heatmaps produced by the TM become more interpretable with drop clause. We also evaluate how drop clause affects learning robustness by introducing corruptions and alterations in the image/language test data. Our results show that drop clause makes TM more robust towards such changes.


title: Entanglement Rate Optimization in Heterogeneous Quantum Communication Networks

abstract: Quantum communication networks are emerging as a promising technology that could constitute a key building block in future communication networks in the 6G era and beyond. These networks have an inherent feature of parallelism that allows them to boost the capacity and enhance the security of communication systems. Recent advances led to the deployment of small- and large-scale quantum communication networks with real quantum hardware. In quantum networks, entanglement is a key resource that allows for data transmission between different nodes. However, to reap the benefits of entanglement and enable efficient quantum communication, the number of generated entangled pairs must be optimized. Indeed, if the entanglement generation rates are not optimized, then some of these valuable resources will be discarded and lost. In this paper, the problem of optimizing the entanglement generation rates and their distribution over a quantum memory is studied. In particular, a quantum network in which users have heterogeneous distances and applications is considered. This problem is posed as a mixed integer nonlinear programming optimization problem whose goal is to efficiently utilize the available quantum memory by distributing the quantum entangled pairs in a way that maximizes the user satisfaction. An interior point optimization method is used to solve the optimization problem and extensive simulations are conducted to evaluate the effectiveness of the proposed system. Simulation results show the key design considerations for efficient quantum networks, and the effect of different network parameters on the network performance.


title: Some hypersurfaces over finite fields, minimal codes and secret sharing schemes

abstract: Linear error-correcting codes can be used for constructing secret sharing schemes; however finding in general the access structures of these secret sharing schemes and, in particular, determining efficient access structures is difficult. Here we investigate the properties of certain algebraic hypersurfaces over finite fields, whose intersection numbers with any hyperplane only takes a few values; these varieties give rise to $q$-divisible linear codes with at most $5$ weights. Furthermore, for $q$ odd these codes turn out to be minimal and we characterize the access structures of the secret sharing schemes based on their dual codes. Indeed, the secret sharing schemes thus obtained are democratic, that is each participant belongs to the same number of minimal access sets and can easily be described.


title: Shack Hartmann wavefront sensor with array of phase coded masks

abstract: Shack-Hartmann wavefront sensors (SHWS) are generally used to measure the wavefront curvature of light beams. Measurement accuracy and the sensitivity of these sensors are important factors for better wavefront sensing. In this study, we demonstrate a new type of SHWS with better measurement accuracy than the regular SHWS. The lenslet array in the regular SHWS is replaced with an array of coded phase masks and the principle of coded aperture correlation holography (COACH) is used for wavefront reconstruction. Sharper correlation peaks achieved by COACH improve the accuracy of the estimated local slopes of the measured wavefront and consequently improve the reconstruction accuracy of the overall wavefront. Experimental results confirm that the proposed method provides a lower mean square wavefront error by one order of magnitude in comparison to the regular SHWS.


title: Effect of Camera's Focal Plane Array Fill Factor on Digital Image Correlation Measurement Accuracy

abstract: The camera's focal plane array (FPA) fill factor is one of the parameters for digital cameras, though it is not widely known and usually not reported in specs sheets. The fill factor of an imaging sensor is defined as the ratio of a pixel's light sensitive area to its total theoretical area. It is generally believed that the lower fill factor may reduce the accuracy of photogrammetric measurements. But nevertheless, there are no studies addressing the effect of the imaging sensor's fill factor on digital image correlation (DIC) measurement accuracy. We report on research aiming to quantify the effect of fill factor on DIC measurements accuracy in terms of displacement error and strain error. We use rigid-body-translation experiments then numerically modify the recorded images to synthesize three different types of images with 1/4 of the original resolution. Each type of the synthesized images has different value of the fill factor; namely 100%, 50% and 25%. By performing DIC analysis with the same parameters on the three different types of synthesized images, the effect of fill factor on measurement accuracy may be realized. Our results show that the FPA's fill factor can have a significant effect on the accuracy of DIC measurements. This effect is clearly dependent on the type and characteristics of the speckle pattern. The fill factor has a clear effect on measurement error for low contrast speckle patterns and for high contrast speckle patterns (black dots on white background) with small dot size (3 pixels dot diameter). However, when the dot size is large enough (about 7 pixels dot diameter), the fill factor has very minor effect on measurement error.


title: Study of Z bosons plus jets events using variables sensitive to double-parton scattering in pp collisions at 13 TeV

abstract: Double-parton scattering is investigated using events with a Z boson and jets. The Z boson is reconstructed using only the dimuon channel. The measurements are performed with proton-proton collision data recorded by the CMS experiment at the LHC at $\sqrt{s} =$ 13 TeV, corresponding to an integrated luminosity of 35.9 fb$^{-1}$ collected in the year 2016. Differential cross sections of Z + $\geq$ 1 jet and Z + $\geq$ 2 jets are measured with transverse momentum of the jets above 20 GeV and pseudorapidity $|\eta|$ $\lt$ 2.4. Several distributions with sensitivity to double-parton scattering effects are measured as functions of the angle and the transverse momentum imbalance between the Z boson and the jets. The measured distributions are compared with predictions from several event generators with different hadronization models and different parameter settings for multiparton interactions. The measured distributions show a dependence on the hadronization and multiparton interaction simulation parameters, and are important input for future improvements of the simulations.


title: SHELBRS: Location Based Recommendation Services using Switchable Homomorphic Encryption

abstract: Location-Based Recommendation Services (LBRS) has seen an unprecedented rise in its usage in recent years. LBRS facilitates a user by recommending services based on his location and past preferences. However, leveraging such services comes at a cost of compromising one's sensitive information like their shopping preferences, lodging places, food habits, recently visited places, etc. to the third-party servers. Losing such information could be crucial and threatens one's privacy. Nowadays, the privacy-aware society seeks solutions that can provide such services, with minimized risks. Recently, a few privacy-preserving recommendation services have been proposed that exploit the fully homomorphic encryption (FHE) properties to address the issue. Though, it reduced privacy risks but suffered from heavy computational overheads that ruled out their commercial applications. Here, we propose SHELBRS, a lightweight LBRS that is based on switchable homomorphic encryption (SHE), which will benefit the users as well as the service providers. A SHE exploits both the additive as well as the multiplicative homomorphic properties but with comparatively much lesser processing time as it's FHE counterpart. We evaluate the performance of our proposed scheme with the other state-of-the-art approaches without compromising security.


title: Knowledge Transfer for Few-shot Segmentation of Novel White Matter Tracts

abstract: Convolutional neural networks (CNNs) have achieved stateof-the-art performance for white matter (WM) tract segmentation based on diffusion magnetic resonance imaging (dMRI). These CNNs require a large number of manual delineations of the WM tracts of interest for training, which are generally labor-intensive and costly. The expensive manual delineation can be a particular disadvantage when novel WM tracts, i.e., tracts that have not been included in existing manual delineations, are to be analyzed. To accurately segment novel WM tracts, it is desirable to transfer the knowledge learned about existing WM tracts, so that even with only a few delineations of the novel WM tracts, CNNs can learn adequately for the segmentation. In this paper, we explore the transfer of such knowledge to the segmentation of novel WM tracts in the few-shot setting. Although a classic fine-tuning strategy can be used for the purpose, the information in the last task-specific layer for segmenting existing WM tracts is completely discarded. We hypothesize that the weights of this last layer can bear valuable information for segmenting the novel WM tracts and thus completely discarding the information is not optimal. In particular, we assume that the novel WM tracts can correlate with existing WM tracts and the segmentation of novel WM tracts can be predicted with the logits of existing WM tracts. In this way, better initialization of the last layer than random initialization can be achieved for fine-tuning. Further, we show that a more adaptive use of the knowledge in the last layer for segmenting existing WM tracts can be conveniently achieved by simply inserting a warmup stage before classic fine-tuning. The proposed method was evaluated on a publicly available dMRI dataset, where we demonstrate the benefit of our method for few-shot segmentation of novel WM tracts.


title: Cosmological Analysis using Panstarrs data: Hubble Constant and Direction Dependence

abstract: Hubble tension and the search for preferred direction are two crucial unresolved issues in modern cosmology. Different measurements of the Hubble constant provide significantly different values, and this is known as the Hubble tension. The cosmological principle assumes that the universe is homogeneous and isotropic; however, deviations from the isotropy have often been observed. We apply the Bayesian tools and the Extreme Value theory dependent statistic to address the above issues. These techniques have been applied to the Panstarrs1 type Ia supernovae data. Our analysis for Hubble constant does not reject the Hubble tension. However, our value is smaller than that of the SHoES program and agrees with the CCHP value. Extreme value theory-based analysis indicates that the data does not show direction dependence. As a byproduct of our technique, we show that the errors in the data are non-Gaussian in nature.


title: How Low is Too Low? A Computational Perspective on Extremely Low-Resource Languages

abstract: Despite the recent advancements of attention-based deep learning architectures across a majority of Natural Language Processing tasks, their application remains limited in a low-resource setting because of a lack of pre-trained models for such languages. In this study, we make the first attempt to investigate the challenges of adapting these techniques for an extremely low-resource language -- Sumerian cuneiform -- one of the world's oldest written languages attested from at least the beginning of the 3rd millennium BC. Specifically, we introduce the first cross-lingual information extraction pipeline for Sumerian, which includes part-of-speech tagging, named entity recognition, and machine translation. We further curate InterpretLR, an interpretability toolkit for low-resource NLP, and use it alongside human attributions to make sense of the models. We emphasize on human evaluations to gauge all our techniques. Notably, most components of our pipeline can be generalised to any other language to obtain an interpretable execution of the techniques, especially in a low-resource setting. We publicly release all software, model checkpoints, and a novel dataset with domain-specific pre-processing to promote further research.


title: Intergalactic heating by Lyman-alpha photons including hyperfine structure corrections

abstract: Lyman-alpha photons from the first radiating sources in the Universe play a pivotal role in 21-cm radio detections of Cosmic Dawn and the Epoch of Reionization. Comments are provided on the effect of the hyperfine structure of hydrogen on the rate of heating or cooling of the Intergalactic Medium. It is shown that heating of the still neutral hydrogen by the Cosmic Microwave Background is negligible, with a characteristic heating time of 1e27 s/ (1+z) at redshift z.


title: GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoning

abstract: Automatic math problem solving has recently attracted increasing attention as a long-standing AI benchmark. In this paper, we focus on solving geometric problems, which requires a comprehensive understanding of textual descriptions, visual diagrams, and theorem knowledge. However, the existing methods were highly dependent on handcraft rules and were merely evaluated on small-scale datasets. Therefore, we propose a Geometric Question Answering dataset GeoQA, containing 4,998 geometric problems with corresponding annotated programs, which illustrate the solving process of the given problems. Compared with another publicly available dataset GeoS, GeoQA is 25 times larger, in which the program annotations can provide a practical testbed for future research on explicit and explainable numerical reasoning. Moreover, we introduce a Neural Geometric Solver (NGS) to address geometric problems by comprehensively parsing multimodal information and generating interpretable programs. We further add multiple self-supervised auxiliary tasks on NGS to enhance cross-modal semantic representation. Extensive experiments on GeoQA validate the effectiveness of our proposed NGS and auxiliary tasks. However, the results are still significantly lower than human performance, which leaves large room for future research. Our benchmark and code are released at https://github.com/chen-judge/GeoQA .


title: Identification of source terms in heat equation with dynamic boundary conditions

abstract: We study an inverse parabolic problem of identifying two source terms in heat equation with dynamic boundary conditions from a final time overdetermination data. Using a weak solution approach by Hasanov, the associated cost functional is analyzed, especially a gradient formula of the functional is proved and given in terms of the solution of an adjoint problem. Next, the existence and uniqueness of a quasi-solution are also investigated. Finally, the numerical reconstruction of some heat sources in a 1-D equation is presented to show the efficiency of the proposed algorithm.


title: RFCBF: enhance the performance and stability of Fast Correlation-Based Filter

abstract: Feature selection is a preprocessing step which plays a crucial role in the domain of machine learning and data mining. Feature selection methods have been shown to be effctive in removing redundant and irrelevant features, improving the learning algorithm's prediction performance. Among the various methods of feature selection based on redundancy, the fast correlation-based filter (FCBF) is one of the most effective. In this paper, we proposed a novel extension of FCBF, called RFCBF, which combines resampling technique to improve classification accuracy. We performed comprehensive experiments to compare the RFCBF with other state-of-the-art feature selection methods using the KNN classifier on 12 publicly available data sets. The experimental results show that the RFCBF algorithm yields significantly better results than previous state-of-the-art methods in terms of classification accuracy and runtime.


title: Unsupervised Joint Learning of Depth, Optical Flow, Ego-motion from Video

abstract: Estimating geometric elements such as depth, camera motion, and optical flow from images is an important part of the robot's visual perception. We use a joint self-supervised method to estimate the three geometric elements. Depth network, optical flow network and camera motion network are independent of each other but are jointly optimized during training phase. Compared with independent training, joint training can make full use of the geometric relationship between geometric elements and provide dynamic and static information of the scene. In this paper, we improve the joint self-supervision method from three aspects: network structure, dynamic object segmentation, and geometric constraints. In terms of network structure, we apply the attention mechanism to the camera motion network, which helps to take advantage of the similarity of camera movement between frames. And according to attention mechanism in Transformer, we propose a plug-and-play convolutional attention module. In terms of dynamic object, according to the different influences of dynamic objects in the optical flow self-supervised framework and the depth-pose self-supervised framework, we propose a threshold algorithm to detect dynamic regions, and mask that in the loss function respectively. In terms of geometric constraints, we use traditional methods to estimate the fundamental matrix from the corresponding points to constrain the camera motion network. We demonstrate the effectiveness of our method on the KITTI dataset. Compared with other joint self-supervised methods, our method achieves state-of-the-art performance in the estimation of pose and optical flow, and the depth estimation has also achieved competitive results. Code will be available https://github.com/jianfenglihg/Unsupervised_geometry.


title: Anisotropy in interface stress at the BCC-iron solid-melt interface: molecular dynamics and phase field crystal modelling

abstract: The interface stresses at of the solid-melt interface are, in general, anisotropic. The anisotropy in the interfacial stress can be evaluated using molecular dynamics (MD) and phase field crystal (PFC) models. In this paper, we report our results on the evaluation of the anisotropy in interface stress in a BCC solid with its melt. Specifically, we study Fe using both MD and PFC models. We show that while both MD and PFC can be used for the evaluation, and the PFC and the amplitude equations based on PFC give quantitatively consistent results, the MD and PFC results are qualitatively the same but do not match quantitatively. We also find that even though the interfacial free energy is only weakly anisotropic in BCC interfacial stress anisotropy is strong. This strong anisotropy has implications for the equilibrium shapes, growth morphologies and other properties at nano-scale in these materials.


title: Vector Detection Network: An Application Study on Robots Reading Analog Meters in the Wild

abstract: Analog meters equipped with one or multiple pointers are wildly utilized to monitor vital devices' status in industrial sites for safety concerns. Reading these legacy meters {\bi autonomously} remains an open problem since estimating pointer origin and direction under imaging damping factors imposed in the wild could be challenging. Nevertheless, high accuracy, flexibility, and real-time performance are demanded. In this work, we propose the Vector Detection Network (VDN) to detect analog meters' pointers given their images, eliminating the barriers for autonomously reading such meters using intelligent agents like robots. We tackled the pointer as a two-dimensional vector, whose initial point coincides with the tip, and the direction is along tail-to-tip. The network estimates a confidence map, wherein the peak pixels are treated as vectors' initial points, along with a two-layer scalar map, whose pixel values at each peak form the scalar components in the directions of the coordinate axes. We established the Pointer-10K dataset composing of real-world analog meter images to evaluate our approach due to no similar dataset is available for now. Experiments on the dataset demonstrated that our methods generalize well to various meters, robust to harsh imaging factors, and run in real-time.


title: The Merger Rate of Black Holes in a Primordial Black Hole Cluster

abstract: In this paper, the merger rate of black holes in a cluster of primordial black holes (PBHs) is investigated. The clusters have characteristics close to those of typical globular star clusters. A cluster that has a wide mass spectrum ranging from $10^{-2}$ to $10 \, M_{\odot}$ (Solar mass) and contains a massive central black hole of the mass $M_{\bullet} = 10^3 \, M_{\odot}$ is considered. It is shown that in the process of the evolution of cluster, the merger rate changed significantly, and by now, the PBH clusters have passed the stage of active merging of the black holes inside~them.


title: Parameter Estimation for the SEIR Model Using Recurrent Nets

abstract: The standard way to estimate the parameters $\Theta_\text{SEIR}$ (e.g., the transmission rate $\beta$) of an SEIR model is to use grid search, where simulations are performed on each set of parameters, and the parameter set leading to the least $L_2$ distance between predicted number of infections and observed infections is selected. This brute-force strategy is not only time consuming, as simulations are slow when the population is large, but also inaccurate, since it is impossible to enumerate all parameter combinations. To address these issues, in this paper, we propose to transform the non-differentiable problem of finding optimal $\Theta_\text{SEIR}$ to a differentiable one, where we first train a recurrent net to fit a small number of simulation data. Next, based on this recurrent net that is able to generalize SEIR simulations, we are able to transform the objective to a differentiable one with respect to $\Theta_\text{SEIR}$, and straightforwardly obtain its optimal value. The proposed strategy is both time efficient as it only relies on a small number of SEIR simulations, and accurate as we are able to find the optimal $\Theta_\text{SEIR}$ based on the differentiable objective. On two COVID-19 datasets, we observe that the proposed strategy leads to significantly better parameter estimations with a smaller number of simulations.


title: $q$-Analogs of strongly regular graphs

abstract: We introduce the notion of q-analogs of strongly regular graphs and give several examples of such structures. We prove a necessary condition on the parameters, show the connection to designs over finite fields, and present a classification.


title: LRTuner: A Learning Rate Tuner for Deep Neural Networks

abstract: One very important hyperparameter for training deep neural networks is the learning rate schedule of the optimizer. The choice of learning rate schedule determines the computational cost of getting close to a minima, how close you actually get to the minima, and most importantly the kind of local minima (wide/narrow) attained. The kind of minima attained has a significant impact on the generalization accuracy of the network. Current systems employ hand tuned learning rate schedules, which are painstakingly tuned for each network and dataset. Given that the state space of schedules is huge, finding a satisfactory learning rate schedule can be very time consuming. In this paper, we present LRTuner, a method for tuning the learning rate as training proceeds. Our method works with any optimizer, and we demonstrate results on SGD with Momentum, and Adam optimizers. We extensively evaluate LRTuner on multiple datasets, models, and across optimizers. We compare favorably against standard learning rate schedules for the given dataset and models, including ImageNet on Resnet-50, Cifar-10 on Resnet-18, and SQuAD fine-tuning on BERT. For example on ImageNet with Resnet-50, LRTuner shows up to 0.2% absolute gains in test accuracy compared to the hand-tuned baseline schedule. Moreover, LRTuner can achieve the same accuracy as the baseline schedule in 29% less optimization steps.


title: Reflow: Zero Knowledge Multi Party Signatures with Application to Distributed Authentication

abstract: Reflow is a novel signature scheme supporting unlinkable signatures by multiple parties authenticated by means of zero-knowledge credentials. Reflow integrates with blockchains and graph databases to ensure confidentiality and authenticity of signatures made by disposable identities that can be verified even when credential issuing authorities are offline. We implement and evaluate Reflow smart contracts for Zenroom and present an application to produce authenticated material passports for resource-event-agent accounting systems based on graph data structures. Reflow uses short and computationally efficient authentication credentials and can easily scale signatures to include thousands of participants.